2024-05-27T10:38:31.317 INFO:root:teuthology version: 0.0.1.dev291+ge7ae758 2024-05-27T10:38:31.318 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2024-05-27_10:29:57-fs:volumes-rishabh-clone-stats-testing-default-smithi/7727872 --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}} --owner scheduled_rishabh@teuthology --name rishabh-2024-05-27_10:29:57-fs:volumes-rishabh-clone-stats-testing-default-smithi --verbose -- /home/teuthworker/archive/rishabh-2024-05-27_10:29:57-fs:volumes-rishabh-clone-stats-testing-default-smithi/7727872/orig.config.yaml 2024-05-27T10:38:31.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-27T10:38:31.449 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-05-27_10:29:57-fs:volumes-rishabh-clone-stats-testing-default-smithi/7727872 branch: rishabh-clone-stats description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}} email: null first_in_suite: false job_id: '7727872' kernel: flavor: default kdb: 1 sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-05-27_10:29:57-fs:volumes-rishabh-clone-stats-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-clone-stats ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 81797d879079e1a392b37a9c23a946594f658c50 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 81797d879079e1a392b37a9c23a946594f658c50 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: mgr-vol-clone-stats sha1: 6c790e41985923230aa0b50494ebab22e6b4e3f9 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4362 sha1: 81797d879079e1a392b37a9c23a946594f658c50 sleep_before_teardown: 0 suite: fs:volumes suite_branch: mgr-vol-clone-stats suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_6c790e41985923230aa0b50494ebab22e6b4e3f9/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 6c790e41985923230aa0b50494ebab22e6b4e3f9 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH5wLwSQ4H5Ebaj/0V9LKrZPsoMCwCFj2+UnTzcUHnWRsbCgEXVkDOJalCwigYmXvopVAGKFet5+XE8dTFdw3zQ= smithi053.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHjO/euyQqI3if50vI1pDcEp5pAQrjvZrSix6pZEcNGKqWqcnJeNK4v8jssThi9S49ZiIPrgTeEqvT87dpcvXyo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestCloneProgressReporter teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: e7ae7580c417d6ab27fda98fecadca5d9f85d63e timestamp: 2024-05-27_10:29:57 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-05-27T10:38:31.449 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_6c790e41985923230aa0b50494ebab22e6b4e3f9/qa; will attempt to use it 2024-05-27T10:38:31.527 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_6c790e41985923230aa0b50494ebab22e6b4e3f9/qa/tasks 2024-05-27T10:38:31.527 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-27T10:38:31.529 INFO:teuthology.task.internal:Checking packages... 2024-05-27T10:38:31.552 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '81797d879079e1a392b37a9c23a946594f658c50' 2024-05-27T10:38:31.552 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-27T10:38:31.552 INFO:teuthology.packaging:ref: None 2024-05-27T10:38:31.552 INFO:teuthology.packaging:tag: None 2024-05-27T10:38:31.552 INFO:teuthology.packaging:branch: rishabh-clone-stats 2024-05-27T10:38:31.552 INFO:teuthology.packaging:sha1: 81797d879079e1a392b37a9c23a946594f658c50 2024-05-27T10:38:31.553 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-clone-stats 2024-05-27T10:38:31.699 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3154.g81797d87 2024-05-27T10:38:31.701 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-27T10:38:31.707 INFO:teuthology.task.internal:no buildpackages task found 2024-05-27T10:38:31.707 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-27T10:38:31.728 INFO:teuthology.task.internal:Saving configuration 2024-05-27T10:38:31.744 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-27T10:38:31.767 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-27T10:38:31.792 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-27_10:29:57-fs:volumes-rishabh-clone-stats-testing-default-smithi/7727872', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-27 10:31:06.032989', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH5wLwSQ4H5Ebaj/0V9LKrZPsoMCwCFj2+UnTzcUHnWRsbCgEXVkDOJalCwigYmXvopVAGKFet5+XE8dTFdw3zQ='} 2024-05-27T10:38:31.816 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-27_10:29:57-fs:volumes-rishabh-clone-stats-testing-default-smithi/7727872', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-27 10:31:06.034438', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHjO/euyQqI3if50vI1pDcEp5pAQrjvZrSix6pZEcNGKqWqcnJeNK4v8jssThi9S49ZiIPrgTeEqvT87dpcvXyo='} 2024-05-27T10:38:31.816 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-27T10:38:31.825 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-27T10:38:31.826 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-27T10:38:31.826 INFO:teuthology.run_tasks:Running task console_log... 2024-05-27T10:38:31.909 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff712de3be0>, signals=[15]) 2024-05-27T10:38:31.909 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-27T10:38:31.915 INFO:teuthology.task.internal:Opening connections... 2024-05-27T10:38:31.915 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-05-27T10:38:31.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T10:38:31.992 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi053.front.sepia.ceph.com 2024-05-27T10:38:31.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T10:38:32.069 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-27T10:38:32.076 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-05-27T10:38:32.095 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-05-27T10:38:32.095 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-05-27T10:38:32.153 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-05-27T10:38:32.153 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-05-27T10:38:32.153 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-05-27T10:38:32.153 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-05-27T10:38:32.153 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-05-27T10:38:32.154 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-05-27T10:38:32.154 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-27T10:38:32.154 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-05-27T10:38:32.154 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-05-27T10:38:32.154 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-27T10:38:32.154 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-05-27T10:38:32.154 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-27T10:38:32.154 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-27T10:38:32.154 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-27T10:38:32.155 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-05-27T10:38:32.179 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2024-05-27T10:38:32.198 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2024-05-27T10:38:32.198 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2024-05-27T10:38:32.256 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream" 2024-05-27T10:38:32.256 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9" 2024-05-27T10:38:32.256 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos" 2024-05-27T10:38:32.256 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora" 2024-05-27T10:38:32.256 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9" 2024-05-27T10:38:32.256 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9" 2024-05-27T10:38:32.256 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-27T10:38:32.256 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2024-05-27T10:38:32.257 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon" 2024-05-27T10:38:32.257 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-27T10:38:32.257 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/" 2024-05-27T10:38:32.257 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-27T10:38:32.257 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-27T10:38:32.257 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-27T10:38:32.257 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2024-05-27T10:38:32.279 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-27T10:38:32.288 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-27T10:38:32.298 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-27T10:38:32.299 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-05-27T10:38:32.301 DEBUG:teuthology.orchestra.run.smithi053:> test '!' -e /home/ubuntu/cephtest 2024-05-27T10:38:32.318 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-27T10:38:32.339 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-27T10:38:32.339 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-05-27T10:38:32.358 DEBUG:teuthology.orchestra.run.smithi053:> test -z $(ls -A /var/lib/ceph) 2024-05-27T10:38:32.387 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-27T10:38:32.446 INFO:teuthology.run_tasks:Running task kernel... 2024-05-27T10:38:32.460 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'} 2024-05-27T10:38:32.460 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'}, 'mon.b': {'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'}}, timeout 300 2024-05-27T10:38:32.460 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-27T10:38:32.461 DEBUG:teuthology.orchestra.run.smithi053:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-27T10:38:32.478 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T10:38:32.478 DEBUG:teuthology.task.kernel:sha1 for mon.a is b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-27T10:38:32.478 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "b9459a26b0888785d05c47deb35abc9d0354ab93"... 2024-05-27T10:38:32.478 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-05-27T10:38:32.479 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T10:38:32.480 DEBUG:teuthology.task.kernel:sha1 for mon.b is b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-27T10:38:32.480 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "b9459a26b0888785d05c47deb35abc9d0354ab93"... 2024-05-27T10:38:32.480 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-05-27T10:38:32.536 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-437.el9.x86_64 2024-05-27T10:38:32.536 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-27T10:38:32.536 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-27T10:38:32.537 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-27T10:38:32.540 INFO:teuthology.orchestra.run.smithi053.stdout:5.14.0-437.el9.x86_64 2024-05-27T10:38:32.540 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-27T10:38:32.540 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-27T10:38:32.540 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-27T10:38:32.677 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum upgrade -y linux-firmware 2024-05-27T10:38:32.691 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum upgrade -y linux-firmware 2024-05-27T10:38:34.723 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.1 MB 00:00 2024-05-27T10:38:35.478 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - BaseOS 6.3 MB/s | 8.1 MB 00:01 2024-05-27T10:38:36.882 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-05-27T10:38:37.280 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-05-27T10:38:41.069 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-05-27T10:38:43.063 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.2 MB 00:02 2024-05-27T10:38:43.392 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 17 kB 00:01 2024-05-27T10:38:44.665 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 17 kB 00:00 2024-05-27T10:38:45.177 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-27T10:38:45.941 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-05-27T10:38:50.502 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-05-27T10:38:51.224 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-05-27T10:38:52.521 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-05-27T10:38:52.522 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-05-27T10:38:52.522 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-05-27T10:38:52.620 INFO:teuthology.task.kernel:Downloading kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on mon.a... 2024-05-27T10:38:52.621 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-27T10:38:52.766 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ 2024-05-27T10:38:52.767 DEBUG:teuthology.orchestra.run.smithi047:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_gb9459a26b088-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-27T10:38:52.769 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi047.front.sepia.ceph.com to complete... 2024-05-27T10:38:53.250 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-27T10:38:53.251 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-05-27T10:38:53.251 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-27T10:38:53.377 INFO:teuthology.task.kernel:Downloading kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on mon.b... 2024-05-27T10:38:53.378 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-27T10:38:53.591 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ 2024-05-27T10:38:53.591 DEBUG:teuthology.orchestra.run.smithi053:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_gb9459a26b088-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-27T10:38:53.594 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi053.front.sepia.ceph.com to complete... 2024-05-27T10:39:06.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27 10:39:06 URL:https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/kernel-6.9.0_gb9459a26b088-1.x86_64.rpm [356863406/356863406] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-27T10:39:06.412 INFO:teuthology.orchestra.run.smithi047.stderr:FINISHED --2024-05-27 10:39:06-- 2024-05-27T10:39:06.412 INFO:teuthology.orchestra.run.smithi047.stderr:Total wall clock time: 14s 2024-05-27T10:39:06.412 INFO:teuthology.orchestra.run.smithi047.stderr:Downloaded: 1 files, 340M in 13s (25.6 MB/s) 2024-05-27T10:39:06.414 INFO:teuthology.task.kernel:Installing kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on mon.a... 2024-05-27T10:39:06.415 DEBUG:teuthology.orchestra.run.smithi047:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-27T10:39:08.591 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying... ######################################## 2024-05-27T10:39:08.710 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing... ######################################## 2024-05-27T10:39:08.814 INFO:teuthology.orchestra.run.smithi047.stdout:Updating / installing... 2024-05-27T10:39:17.103 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-6.9.0_gb9459a26b088-1 ######################################## 2024-05-27T10:39:23.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27 10:39:23 URL:https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/kernel-6.9.0_gb9459a26b088-1.x86_64.rpm [356863406/356863406] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-27T10:39:23.765 INFO:teuthology.orchestra.run.smithi053.stderr:FINISHED --2024-05-27 10:39:23-- 2024-05-27T10:39:23.765 INFO:teuthology.orchestra.run.smithi053.stderr:Total wall clock time: 30s 2024-05-27T10:39:23.765 INFO:teuthology.orchestra.run.smithi053.stderr:Downloaded: 1 files, 340M in 30s (11.4 MB/s) 2024-05-27T10:39:23.767 INFO:teuthology.task.kernel:Installing kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on mon.b... 2024-05-27T10:39:23.768 DEBUG:teuthology.orchestra.run.smithi053:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-27T10:39:25.956 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying... ######################################## 2024-05-27T10:39:26.086 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing... ######################################## 2024-05-27T10:39:26.208 INFO:teuthology.orchestra.run.smithi053.stdout:Updating / installing... 2024-05-27T10:39:34.491 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-6.9.0_gb9459a26b088-1 ######################################## 2024-05-27T10:39:56.972 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi047.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-27T10:39:56.972 DEBUG:teuthology.orchestra.run.smithi047:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-27T10:39:57.058 INFO:teuthology.orchestra.run.smithi047.stdout:/boot/System.map-6.9.0-gb9459a26b088 2024-05-27T10:39:57.058 INFO:teuthology.orchestra.run.smithi047.stdout:/boot/config-6.9.0-gb9459a26b088 2024-05-27T10:39:57.059 INFO:teuthology.orchestra.run.smithi047.stdout:/boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-27T10:39:57.059 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/System.map 2024-05-27T10:39:57.059 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/config 2024-05-27T10:39:57.059 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel 2024-05-27T10:39:57.059 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch 2024-05-27T10:39:57.059 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86 2024-05-27T10:39:57.059 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto 2024-05-27T10:39:57.059 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-27T10:39:57.059 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-27T10:39:57.059 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-27T10:39:57.059 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-27T10:39:57.060 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-27T10:39:57.060 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-27T10:39:57.060 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-27T10:39:57.060 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-27T10:39:57.060 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-27T10:39:57.060 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-27T10:39:57.060 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-27T10:39:57.060 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-27T10:39:57.060 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-27T10:39:57.060 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-27T10:39:57.060 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-27T10:39:57.061 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-27T10:39:57.061 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-27T10:39:57.061 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-27T10:39:57.061 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-27T10:39:57.061 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-27T10:39:57.061 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel 2024-05-27T10:39:57.061 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu 2024-05-27T10:39:57.061 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce 2024-05-27T10:39:57.061 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-27T10:39:57.061 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm 2024-05-27T10:39:57.061 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-27T10:39:57.061 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-27T10:39:57.061 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm.ko 2024-05-27T10:39:57.062 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto 2024-05-27T10:39:57.062 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ansi_cprng.ko 2024-05-27T10:39:57.062 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/anubis.ko 2024-05-27T10:39:57.062 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/arc4.ko 2024-05-27T10:39:57.062 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx 2024-05-27T10:39:57.062 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_memcpy.ko 2024-05-27T10:39:57.062 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_pq.ko 2024-05-27T10:39:57.062 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-27T10:39:57.062 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_tx.ko 2024-05-27T10:39:57.062 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_xor.ko 2024-05-27T10:39:57.063 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/raid6test.ko 2024-05-27T10:39:57.063 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authenc.ko 2024-05-27T10:39:57.063 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authencesn.ko 2024-05-27T10:39:57.063 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blake2b_generic.ko 2024-05-27T10:39:57.063 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_common.ko 2024-05-27T10:39:57.063 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_generic.ko 2024-05-27T10:39:57.063 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/camellia_generic.ko 2024-05-27T10:39:57.063 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast5_generic.ko 2024-05-27T10:39:57.063 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast6_generic.ko 2024-05-27T10:39:57.063 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast_common.ko 2024-05-27T10:39:57.063 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ccm.ko 2024-05-27T10:39:57.063 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cmac.ko 2024-05-27T10:39:57.064 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crc32_generic.ko 2024-05-27T10:39:57.064 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_engine.ko 2024-05-27T10:39:57.064 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_user.ko 2024-05-27T10:39:57.064 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cts.ko 2024-05-27T10:39:57.064 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/des_generic.ko 2024-05-27T10:39:57.064 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/dh_generic.ko 2024-05-27T10:39:57.064 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/echainiv.ko 2024-05-27T10:39:57.064 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/essiv.ko 2024-05-27T10:39:57.064 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/fcrypt.ko 2024-05-27T10:39:57.064 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/khazad.ko 2024-05-27T10:39:57.064 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4.ko 2024-05-27T10:39:57.064 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4hc.ko 2024-05-27T10:39:57.064 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/md4.ko 2024-05-27T10:39:57.065 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/michael_mic.ko 2024-05-27T10:39:57.065 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcbc.ko 2024-05-27T10:39:57.065 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcrypt.ko 2024-05-27T10:39:57.065 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/rmd160.ko 2024-05-27T10:39:57.065 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/seed.ko 2024-05-27T10:39:57.065 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/serpent_generic.ko 2024-05-27T10:39:57.065 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tcrypt.ko 2024-05-27T10:39:57.065 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tea.ko 2024-05-27T10:39:57.065 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_common.ko 2024-05-27T10:39:57.065 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_generic.ko 2024-05-27T10:39:57.065 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/vmac.ko 2024-05-27T10:39:57.065 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/wp512.ko 2024-05-27T10:39:57.065 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xcbc.ko 2024-05-27T10:39:57.066 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xor.ko 2024-05-27T10:39:57.066 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xxhash_generic.ko 2024-05-27T10:39:57.066 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers 2024-05-27T10:39:57.066 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi 2024-05-27T10:39:57.066 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-27T10:39:57.066 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_pad.ko 2024-05-27T10:39:57.066 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ec_sys.ko 2024-05-27T10:39:57.066 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/platform_profile.ko 2024-05-27T10:39:57.066 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbs.ko 2024-05-27T10:39:57.066 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbshc.ko 2024-05-27T10:39:57.066 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/video.ko 2024-05-27T10:39:57.066 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata 2024-05-27T10:39:57.066 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/acard-ahci.ko 2024-05-27T10:39:57.066 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci_platform.ko 2024-05-27T10:39:57.067 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ata_generic.ko 2024-05-27T10:39:57.067 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci_platform.ko 2024-05-27T10:39:57.067 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_acpi.ko 2024-05-27T10:39:57.067 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ali.ko 2024-05-27T10:39:57.067 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_amd.ko 2024-05-27T10:39:57.067 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_artop.ko 2024-05-27T10:39:57.067 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atiixp.ko 2024-05-27T10:39:57.067 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atp867x.ko 2024-05-27T10:39:57.067 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd640.ko 2024-05-27T10:39:57.067 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd64x.ko 2024-05-27T10:39:57.067 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cypress.ko 2024-05-27T10:39:57.067 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_efar.ko 2024-05-27T10:39:57.067 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt366.ko 2024-05-27T10:39:57.068 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt37x.ko 2024-05-27T10:39:57.068 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-27T10:39:57.068 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-27T10:39:57.068 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it8213.ko 2024-05-27T10:39:57.068 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it821x.ko 2024-05-27T10:39:57.068 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_jmicron.ko 2024-05-27T10:39:57.068 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_marvell.ko 2024-05-27T10:39:57.068 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_mpiix.ko 2024-05-27T10:39:57.068 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_netcell.ko 2024-05-27T10:39:57.068 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ninja32.ko 2024-05-27T10:39:57.068 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87410.ko 2024-05-27T10:39:57.068 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87415.ko 2024-05-27T10:39:57.068 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_oldpiix.ko 2024-05-27T10:39:57.068 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_opti.ko 2024-05-27T10:39:57.069 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_optidma.ko 2024-05-27T10:39:57.069 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pcmcia.ko 2024-05-27T10:39:57.069 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-27T10:39:57.069 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-27T10:39:57.069 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_piccolo.ko 2024-05-27T10:39:57.069 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rdc.ko 2024-05-27T10:39:57.069 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sch.ko 2024-05-27T10:39:57.069 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_serverworks.ko 2024-05-27T10:39:57.069 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sil680.ko 2024-05-27T10:39:57.069 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sis.ko 2024-05-27T10:39:57.069 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sl82c105.ko 2024-05-27T10:39:57.069 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_triflex.ko 2024-05-27T10:39:57.069 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_via.ko 2024-05-27T10:39:57.069 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pdc_adma.ko 2024-05-27T10:39:57.070 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_inic162x.ko 2024-05-27T10:39:57.070 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_mv.ko 2024-05-27T10:39:57.070 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_nv.ko 2024-05-27T10:39:57.070 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_promise.ko 2024-05-27T10:39:57.070 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_qstor.ko 2024-05-27T10:39:57.070 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil.ko 2024-05-27T10:39:57.070 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil24.ko 2024-05-27T10:39:57.070 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sis.ko 2024-05-27T10:39:57.070 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_svw.ko 2024-05-27T10:39:57.070 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sx4.ko 2024-05-27T10:39:57.070 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_uli.ko 2024-05-27T10:39:57.070 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_via.ko 2024-05-27T10:39:57.070 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_vsc.ko 2024-05-27T10:39:57.071 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay 2024-05-27T10:39:57.071 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ks0108.ko 2024-05-27T10:39:57.071 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base 2024-05-27T10:39:57.071 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap 2024-05-27T10:39:57.071 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-27T10:39:57.071 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-27T10:39:57.071 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma 2024-05-27T10:39:57.071 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/bcma.ko 2024-05-27T10:39:57.071 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block 2024-05-27T10:39:57.071 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe 2024-05-27T10:39:57.071 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/aoe.ko 2024-05-27T10:39:57.071 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/brd.ko 2024-05-27T10:39:57.071 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd 2024-05-27T10:39:57.072 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/drbd.ko 2024-05-27T10:39:57.072 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/floppy.ko 2024-05-27T10:39:57.072 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/loop.ko 2024-05-27T10:39:57.072 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx 2024-05-27T10:39:57.072 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-27T10:39:57.072 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/nbd.ko 2024-05-27T10:39:57.072 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk 2024-05-27T10:39:57.072 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/null_blk.ko 2024-05-27T10:39:57.072 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/pktcdvd.ko 2024-05-27T10:39:57.072 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/rbd.ko 2024-05-27T10:39:57.073 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/virtio_blk.ko 2024-05-27T10:39:57.073 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback 2024-05-27T10:39:57.073 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-27T10:39:57.073 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkfront.ko 2024-05-27T10:39:57.073 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram 2024-05-27T10:39:57.073 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/zram.ko 2024-05-27T10:39:57.073 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char 2024-05-27T10:39:57.073 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hangcheck-timer.ko 2024-05-27T10:39:57.073 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random 2024-05-27T10:39:57.073 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-27T10:39:57.073 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-27T10:39:57.074 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-27T10:39:57.074 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/via-rng.ko 2024-05-27T10:39:57.074 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-27T10:39:57.074 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi 2024-05-27T10:39:57.074 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-27T10:39:57.074 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-27T10:39:57.074 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-27T10:39:57.074 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-27T10:39:57.074 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-27T10:39:57.075 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-27T10:39:57.075 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/lp.ko 2024-05-27T10:39:57.075 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave 2024-05-27T10:39:57.075 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/mwave.ko 2024-05-27T10:39:57.075 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ppdev.ko 2024-05-27T10:39:57.075 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tlclk.ko 2024-05-27T10:39:57.075 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm 2024-05-27T10:39:57.075 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm.ko 2024-05-27T10:39:57.075 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-27T10:39:57.075 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-27T10:39:57.075 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-27T10:39:57.075 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-27T10:39:57.076 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-27T10:39:57.076 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/uv_mmtimer.ko 2024-05-27T10:39:57.076 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/virtio_console.ko 2024-05-27T10:39:57.076 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq 2024-05-27T10:39:57.076 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-27T10:39:57.076 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-27T10:39:57.076 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-27T10:39:57.076 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-27T10:39:57.076 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-27T10:39:57.076 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-27T10:39:57.076 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto 2024-05-27T10:39:57.076 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp 2024-05-27T10:39:57.077 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-27T10:39:57.077 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp.ko 2024-05-27T10:39:57.077 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel 2024-05-27T10:39:57.077 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat 2024-05-27T10:39:57.077 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common 2024-05-27T10:39:57.077 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-27T10:39:57.077 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-27T10:39:57.077 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-27T10:39:57.077 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-aes.ko 2024-05-27T10:39:57.077 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-sha.ko 2024-05-27T10:39:57.077 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio 2024-05-27T10:39:57.078 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-27T10:39:57.078 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca 2024-05-27T10:39:57.078 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/dca.ko 2024-05-27T10:39:57.078 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq 2024-05-27T10:39:57.078 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-27T10:39:57.078 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma 2024-05-27T10:39:57.078 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw 2024-05-27T10:39:57.078 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-27T10:39:57.078 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat 2024-05-27T10:39:57.078 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-27T10:39:57.078 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac 2024-05-27T10:39:57.079 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/amd64_edac.ko 2024-05-27T10:39:57.079 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/e752x_edac.ko 2024-05-27T10:39:57.079 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/edac_mce_amd.ko 2024-05-27T10:39:57.079 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3000_edac.ko 2024-05-27T10:39:57.079 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3200_edac.ko 2024-05-27T10:39:57.079 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5100_edac.ko 2024-05-27T10:39:57.079 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5400_edac.ko 2024-05-27T10:39:57.079 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7300_edac.ko 2024-05-27T10:39:57.079 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7core_edac.ko 2024-05-27T10:39:57.079 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i82975x_edac.ko 2024-05-27T10:39:57.079 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ie31200_edac.ko 2024-05-27T10:39:57.079 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/sb_edac.ko 2024-05-27T10:39:57.080 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/x38_edac.ko 2024-05-27T10:39:57.080 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware 2024-05-27T10:39:57.080 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/edd.ko 2024-05-27T10:39:57.080 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-27T10:39:57.080 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio 2024-05-27T10:39:57.080 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ich.ko 2024-05-27T10:39:57.080 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-27T10:39:57.080 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid 2024-05-27T10:39:57.080 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-appleir.ko 2024-05-27T10:39:57.080 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-aureal.ko 2024-05-27T10:39:57.080 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-axff.ko 2024-05-27T10:39:57.080 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-dr.ko 2024-05-27T10:39:57.080 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elecom.ko 2024-05-27T10:39:57.081 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elo.ko 2024-05-27T10:39:57.081 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-emsff.ko 2024-05-27T10:39:57.081 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gaff.ko 2024-05-27T10:39:57.081 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gt683r.ko 2024-05-27T10:39:57.081 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gyration.ko 2024-05-27T10:39:57.081 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-27T10:39:57.081 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-27T10:39:57.081 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtekff.ko 2024-05-27T10:39:57.081 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-hyperv.ko 2024-05-27T10:39:57.081 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-icade.ko 2024-05-27T10:39:57.081 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-keytouch.ko 2024-05-27T10:39:57.081 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kye.ko 2024-05-27T10:39:57.081 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lcpower.ko 2024-05-27T10:39:57.082 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-led.ko 2024-05-27T10:39:57.082 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lenovo.ko 2024-05-27T10:39:57.082 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-27T10:39:57.082 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-27T10:39:57.082 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-multitouch.ko 2024-05-27T10:39:57.082 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ortek.ko 2024-05-27T10:39:57.082 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-penmount.ko 2024-05-27T10:39:57.082 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-petalynx.ko 2024-05-27T10:39:57.082 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-picolcd.ko 2024-05-27T10:39:57.082 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-pl.ko 2024-05-27T10:39:57.082 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-plantronics.ko 2024-05-27T10:39:57.082 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-primax.ko 2024-05-27T10:39:57.082 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-rmi.ko 2024-05-27T10:39:57.083 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-27T10:39:57.083 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-common.ko 2024-05-27T10:39:57.083 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-27T10:39:57.083 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-27T10:39:57.083 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-27T10:39:57.083 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-27T10:39:57.083 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-27T10:39:57.083 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-27T10:39:57.083 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-27T10:39:57.083 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-27T10:39:57.083 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-27T10:39:57.083 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat.ko 2024-05-27T10:39:57.083 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-saitek.ko 2024-05-27T10:39:57.084 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-samsung.ko 2024-05-27T10:39:57.084 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-27T10:39:57.084 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sjoy.ko 2024-05-27T10:39:57.084 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sony.ko 2024-05-27T10:39:57.084 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-speedlink.ko 2024-05-27T10:39:57.084 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-steelseries.ko 2024-05-27T10:39:57.084 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sunplus.ko 2024-05-27T10:39:57.084 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-27T10:39:57.084 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tivo.ko 2024-05-27T10:39:57.084 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tmff.ko 2024-05-27T10:39:57.084 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-topseed.ko 2024-05-27T10:39:57.084 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-twinhan.ko 2024-05-27T10:39:57.085 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-uclogic.ko 2024-05-27T10:39:57.085 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-waltop.ko 2024-05-27T10:39:57.085 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-wiimote.ko 2024-05-27T10:39:57.085 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-xinmo.ko 2024-05-27T10:39:57.085 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zpff.ko 2024-05-27T10:39:57.085 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zydacron.ko 2024-05-27T10:39:57.085 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/uhid.ko 2024-05-27T10:39:57.085 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/wacom.ko 2024-05-27T10:39:57.085 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv 2024-05-27T10:39:57.085 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_balloon.ko 2024-05-27T10:39:57.085 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_utils.ko 2024-05-27T10:39:57.085 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_vmbus.ko 2024-05-27T10:39:57.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon 2024-05-27T10:39:57.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru.ko 2024-05-27T10:39:57.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru3.ko 2024-05-27T10:39:57.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-27T10:39:57.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7414.ko 2024-05-27T10:39:57.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7418.ko 2024-05-27T10:39:57.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adc128d818.ko 2024-05-27T10:39:57.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1025.ko 2024-05-27T10:39:57.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1026.ko 2024-05-27T10:39:57.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1029.ko 2024-05-27T10:39:57.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1031.ko 2024-05-27T10:39:57.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm9240.ko 2024-05-27T10:39:57.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ads7828.ko 2024-05-27T10:39:57.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7410.ko 2024-05-27T10:39:57.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7411.ko 2024-05-27T10:39:57.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7462.ko 2024-05-27T10:39:57.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7470.ko 2024-05-27T10:39:57.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7475.ko 2024-05-27T10:39:57.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7x10.ko 2024-05-27T10:39:57.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/amc6821.ko 2024-05-27T10:39:57.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/applesmc.ko 2024-05-27T10:39:57.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asb100.ko 2024-05-27T10:39:57.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asc7621.ko 2024-05-27T10:39:57.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-27T10:39:57.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/atxp1.ko 2024-05-27T10:39:57.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/coretemp.ko 2024-05-27T10:39:57.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-27T10:39:57.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dme1737.ko 2024-05-27T10:39:57.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds1621.ko 2024-05-27T10:39:57.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds620.ko 2024-05-27T10:39:57.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc1403.ko 2024-05-27T10:39:57.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc6w201.ko 2024-05-27T10:39:57.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71805f.ko 2024-05-27T10:39:57.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71882fg.ko 2024-05-27T10:39:57.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f75375s.ko 2024-05-27T10:39:57.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fam15h_power.ko 2024-05-27T10:39:57.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fschmd.ko 2024-05-27T10:39:57.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g760a.ko 2024-05-27T10:39:57.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g762.ko 2024-05-27T10:39:57.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl518sm.ko 2024-05-27T10:39:57.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl520sm.ko 2024-05-27T10:39:57.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-27T10:39:57.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5500_temp.ko 2024-05-27T10:39:57.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5k_amb.ko 2024-05-27T10:39:57.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmaem.ko 2024-05-27T10:39:57.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmpex.ko 2024-05-27T10:39:57.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina209.ko 2024-05-27T10:39:57.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina2xx.ko 2024-05-27T10:39:57.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/it87.ko 2024-05-27T10:39:57.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k10temp.ko 2024-05-27T10:39:57.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k8temp.ko 2024-05-27T10:39:57.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lineage-pem.ko 2024-05-27T10:39:57.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm63.ko 2024-05-27T10:39:57.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm73.ko 2024-05-27T10:39:57.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm75.ko 2024-05-27T10:39:57.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm77.ko 2024-05-27T10:39:57.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm78.ko 2024-05-27T10:39:57.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm80.ko 2024-05-27T10:39:57.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm83.ko 2024-05-27T10:39:57.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm85.ko 2024-05-27T10:39:57.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm87.ko 2024-05-27T10:39:57.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm90.ko 2024-05-27T10:39:57.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm92.ko 2024-05-27T10:39:57.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm93.ko 2024-05-27T10:39:57.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95234.ko 2024-05-27T10:39:57.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95241.ko 2024-05-27T10:39:57.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95245.ko 2024-05-27T10:39:57.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc2945.ko 2024-05-27T10:39:57.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4151.ko 2024-05-27T10:39:57.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4215.ko 2024-05-27T10:39:57.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4222.ko 2024-05-27T10:39:57.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4245.ko 2024-05-27T10:39:57.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4260.ko 2024-05-27T10:39:57.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4261.ko 2024-05-27T10:39:57.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max16065.ko 2024-05-27T10:39:57.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1619.ko 2024-05-27T10:39:57.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1668.ko 2024-05-27T10:39:57.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max197.ko 2024-05-27T10:39:57.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6639.ko 2024-05-27T10:39:57.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6650.ko 2024-05-27T10:39:57.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6697.ko 2024-05-27T10:39:57.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mcp3021.ko 2024-05-27T10:39:57.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6683.ko 2024-05-27T10:39:57.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775-core.ko 2024-05-27T10:39:57.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775.ko 2024-05-27T10:39:57.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct7802.ko 2024-05-27T10:39:57.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87360.ko 2024-05-27T10:39:57.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87427.ko 2024-05-27T10:39:57.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pcf8591.ko 2024-05-27T10:39:57.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus 2024-05-27T10:39:57.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-27T10:39:57.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-27T10:39:57.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-27T10:39:57.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-27T10:39:57.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-27T10:39:57.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-27T10:39:57.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-27T10:39:57.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-27T10:39:57.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-27T10:39:57.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-27T10:39:57.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-27T10:39:57.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-27T10:39:57.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/powr1220.ko 2024-05-27T10:39:57.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5627.ko 2024-05-27T10:39:57.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5636.ko 2024-05-27T10:39:57.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-27T10:39:57.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht15.ko 2024-05-27T10:39:57.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht21.ko 2024-05-27T10:39:57.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/shtc1.ko 2024-05-27T10:39:57.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sis5595.ko 2024-05-27T10:39:57.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47b397.ko 2024-05-27T10:39:57.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m1.ko 2024-05-27T10:39:57.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m192.ko 2024-05-27T10:39:57.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/thmc50.ko 2024-05-27T10:39:57.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp102.ko 2024-05-27T10:39:57.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp103.ko 2024-05-27T10:39:57.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp401.ko 2024-05-27T10:39:57.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp421.ko 2024-05-27T10:39:57.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via-cputemp.ko 2024-05-27T10:39:57.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via686a.ko 2024-05-27T10:39:57.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt1211.ko 2024-05-27T10:39:57.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt8231.ko 2024-05-27T10:39:57.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627ehf.ko 2024-05-27T10:39:57.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627hf.ko 2024-05-27T10:39:57.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83781d.ko 2024-05-27T10:39:57.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83791d.ko 2024-05-27T10:39:57.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83792d.ko 2024-05-27T10:39:57.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83793.ko 2024-05-27T10:39:57.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83795.ko 2024-05-27T10:39:57.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l785ts.ko 2024-05-27T10:39:57.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l786ng.ko 2024-05-27T10:39:57.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c 2024-05-27T10:39:57.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos 2024-05-27T10:39:57.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-27T10:39:57.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-27T10:39:57.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses 2024-05-27T10:39:57.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-27T10:39:57.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-27T10:39:57.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-27T10:39:57.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-27T10:39:57.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-27T10:39:57.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-27T10:39:57.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-27T10:39:57.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-27T10:39:57.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-27T10:39:57.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-27T10:39:57.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-27T10:39:57.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-27T10:39:57.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-27T10:39:57.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-27T10:39:57.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-27T10:39:57.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-27T10:39:57.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-27T10:39:57.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-27T10:39:57.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-27T10:39:57.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-27T10:39:57.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-27T10:39:57.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-27T10:39:57.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-27T10:39:57.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-dev.ko 2024-05-27T10:39:57.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-mux.ko 2024-05-27T10:39:57.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-27T10:39:57.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-smbus.ko 2024-05-27T10:39:57.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-stub.ko 2024-05-27T10:39:57.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband 2024-05-27T10:39:57.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core 2024-05-27T10:39:57.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-27T10:39:57.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_core.ko 2024-05-27T10:39:57.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-27T10:39:57.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-27T10:39:57.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-27T10:39:57.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-27T10:39:57.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-27T10:39:57.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw 2024-05-27T10:39:57.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4 2024-05-27T10:39:57.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-27T10:39:57.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4 2024-05-27T10:39:57.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-27T10:39:57.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5 2024-05-27T10:39:57.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-27T10:39:57.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca 2024-05-27T10:39:57.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-27T10:39:57.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp 2024-05-27T10:39:57.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib 2024-05-27T10:39:57.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-27T10:39:57.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser 2024-05-27T10:39:57.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-27T10:39:57.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert 2024-05-27T10:39:57.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-27T10:39:57.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp 2024-05-27T10:39:57.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-27T10:39:57.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt 2024-05-27T10:39:57.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-27T10:39:57.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input 2024-05-27T10:39:57.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport 2024-05-27T10:39:57.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-27T10:39:57.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-27T10:39:57.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/gameport.ko 2024-05-27T10:39:57.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/joydev.ko 2024-05-27T10:39:57.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard 2024-05-27T10:39:57.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-27T10:39:57.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse 2024-05-27T10:39:57.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/appletouch.ko 2024-05-27T10:39:57.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/bcm5974.ko 2024-05-27T10:39:57.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/cyapatp.ko 2024-05-27T10:39:57.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-27T10:39:57.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/sermouse.ko 2024-05-27T10:39:57.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-27T10:39:57.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-27T10:39:57.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-27T10:39:57.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4 2024-05-27T10:39:57.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-27T10:39:57.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio 2024-05-27T10:39:57.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/altera_ps2.ko 2024-05-27T10:39:57.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/arc_ps2.ko 2024-05-27T10:39:57.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-27T10:39:57.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serio_raw.ko 2024-05-27T10:39:57.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/sparse-keymap.ko 2024-05-27T10:39:57.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds 2024-05-27T10:39:57.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-blinkm.ko 2024-05-27T10:39:57.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3530.ko 2024-05-27T10:39:57.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp3944.ko 2024-05-27T10:39:57.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-ss4200.ko 2024-05-27T10:39:57.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger 2024-05-27T10:39:57.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-27T10:39:57.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-27T10:39:57.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-27T10:39:57.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-27T10:39:57.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-27T10:39:57.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-27T10:39:57.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-27T10:39:57.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-27T10:39:57.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-27T10:39:57.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md 2024-05-27T10:39:57.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache 2024-05-27T10:39:57.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/bcache.ko 2024-05-27T10:39:57.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bio-prison.ko 2024-05-27T10:39:57.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache-smq.ko 2024-05-27T10:39:57.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache.ko 2024-05-27T10:39:57.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-crypt.ko 2024-05-27T10:39:57.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-delay.ko 2024-05-27T10:39:57.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-flakey.ko 2024-05-27T10:39:57.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log-userspace.ko 2024-05-27T10:39:57.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-multipath.ko 2024-05-27T10:39:57.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-queue-length.ko 2024-05-27T10:39:57.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-raid.ko 2024-05-27T10:39:57.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-round-robin.ko 2024-05-27T10:39:57.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-service-time.ko 2024-05-27T10:39:57.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-switch.ko 2024-05-27T10:39:57.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-thin-pool.ko 2024-05-27T10:39:57.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-verity.ko 2024-05-27T10:39:57.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data 2024-05-27T10:39:57.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-27T10:39:57.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid0.ko 2024-05-27T10:39:57.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid1.ko 2024-05-27T10:39:57.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid10.ko 2024-05-27T10:39:57.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid456.ko 2024-05-27T10:39:57.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message 2024-05-27T10:39:57.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion 2024-05-27T10:39:57.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptbase.ko 2024-05-27T10:39:57.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptctl.ko 2024-05-27T10:39:57.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptfc.ko 2024-05-27T10:39:57.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptlan.ko 2024-05-27T10:39:57.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptsas.ko 2024-05-27T10:39:57.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptscsih.ko 2024-05-27T10:39:57.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptspi.ko 2024-05-27T10:39:57.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd 2024-05-27T10:39:57.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_ich.ko 2024-05-27T10:39:57.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_sch.ko 2024-05-27T10:39:57.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mfd-core.ko 2024-05-27T10:39:57.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/sm501.ko 2024-05-27T10:39:57.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/viperboard.ko 2024-05-27T10:39:57.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/vx855.ko 2024-05-27T10:39:57.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wl1273-core.ko 2024-05-27T10:39:57.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc 2024-05-27T10:39:57.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl 2024-05-27T10:39:57.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-27T10:39:57.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds9802als.ko 2024-05-27T10:39:57.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds990x.ko 2024-05-27T10:39:57.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/bh1770glc.ko 2024-05-27T10:39:57.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710 2024-05-27T10:39:57.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/cb710.ko 2024-05-27T10:39:57.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom 2024-05-27T10:39:57.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/at24.ko 2024-05-27T10:39:57.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-27T10:39:57.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/max6875.ko 2024-05-27T10:39:57.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/enclosure.ko 2024-05-27T10:39:57.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hpilo.ko 2024-05-27T10:39:57.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29003.ko 2024-05-27T10:39:57.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29020.ko 2024-05-27T10:39:57.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d 2024-05-27T10:39:57.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-27T10:39:57.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-27T10:39:57.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei 2024-05-27T10:39:57.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-me.ko 2024-05-27T10:39:57.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-txe.ko 2024-05-27T10:39:57.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei.ko 2024-05-27T10:39:57.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru 2024-05-27T10:39:57.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-27T10:39:57.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp 2024-05-27T10:39:57.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-27T10:39:57.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-27T10:39:57.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-27T10:39:57.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_7xx1.ko 2024-05-27T10:39:57.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_core.ko 2024-05-27T10:39:57.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tsl2550.ko 2024-05-27T10:39:57.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_balloon.ko 2024-05-27T10:39:57.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci 2024-05-27T10:39:57.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-27T10:39:57.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net 2024-05-27T10:39:57.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding 2024-05-27T10:39:57.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/bonding.ko 2024-05-27T10:39:57.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa 2024-05-27T10:39:57.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53 2024-05-27T10:39:57.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-27T10:39:57.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-27T10:39:57.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-27T10:39:57.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx 2024-05-27T10:39:57.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-27T10:39:57.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dummy.ko 2024-05-27T10:39:57.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/eql.ko 2024-05-27T10:39:57.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet 2024-05-27T10:39:57.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com 2024-05-27T10:39:57.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-27T10:39:57.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-27T10:39:57.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-27T10:39:57.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-27T10:39:57.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390 2024-05-27T10:39:57.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-27T10:39:57.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-27T10:39:57.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-27T10:39:57.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-27T10:39:57.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec 2024-05-27T10:39:57.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-27T10:39:57.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere 2024-05-27T10:39:57.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-27T10:39:57.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon 2024-05-27T10:39:57.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-27T10:39:57.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera 2024-05-27T10:39:57.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-27T10:39:57.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd 2024-05-27T10:39:57.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-27T10:39:57.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-27T10:39:57.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-27T10:39:57.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros 2024-05-27T10:39:57.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx 2024-05-27T10:39:57.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-27T10:39:57.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-27T10:39:57.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-27T10:39:57.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-27T10:39:57.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-27T10:39:57.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx 2024-05-27T10:39:57.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-27T10:39:57.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-27T10:39:57.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom 2024-05-27T10:39:57.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-27T10:39:57.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-27T10:39:57.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-27T10:39:57.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-27T10:39:57.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-27T10:39:57.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet 2024-05-27T10:39:57.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-27T10:39:57.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-27T10:39:57.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade 2024-05-27T10:39:57.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna 2024-05-27T10:39:57.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-27T10:39:57.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio 2024-05-27T10:39:57.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-27T10:39:57.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-27T10:39:57.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-27T10:39:57.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-27T10:39:57.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-27T10:39:57.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-27T10:39:57.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-27T10:39:57.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-27T10:39:57.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-27T10:39:57.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-27T10:39:57.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco 2024-05-27T10:39:57.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic 2024-05-27T10:39:57.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-27T10:39:57.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec 2024-05-27T10:39:57.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip 2024-05-27T10:39:57.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-27T10:39:57.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-27T10:39:57.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-27T10:39:57.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-27T10:39:57.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-27T10:39:57.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-27T10:39:57.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink 2024-05-27T10:39:57.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-27T10:39:57.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-27T10:39:57.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dnet.ko 2024-05-27T10:39:57.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex 2024-05-27T10:39:57.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet 2024-05-27T10:39:57.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-27T10:39:57.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ethoc.ko 2024-05-27T10:39:57.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fealnx.ko 2024-05-27T10:39:57.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel 2024-05-27T10:39:57.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-27T10:39:57.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000 2024-05-27T10:39:57.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-27T10:39:57.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e 2024-05-27T10:39:57.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-27T10:39:57.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k 2024-05-27T10:39:57.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-27T10:39:57.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e 2024-05-27T10:39:57.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-27T10:39:57.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf 2024-05-27T10:39:57.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-27T10:39:57.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb 2024-05-27T10:39:57.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-27T10:39:57.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf 2024-05-27T10:39:57.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-27T10:39:57.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-27T10:39:57.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-27T10:39:57.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-27T10:39:57.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-27T10:39:57.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/jme.ko 2024-05-27T10:39:57.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell 2024-05-27T10:39:57.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-27T10:39:57.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-27T10:39:57.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-27T10:39:57.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox 2024-05-27T10:39:57.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-27T10:39:57.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-27T10:39:57.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-27T10:39:57.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-27T10:39:57.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-27T10:39:57.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-27T10:39:57.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel 2024-05-27T10:39:57.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-27T10:39:57.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom 2024-05-27T10:39:57.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-27T10:39:57.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-27T10:39:57.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi 2024-05-27T10:39:57.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-27T10:39:57.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-27T10:39:57.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion 2024-05-27T10:39:57.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-27T10:39:57.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia 2024-05-27T10:39:57.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-27T10:39:57.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines 2024-05-27T10:39:57.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-27T10:39:57.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-27T10:39:57.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic 2024-05-27T10:39:57.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-27T10:39:57.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-27T10:39:57.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-27T10:39:57.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-27T10:39:57.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-27T10:39:57.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc 2024-05-27T10:39:57.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-27T10:39:57.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek 2024-05-27T10:39:57.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-27T10:39:57.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-27T10:39:57.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-27T10:39:57.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-27T10:39:57.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker 2024-05-27T10:39:57.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-27T10:39:57.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc 2024-05-27T10:39:57.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-27T10:39:57.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan 2024-05-27T10:39:57.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-27T10:39:57.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis 2024-05-27T10:39:57.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-27T10:39:57.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-27T10:39:57.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc 2024-05-27T10:39:57.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-27T10:39:57.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-27T10:39:57.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-27T10:39:57.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-27T10:39:57.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro 2024-05-27T10:39:57.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-27T10:39:57.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-27T10:39:57.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-27T10:39:57.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun 2024-05-27T10:39:57.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-27T10:39:57.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-27T10:39:57.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-27T10:39:57.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-27T10:39:57.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti 2024-05-27T10:39:57.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-27T10:39:57.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti 2024-05-27T10:39:57.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-27T10:39:57.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via 2024-05-27T10:39:57.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-27T10:39:57.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-27T10:39:57.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet 2024-05-27T10:39:57.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-27T10:39:57.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-27T10:39:57.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom 2024-05-27T10:39:57.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-27T10:39:57.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/geneve.ko 2024-05-27T10:39:57.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv 2024-05-27T10:39:57.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-27T10:39:57.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154 2024-05-27T10:39:57.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-27T10:39:57.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ifb.ko 2024-05-27T10:39:57.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan 2024-05-27T10:39:57.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-27T10:39:57.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvlan.ko 2024-05-27T10:39:57.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvtap.ko 2024-05-27T10:39:57.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio 2024-05-27T10:39:57.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio.ko 2024-05-27T10:39:57.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-27T10:39:57.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-27T10:39:57.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-27T10:39:57.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mii.ko 2024-05-27T10:39:57.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/net_failover.ko 2024-05-27T10:39:57.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/netconsole.ko 2024-05-27T10:39:57.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/nlmon.ko 2024-05-27T10:39:57.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs 2024-05-27T10:39:57.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-27T10:39:57.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-27T10:39:57.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy 2024-05-27T10:39:57.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/amd.ko 2024-05-27T10:39:57.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-27T10:39:57.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-27T10:39:57.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-27T10:39:57.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm87xx.ko 2024-05-27T10:39:57.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/broadcom.ko 2024-05-27T10:39:57.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/cicada.ko 2024-05-27T10:39:57.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/davicom.ko 2024-05-27T10:39:57.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/dp83640.ko 2024-05-27T10:39:57.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/et1011c.ko 2024-05-27T10:39:57.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/icplus.ko 2024-05-27T10:39:57.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/lxt.ko 2024-05-27T10:39:57.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/marvell.ko 2024-05-27T10:39:57.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/micrel.ko 2024-05-27T10:39:57.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/national.ko 2024-05-27T10:39:57.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/phylink.ko 2024-05-27T10:39:57.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/qsemi.ko 2024-05-27T10:39:57.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/realtek.ko 2024-05-27T10:39:57.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/smsc.ko 2024-05-27T10:39:57.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ste10Xp.ko 2024-05-27T10:39:57.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/vitesse.ko 2024-05-27T10:39:57.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp 2024-05-27T10:39:57.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-27T10:39:57.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_async.ko 2024-05-27T10:39:57.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-27T10:39:57.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-27T10:39:57.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-27T10:39:57.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-27T10:39:57.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppoe.ko 2024-05-27T10:39:57.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppox.ko 2024-05-27T10:39:57.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pptp.ko 2024-05-27T10:39:57.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip 2024-05-27T10:39:57.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slhc.ko 2024-05-27T10:39:57.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slip.ko 2024-05-27T10:39:57.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sungem_phy.ko 2024-05-27T10:39:57.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tap.ko 2024-05-27T10:39:57.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team 2024-05-27T10:39:57.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team.ko 2024-05-27T10:39:57.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-27T10:39:57.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-27T10:39:57.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-27T10:39:57.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_random.ko 2024-05-27T10:39:57.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-27T10:39:57.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tun.ko 2024-05-27T10:39:57.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/veth.ko 2024-05-27T10:39:57.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/virtio_net.ko 2024-05-27T10:39:57.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3 2024-05-27T10:39:57.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-27T10:39:57.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan 2024-05-27T10:39:57.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/vxlan.ko 2024-05-27T10:39:57.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback 2024-05-27T10:39:57.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-27T10:39:57.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netfront.ko 2024-05-27T10:39:57.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb 2024-05-27T10:39:57.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ntb.ko 2024-05-27T10:39:57.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme 2024-05-27T10:39:57.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host 2024-05-27T10:39:57.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme-core.ko 2024-05-27T10:39:57.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme.ko 2024-05-27T10:39:57.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport 2024-05-27T10:39:57.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport.ko 2024-05-27T10:39:57.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_cs.ko 2024-05-27T10:39:57.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_pc.ko 2024-05-27T10:39:57.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_serial.ko 2024-05-27T10:39:57.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci 2024-05-27T10:39:57.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug 2024-05-27T10:39:57.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-27T10:39:57.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie 2024-05-27T10:39:57.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-27T10:39:57.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/xen-pcifront.ko 2024-05-27T10:39:57.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia 2024-05-27T10:39:57.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/i82092.ko 2024-05-27T10:39:57.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pd6729.ko 2024-05-27T10:39:57.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-27T10:39:57.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl 2024-05-27T10:39:57.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel 2024-05-27T10:39:57.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-27T10:39:57.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform 2024-05-27T10:39:57.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86 2024-05-27T10:39:57.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-27T10:39:57.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acerhdf.ko 2024-05-27T10:39:57.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-27T10:39:57.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-27T10:39:57.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-27T10:39:57.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-27T10:39:57.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-27T10:39:57.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-27T10:39:57.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-27T10:39:57.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-27T10:39:57.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-27T10:39:57.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/hdaps.ko 2024-05-27T10:39:57.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel 2024-05-27T10:39:57.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-27T10:39:57.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel_ips.ko 2024-05-27T10:39:57.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-27T10:39:57.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-27T10:39:57.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-27T10:39:57.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-27T10:39:57.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-27T10:39:57.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-27T10:39:57.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-27T10:39:57.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-27T10:39:57.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-27T10:39:57.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi.ko 2024-05-27T10:39:57.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap 2024-05-27T10:39:57.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-27T10:39:57.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-27T10:39:57.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps 2024-05-27T10:39:57.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients 2024-05-27T10:39:57.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-27T10:39:57.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-27T10:39:57.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps_parport.ko 2024-05-27T10:39:57.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/pps_core.ko 2024-05-27T10:39:57.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp 2024-05-27T10:39:57.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp.ko 2024-05-27T10:39:57.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp_kvm.ko 2024-05-27T10:39:57.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras 2024-05-27T10:39:57.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd 2024-05-27T10:39:57.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl 2024-05-27T10:39:57.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-27T10:39:57.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/fmpm.ko 2024-05-27T10:39:57.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc 2024-05-27T10:39:57.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-27T10:39:57.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-27T10:39:57.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-27T10:39:57.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-27T10:39:57.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-27T10:39:57.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-27T10:39:57.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-27T10:39:57.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-27T10:39:57.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-27T10:39:57.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-27T10:39:57.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-em3027.ko 2024-05-27T10:39:57.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-27T10:39:57.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-27T10:39:57.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-27T10:39:57.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-27T10:39:57.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-27T10:39:57.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-27T10:39:57.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max6900.ko 2024-05-27T10:39:57.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-27T10:39:57.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-27T10:39:57.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-27T10:39:57.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-27T10:39:57.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-27T10:39:57.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-27T10:39:57.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-27T10:39:57.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-27T10:39:57.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-27T10:39:57.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-27T10:39:57.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-27T10:39:57.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-27T10:39:57.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-x1205.ko 2024-05-27T10:39:57.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi 2024-05-27T10:39:57.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-9xxx.ko 2024-05-27T10:39:57.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-sas.ko 2024-05-27T10:39:57.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-xxxx.ko 2024-05-27T10:39:57.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/BusLogic.ko 2024-05-27T10:39:57.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/a100u2w.ko 2024-05-27T10:39:57.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid 2024-05-27T10:39:57.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-27T10:39:57.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/advansys.ko 2024-05-27T10:39:57.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx 2024-05-27T10:39:57.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-27T10:39:57.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-27T10:39:57.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/am53c974.ko 2024-05-27T10:39:57.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr 2024-05-27T10:39:57.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-27T10:39:57.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/atp870u.ko 2024-05-27T10:39:57.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi 2024-05-27T10:39:57.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-27T10:39:57.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa 2024-05-27T10:39:57.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/bfa.ko 2024-05-27T10:39:57.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc 2024-05-27T10:39:57.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-27T10:39:57.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i 2024-05-27T10:39:57.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-27T10:39:57.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ch.ko 2024-05-27T10:39:57.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor 2024-05-27T10:39:57.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-27T10:39:57.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi 2024-05-27T10:39:57.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-27T10:39:57.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-27T10:39:57.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-27T10:39:57.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-27T10:39:57.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-27T10:39:57.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dc395x.ko 2024-05-27T10:39:57.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler 2024-05-27T10:39:57.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-27T10:39:57.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-27T10:39:57.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-27T10:39:57.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-27T10:39:57.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dmx3191d.ko 2024-05-27T10:39:57.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r 2024-05-27T10:39:57.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-27T10:39:57.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esp_scsi.ko 2024-05-27T10:39:57.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe 2024-05-27T10:39:57.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-27T10:39:57.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-27T10:39:57.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic 2024-05-27T10:39:57.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/fnic.ko 2024-05-27T10:39:57.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hpsa.ko 2024-05-27T10:39:57.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hptiop.ko 2024-05-27T10:39:57.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hv_storvsc.ko 2024-05-27T10:39:57.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/initio.ko 2024-05-27T10:39:57.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ipr.ko 2024-05-27T10:39:57.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ips.ko 2024-05-27T10:39:57.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci 2024-05-27T10:39:57.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/isci.ko 2024-05-27T10:39:57.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-27T10:39:57.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-27T10:39:57.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc 2024-05-27T10:39:57.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/libfc.ko 2024-05-27T10:39:57.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi.ko 2024-05-27T10:39:57.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-27T10:39:57.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas 2024-05-27T10:39:57.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/libsas.ko 2024-05-27T10:39:57.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc 2024-05-27T10:39:57.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-27T10:39:57.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid 2024-05-27T10:39:57.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid.ko 2024-05-27T10:39:57.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-27T10:39:57.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-27T10:39:57.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-27T10:39:57.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas 2024-05-27T10:39:57.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-27T10:39:57.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas 2024-05-27T10:39:57.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-27T10:39:57.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvumi.ko 2024-05-27T10:39:57.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001 2024-05-27T10:39:57.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-27T10:39:57.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pmcraid.ko 2024-05-27T10:39:57.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla1280.ko 2024-05-27T10:39:57.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx 2024-05-27T10:39:57.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-27T10:39:57.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-27T10:39:57.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx 2024-05-27T10:39:57.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-27T10:39:57.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/raid_class.ko 2024-05-27T10:39:57.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_debug.ko 2024-05-27T10:39:57.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-27T10:39:57.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-27T10:39:57.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-27T10:39:57.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-27T10:39:57.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-27T10:39:57.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ses.ko 2024-05-27T10:39:57.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/st.ko 2024-05-27T10:39:57.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/stex.ko 2024-05-27T10:39:57.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2 2024-05-27T10:39:57.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-27T10:39:57.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/virtio_scsi.ko 2024-05-27T10:39:57.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-27T10:39:57.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/wd719x.ko 2024-05-27T10:39:57.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb 2024-05-27T10:39:57.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ssb.ko 2024-05-27T10:39:57.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target 2024-05-27T10:39:57.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi 2024-05-27T10:39:57.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-27T10:39:57.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback 2024-05-27T10:39:57.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-27T10:39:57.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_file.ko 2024-05-27T10:39:57.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_iblock.ko 2024-05-27T10:39:57.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_mod.ko 2024-05-27T10:39:57.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_pscsi.ko 2024-05-27T10:39:57.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_user.ko 2024-05-27T10:39:57.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc 2024-05-27T10:39:57.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-27T10:39:57.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal 2024-05-27T10:39:57.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel 2024-05-27T10:39:57.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal 2024-05-27T10:39:57.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-27T10:39:57.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-27T10:39:57.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-27T10:39:57.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-27T10:39:57.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-27T10:39:57.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-27T10:39:57.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-27T10:39:57.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-27T10:39:57.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-27T10:39:57.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-27T10:39:57.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-27T10:39:57.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-27T10:39:57.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-27T10:39:57.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-27T10:39:57.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-27T10:39:57.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-27T10:39:57.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-27T10:39:57.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-27T10:39:57.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty 2024-05-27T10:39:57.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless 2024-05-27T10:39:57.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-27T10:39:57.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_gsm.ko 2024-05-27T10:39:57.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_hdlc.ko 2024-05-27T10:39:57.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/nozomi.ko 2024-05-27T10:39:57.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial 2024-05-27T10:39:57.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250 2024-05-27T10:39:57.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-27T10:39:57.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/arc_uart.ko 2024-05-27T10:39:57.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm 2024-05-27T10:39:57.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-27T10:39:57.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs 2024-05-27T10:39:57.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core 2024-05-27T10:39:57.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-27T10:39:57.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host 2024-05-27T10:39:57.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-27T10:39:57.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio 2024-05-27T10:39:57.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio.ko 2024-05-27T10:39:57.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_aec.ko 2024-05-27T10:39:57.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_cif.ko 2024-05-27T10:39:57.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pci_generic.ko 2024-05-27T10:39:57.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_sercos3.ko 2024-05-27T10:39:57.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb 2024-05-27T10:39:57.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class 2024-05-27T10:39:57.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-acm.ko 2024-05-27T10:39:57.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-27T10:39:57.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usblp.ko 2024-05-27T10:39:57.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usbtmc.ko 2024-05-27T10:39:57.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host 2024-05-27T10:39:57.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-27T10:39:57.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image 2024-05-27T10:39:57.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/mdc800.ko 2024-05-27T10:39:57.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/microtek.ko 2024-05-27T10:39:57.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc 2024-05-27T10:39:57.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/adutux.ko 2024-05-27T10:39:57.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/appledisplay.ko 2024-05-27T10:39:57.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi26.ko 2024-05-27T10:39:57.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi62.ko 2024-05-27T10:39:57.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ezusb.ko 2024-05-27T10:39:57.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/idmouse.ko 2024-05-27T10:39:57.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/iowarrior.ko 2024-05-27T10:39:57.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-27T10:39:57.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ldusb.ko 2024-05-27T10:39:57.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/legousbtower.ko 2024-05-27T10:39:57.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga 2024-05-27T10:39:57.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-27T10:39:57.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-27T10:39:57.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usb3503.ko 2024-05-27T10:39:57.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usblcd.ko 2024-05-27T10:39:57.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-27T10:39:57.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/uss720.ko 2024-05-27T10:39:57.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/yurex.ko 2024-05-27T10:39:57.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy 2024-05-27T10:39:57.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-generic.ko 2024-05-27T10:39:57.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial 2024-05-27T10:39:57.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/aircable.ko 2024-05-27T10:39:57.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ark3116.ko 2024-05-27T10:39:57.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-27T10:39:57.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ch341.ko 2024-05-27T10:39:57.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cp210x.ko 2024-05-27T10:39:57.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cyberjack.ko 2024-05-27T10:39:57.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-27T10:39:57.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-27T10:39:57.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/empeg.ko 2024-05-27T10:39:57.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-27T10:39:57.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-27T10:39:57.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-27T10:39:57.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_ti.ko 2024-05-27T10:39:57.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipaq.ko 2024-05-27T10:39:57.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipw.ko 2024-05-27T10:39:57.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ir-usb.ko 2024-05-27T10:39:57.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-27T10:39:57.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan.ko 2024-05-27T10:39:57.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-27T10:39:57.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-27T10:39:57.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-27T10:39:57.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mct_u232.ko 2024-05-27T10:39:57.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7720.ko 2024-05-27T10:39:57.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7840.ko 2024-05-27T10:39:57.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/navman.ko 2024-05-27T10:39:57.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/omninet.ko 2024-05-27T10:39:57.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/opticon.ko 2024-05-27T10:39:57.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/option.ko 2024-05-27T10:39:57.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/oti6858.ko 2024-05-27T10:39:57.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/pl2303.ko 2024-05-27T10:39:57.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcaux.ko 2024-05-27T10:39:57.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcserial.ko 2024-05-27T10:39:57.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/quatech2.ko 2024-05-27T10:39:57.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/safe_serial.ko 2024-05-27T10:39:57.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/sierra.ko 2024-05-27T10:39:57.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-27T10:39:57.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ssu100.ko 2024-05-27T10:39:57.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/symbolserial.ko 2024-05-27T10:39:57.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-27T10:39:57.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-27T10:39:57.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_debug.ko 2024-05-27T10:39:57.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-27T10:39:57.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/visor.ko 2024-05-27T10:39:57.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/whiteheat.ko 2024-05-27T10:39:57.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-27T10:39:57.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage 2024-05-27T10:39:57.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/uas.ko 2024-05-27T10:39:57.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-27T10:39:57.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-27T10:39:57.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-27T10:39:57.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-27T10:39:57.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-27T10:39:57.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-27T10:39:57.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-27T10:39:57.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-karma.ko 2024-05-27T10:39:57.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-27T10:39:57.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-27T10:39:57.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-27T10:39:57.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-27T10:39:57.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-27T10:39:57.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/usb-storage.ko 2024-05-27T10:39:57.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip 2024-05-27T10:39:57.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-27T10:39:57.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-27T10:39:57.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-27T10:39:57.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio 2024-05-27T10:39:57.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci 2024-05-27T10:39:57.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-27T10:39:57.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-27T10:39:57.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio.ko 2024-05-27T10:39:57.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-27T10:39:57.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost 2024-05-27T10:39:57.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost.ko 2024-05-27T10:39:57.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-27T10:39:57.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_net.ko 2024-05-27T10:39:57.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_scsi.ko 2024-05-27T10:39:57.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video 2024-05-27T10:39:57.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight 2024-05-27T10:39:57.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/apple_bl.ko 2024-05-27T10:39:57.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lcd.ko 2024-05-27T10:39:57.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-27T10:39:57.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio 2024-05-27T10:39:57.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio.ko 2024-05-27T10:39:57.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_balloon.ko 2024-05-27T10:39:57.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_mmio.ko 2024-05-27T10:39:57.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci.ko 2024-05-27T10:39:57.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-27T10:39:57.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-27T10:39:57.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_ring.ko 2024-05-27T10:39:57.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1 2024-05-27T10:39:57.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters 2024-05-27T10:39:57.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2482.ko 2024-05-27T10:39:57.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2490.ko 2024-05-27T10:39:57.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves 2024-05-27T10:39:57.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-27T10:39:57.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-27T10:39:57.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-27T10:39:57.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-27T10:39:57.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-27T10:39:57.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-27T10:39:57.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-27T10:39:57.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-27T10:39:57.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-27T10:39:57.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-27T10:39:57.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-27T10:39:57.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/wire.ko 2024-05-27T10:39:57.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog 2024-05-27T10:39:57.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-27T10:39:57.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-27T10:39:57.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-27T10:39:57.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/hpwdt.ko 2024-05-27T10:39:57.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/i6300esb.ko 2024-05-27T10:39:57.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-27T10:39:57.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-27T10:39:57.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ib700wdt.ko 2024-05-27T10:39:57.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ibmasr.ko 2024-05-27T10:39:57.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-27T10:39:57.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-27T10:39:57.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it87_wdt.ko 2024-05-27T10:39:57.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/machzwd.ko 2024-05-27T10:39:57.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/nv_tco.ko 2024-05-27T10:39:57.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-27T10:39:57.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-27T10:39:57.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-27T10:39:57.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-27T10:39:57.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/softdog.ko 2024-05-27T10:39:57.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-27T10:39:57.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/via_wdt.ko 2024-05-27T10:39:57.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-27T10:39:57.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-27T10:39:57.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-27T10:39:57.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wdt_pci.ko 2024-05-27T10:39:57.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/xen_wdt.ko 2024-05-27T10:39:57.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen 2024-05-27T10:39:57.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-27T10:39:57.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-evtchn.ko 2024-05-27T10:39:57.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntalloc.ko 2024-05-27T10:39:57.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntdev.ko 2024-05-27T10:39:57.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback 2024-05-27T10:39:57.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-27T10:39:57.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-privcmd.ko 2024-05-27T10:39:57.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs 2024-05-27T10:39:57.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-27T10:39:57.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs 2024-05-27T10:39:57.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p 2024-05-27T10:39:57.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/9p.ko 2024-05-27T10:39:57.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs 2024-05-27T10:39:57.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/affs.ko 2024-05-27T10:39:57.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs 2024-05-27T10:39:57.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/befs.ko 2024-05-27T10:39:57.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/binfmt_misc.ko 2024-05-27T10:39:57.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs 2024-05-27T10:39:57.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/btrfs.ko 2024-05-27T10:39:57.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles 2024-05-27T10:39:57.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/cachefiles.ko 2024-05-27T10:39:57.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph 2024-05-27T10:39:57.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ceph.ko 2024-05-27T10:39:57.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda 2024-05-27T10:39:57.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/coda.ko 2024-05-27T10:39:57.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs 2024-05-27T10:39:57.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/cramfs.ko 2024-05-27T10:39:57.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm 2024-05-27T10:39:57.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/dlm.ko 2024-05-27T10:39:57.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs 2024-05-27T10:39:57.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-27T10:39:57.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs 2024-05-27T10:39:57.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/f2fs.ko 2024-05-27T10:39:57.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat 2024-05-27T10:39:57.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/fat.ko 2024-05-27T10:39:57.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/msdos.ko 2024-05-27T10:39:57.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/vfat.ko 2024-05-27T10:39:57.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse 2024-05-27T10:39:57.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/cuse.ko 2024-05-27T10:39:57.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/fuse.ko 2024-05-27T10:39:57.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2 2024-05-27T10:39:57.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/gfs2.ko 2024-05-27T10:39:57.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs 2024-05-27T10:39:57.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/hfs.ko 2024-05-27T10:39:57.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus 2024-05-27T10:39:57.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/hfsplus.ko 2024-05-27T10:39:57.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs 2024-05-27T10:39:57.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/isofs.ko 2024-05-27T10:39:57.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs 2024-05-27T10:39:57.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/jfs.ko 2024-05-27T10:39:57.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd 2024-05-27T10:39:57.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/lockd.ko 2024-05-27T10:39:57.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix 2024-05-27T10:39:57.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/minix.ko 2024-05-27T10:39:57.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs 2024-05-27T10:39:57.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/netfs.ko 2024-05-27T10:39:57.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs 2024-05-27T10:39:57.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout 2024-05-27T10:39:57.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-27T10:39:57.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout 2024-05-27T10:39:57.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-27T10:39:57.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout 2024-05-27T10:39:57.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-27T10:39:57.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfs.ko 2024-05-27T10:39:57.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv3.ko 2024-05-27T10:39:57.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv4.ko 2024-05-27T10:39:57.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common 2024-05-27T10:39:57.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/grace.ko 2024-05-27T10:39:57.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/nfs_acl.ko 2024-05-27T10:39:57.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd 2024-05-27T10:39:57.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/nfsd.ko 2024-05-27T10:39:57.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2 2024-05-27T10:39:57.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/nilfs2.ko 2024-05-27T10:39:57.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls 2024-05-27T10:39:57.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-celtic.ko 2024-05-27T10:39:57.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-centeuro.ko 2024-05-27T10:39:57.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-croatian.ko 2024-05-27T10:39:57.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-cyrillic.ko 2024-05-27T10:39:57.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-gaelic.ko 2024-05-27T10:39:57.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-greek.ko 2024-05-27T10:39:57.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-iceland.ko 2024-05-27T10:39:57.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-inuit.ko 2024-05-27T10:39:57.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-roman.ko 2024-05-27T10:39:57.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-romanian.ko 2024-05-27T10:39:57.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-turkish.ko 2024-05-27T10:39:57.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1250.ko 2024-05-27T10:39:57.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1251.ko 2024-05-27T10:39:57.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1255.ko 2024-05-27T10:39:57.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp737.ko 2024-05-27T10:39:57.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp775.ko 2024-05-27T10:39:57.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp850.ko 2024-05-27T10:39:57.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp852.ko 2024-05-27T10:39:57.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp855.ko 2024-05-27T10:39:57.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp857.ko 2024-05-27T10:39:57.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp860.ko 2024-05-27T10:39:57.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp861.ko 2024-05-27T10:39:57.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp862.ko 2024-05-27T10:39:57.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp863.ko 2024-05-27T10:39:57.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp864.ko 2024-05-27T10:39:57.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp865.ko 2024-05-27T10:39:57.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp866.ko 2024-05-27T10:39:57.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp869.ko 2024-05-27T10:39:57.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp874.ko 2024-05-27T10:39:57.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp932.ko 2024-05-27T10:39:57.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp936.ko 2024-05-27T10:39:57.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp949.ko 2024-05-27T10:39:57.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp950.ko 2024-05-27T10:39:57.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_euc-jp.ko 2024-05-27T10:39:57.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-1.ko 2024-05-27T10:39:57.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-13.ko 2024-05-27T10:39:57.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-14.ko 2024-05-27T10:39:57.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-15.ko 2024-05-27T10:39:57.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-2.ko 2024-05-27T10:39:57.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-3.ko 2024-05-27T10:39:57.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-4.ko 2024-05-27T10:39:57.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-5.ko 2024-05-27T10:39:57.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-6.ko 2024-05-27T10:39:57.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-7.ko 2024-05-27T10:39:57.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-9.ko 2024-05-27T10:39:57.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-r.ko 2024-05-27T10:39:57.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-ru.ko 2024-05-27T10:39:57.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-u.ko 2024-05-27T10:39:57.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-27T10:39:57.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_utf8.ko 2024-05-27T10:39:57.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2 2024-05-27T10:39:57.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster 2024-05-27T10:39:57.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-27T10:39:57.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm 2024-05-27T10:39:57.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-27T10:39:57.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs 2024-05-27T10:39:57.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-27T10:39:57.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2.ko 2024-05-27T10:39:57.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-27T10:39:57.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-27T10:39:57.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-27T10:39:57.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs 2024-05-27T10:39:57.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/overlay.ko 2024-05-27T10:39:57.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore 2024-05-27T10:39:57.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ramoops.ko 2024-05-27T10:39:57.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs 2024-05-27T10:39:57.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/reiserfs.ko 2024-05-27T10:39:57.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs 2024-05-27T10:39:57.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/romfs.ko 2024-05-27T10:39:57.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb 2024-05-27T10:39:57.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client 2024-05-27T10:39:57.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/cifs.ko 2024-05-27T10:39:57.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common 2024-05-27T10:39:57.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_arc4.ko 2024-05-27T10:39:57.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_md4.ko 2024-05-27T10:39:57.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs 2024-05-27T10:39:57.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/squashfs.ko 2024-05-27T10:39:57.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv 2024-05-27T10:39:57.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/sysv.ko 2024-05-27T10:39:57.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf 2024-05-27T10:39:57.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/udf.ko 2024-05-27T10:39:57.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs 2024-05-27T10:39:57.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ufs.ko 2024-05-27T10:39:57.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs 2024-05-27T10:39:57.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/xfs.ko 2024-05-27T10:39:57.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel 2024-05-27T10:39:57.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu 2024-05-27T10:39:57.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu/rcutorture.ko 2024-05-27T10:39:57.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/torture.ko 2024-05-27T10:39:57.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace 2024-05-27T10:39:57.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-27T10:39:57.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib 2024-05-27T10:39:57.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/asn1_encoder.ko 2024-05-27T10:39:57.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc-itu-t.ko 2024-05-27T10:39:57.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc8.ko 2024-05-27T10:39:57.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto 2024-05-27T10:39:57.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libarc4.ko 2024-05-27T10:39:57.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libdes.ko 2024-05-27T10:39:57.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/libcrc32c.ko 2024-05-27T10:39:57.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lru_cache.ko 2024-05-27T10:39:57.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4 2024-05-27T10:39:57.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4_compress.ko 2024-05-27T10:39:57.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4hc_compress.ko 2024-05-27T10:39:57.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math 2024-05-27T10:39:57.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/cordic.ko 2024-05-27T10:39:57.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6 2024-05-27T10:39:57.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/raid6_pq.ko 2024-05-27T10:39:57.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon 2024-05-27T10:39:57.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-27T10:39:57.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_bm.ko 2024-05-27T10:39:57.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_fsm.ko 2024-05-27T10:39:57.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_kmp.ko 2024-05-27T10:39:57.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd 2024-05-27T10:39:57.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd/zstd_compress.ko 2024-05-27T10:39:57.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm 2024-05-27T10:39:57.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm/hwpoison-inject.ko 2024-05-27T10:39:57.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net 2024-05-27T10:39:57.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan 2024-05-27T10:39:57.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/6lowpan.ko 2024-05-27T10:39:57.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_dest.ko 2024-05-27T10:39:57.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_fragment.ko 2024-05-27T10:39:57.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_hop.ko 2024-05-27T10:39:57.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-27T10:39:57.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_mobility.ko 2024-05-27T10:39:57.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_routing.ko 2024-05-27T10:39:57.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_udp.ko 2024-05-27T10:39:57.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802 2024-05-27T10:39:57.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/garp.ko 2024-05-27T10:39:57.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/mrp.ko 2024-05-27T10:39:57.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/p8022.ko 2024-05-27T10:39:57.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/psnap.ko 2024-05-27T10:39:57.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/stp.ko 2024-05-27T10:39:57.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q 2024-05-27T10:39:57.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/8021q.ko 2024-05-27T10:39:57.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p 2024-05-27T10:39:57.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet.ko 2024-05-27T10:39:57.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_fd.ko 2024-05-27T10:39:57.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_rdma.ko 2024-05-27T10:39:57.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_virtio.ko 2024-05-27T10:39:57.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv 2024-05-27T10:39:57.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/batman-adv.ko 2024-05-27T10:39:57.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge 2024-05-27T10:39:57.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/br_netfilter.ko 2024-05-27T10:39:57.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/bridge.ko 2024-05-27T10:39:57.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter 2024-05-27T10:39:57.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-27T10:39:57.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-27T10:39:57.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-27T10:39:57.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-27T10:39:57.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-27T10:39:57.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-27T10:39:57.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-27T10:39:57.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-27T10:39:57.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-27T10:39:57.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-27T10:39:57.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-27T10:39:57.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-27T10:39:57.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-27T10:39:57.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-27T10:39:57.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-27T10:39:57.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-27T10:39:57.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-27T10:39:57.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-27T10:39:57.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-27T10:39:57.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-27T10:39:57.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtables.ko 2024-05-27T10:39:57.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-27T10:39:57.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-27T10:39:57.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-27T10:39:57.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph 2024-05-27T10:39:57.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/libceph.ko 2024-05-27T10:39:57.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core 2024-05-27T10:39:57.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/failover.ko 2024-05-27T10:39:57.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/pktgen.ko 2024-05-27T10:39:57.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp 2024-05-27T10:39:57.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp.ko 2024-05-27T10:39:57.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_diag.ko 2024-05-27T10:39:57.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv4.ko 2024-05-27T10:39:57.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv6.ko 2024-05-27T10:39:57.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver 2024-05-27T10:39:57.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver/dns_resolver.ko 2024-05-27T10:39:57.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa 2024-05-27T10:39:57.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/dsa_core.ko 2024-05-27T10:39:57.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_brcm.ko 2024-05-27T10:39:57.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_dsa.ko 2024-05-27T10:39:57.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_none.ko 2024-05-27T10:39:57.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_trailer.ko 2024-05-27T10:39:57.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154 2024-05-27T10:39:57.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan 2024-05-27T10:39:57.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-27T10:39:57.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154.ko 2024-05-27T10:39:57.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-27T10:39:57.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4 2024-05-27T10:39:57.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ah4.ko 2024-05-27T10:39:57.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/esp4.ko 2024-05-27T10:39:57.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/fou.ko 2024-05-27T10:39:57.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/gre.ko 2024-05-27T10:39:57.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/inet_diag.ko 2024-05-27T10:39:57.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_gre.ko 2024-05-27T10:39:57.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_tunnel.ko 2024-05-27T10:39:57.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_vti.ko 2024-05-27T10:39:57.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipcomp.ko 2024-05-27T10:39:57.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipip.ko 2024-05-27T10:39:57.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter 2024-05-27T10:39:57.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-27T10:39:57.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-27T10:39:57.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-27T10:39:57.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-27T10:39:57.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-27T10:39:57.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-27T10:39:57.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-27T10:39:57.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-27T10:39:57.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-27T10:39:57.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-27T10:39:57.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-27T10:39:57.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-27T10:39:57.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-27T10:39:57.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-27T10:39:57.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-27T10:39:57.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-27T10:39:57.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-27T10:39:57.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-27T10:39:57.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-27T10:39:57.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-27T10:39:57.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-27T10:39:57.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_bic.ko 2024-05-27T10:39:57.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_dctcp.ko 2024-05-27T10:39:57.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_diag.ko 2024-05-27T10:39:57.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_highspeed.ko 2024-05-27T10:39:57.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_htcp.ko 2024-05-27T10:39:57.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_hybla.ko 2024-05-27T10:39:57.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_illinois.ko 2024-05-27T10:39:57.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_lp.ko 2024-05-27T10:39:57.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_scalable.ko 2024-05-27T10:39:57.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_vegas.ko 2024-05-27T10:39:57.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_veno.ko 2024-05-27T10:39:57.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_westwood.ko 2024-05-27T10:39:57.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_yeah.ko 2024-05-27T10:39:57.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tunnel4.ko 2024-05-27T10:39:57.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_diag.ko 2024-05-27T10:39:57.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_tunnel.ko 2024-05-27T10:39:57.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-27T10:39:57.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6 2024-05-27T10:39:57.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ah6.ko 2024-05-27T10:39:57.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/esp6.ko 2024-05-27T10:39:57.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/fou6.ko 2024-05-27T10:39:57.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_tunnel.ko 2024-05-27T10:39:57.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-27T10:39:57.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_vti.ko 2024-05-27T10:39:57.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ipcomp6.ko 2024-05-27T10:39:57.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter 2024-05-27T10:39:57.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-27T10:39:57.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-27T10:39:57.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-27T10:39:57.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-27T10:39:57.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-27T10:39:57.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-27T10:39:57.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-27T10:39:57.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-27T10:39:57.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-27T10:39:57.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-27T10:39:57.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-27T10:39:57.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-27T10:39:57.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-27T10:39:57.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-27T10:39:57.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-27T10:39:57.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-27T10:39:57.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-27T10:39:57.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-27T10:39:57.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-27T10:39:57.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-27T10:39:57.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-27T10:39:57.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-27T10:39:57.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-27T10:39:57.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-27T10:39:57.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/sit.ko 2024-05-27T10:39:57.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/tunnel6.ko 2024-05-27T10:39:57.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-27T10:39:57.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key 2024-05-27T10:39:57.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key/af_key.ko 2024-05-27T10:39:57.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp 2024-05-27T10:39:57.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_core.ko 2024-05-27T10:39:57.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-27T10:39:57.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_eth.ko 2024-05-27T10:39:57.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip.ko 2024-05-27T10:39:57.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip6.ko 2024-05-27T10:39:57.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_netlink.ko 2024-05-27T10:39:57.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ppp.ko 2024-05-27T10:39:57.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc 2024-05-27T10:39:57.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc.ko 2024-05-27T10:39:57.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154 2024-05-27T10:39:57.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/mac802154.ko 2024-05-27T10:39:57.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls 2024-05-27T10:39:57.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/mpls_gso.ko 2024-05-27T10:39:57.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter 2024-05-27T10:39:57.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset 2024-05-27T10:39:57.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set.ko 2024-05-27T10:39:57.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-27T10:39:57.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-27T10:39:57.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-27T10:39:57.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-27T10:39:57.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-27T10:39:57.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-27T10:39:57.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-27T10:39:57.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-27T10:39:57.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-27T10:39:57.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-27T10:39:57.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-27T10:39:57.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-27T10:39:57.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-27T10:39:57.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-27T10:39:57.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-27T10:39:57.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs 2024-05-27T10:39:57.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-27T10:39:57.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-27T10:39:57.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-27T10:39:57.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-27T10:39:57.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-27T10:39:57.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-27T10:39:57.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-27T10:39:57.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-27T10:39:57.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-27T10:39:57.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-27T10:39:57.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-27T10:39:57.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-27T10:39:57.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-27T10:39:57.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-27T10:39:57.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conncount.ko 2024-05-27T10:39:57.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack.ko 2024-05-27T10:39:57.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-27T10:39:57.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-27T10:39:57.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-27T10:39:57.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-27T10:39:57.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-27T10:39:57.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-27T10:39:57.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-27T10:39:57.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-27T10:39:57.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-27T10:39:57.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-27T10:39:57.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-27T10:39:57.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-27T10:39:57.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-27T10:39:57.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table.ko 2024-05-27T10:39:57.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-27T10:39:57.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_log_syslog.ko 2024-05-27T10:39:57.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat.ko 2024-05-27T10:39:57.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-27T10:39:57.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-27T10:39:57.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_irc.ko 2024-05-27T10:39:57.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_sip.ko 2024-05-27T10:39:57.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-27T10:39:57.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-27T10:39:57.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_tables.ko 2024-05-27T10:39:57.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink.ko 2024-05-27T10:39:57.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-27T10:39:57.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_log.ko 2024-05-27T10:39:57.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-27T10:39:57.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-27T10:39:57.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_chain_nat.ko 2024-05-27T10:39:57.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_compat.ko 2024-05-27T10:39:57.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_ct.ko 2024-05-27T10:39:57.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-27T10:39:57.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fib.ko 2024-05-27T10:39:57.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-27T10:39:57.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_hash.ko 2024-05-27T10:39:57.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_limit.ko 2024-05-27T10:39:57.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_log.ko 2024-05-27T10:39:57.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_masq.ko 2024-05-27T10:39:57.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_nat.ko 2024-05-27T10:39:57.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_numgen.ko 2024-05-27T10:39:57.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_queue.ko 2024-05-27T10:39:57.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_quota.ko 2024-05-27T10:39:57.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_redir.ko 2024-05-27T10:39:57.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject.ko 2024-05-27T10:39:57.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject_inet.ko 2024-05-27T10:39:57.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_socket.ko 2024-05-27T10:39:57.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_tunnel.ko 2024-05-27T10:39:57.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_AUDIT.ko 2024-05-27T10:39:57.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-27T10:39:57.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-27T10:39:57.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-27T10:39:57.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CT.ko 2024-05-27T10:39:57.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_DSCP.ko 2024-05-27T10:39:57.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HL.ko 2024-05-27T10:39:57.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HMARK.ko 2024-05-27T10:39:57.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-27T10:39:57.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LED.ko 2024-05-27T10:39:57.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LOG.ko 2024-05-27T10:39:57.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-27T10:39:57.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NETMAP.ko 2024-05-27T10:39:57.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFLOG.ko 2024-05-27T10:39:57.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-27T10:39:57.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_RATEEST.ko 2024-05-27T10:39:57.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-27T10:39:57.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_SECMARK.ko 2024-05-27T10:39:57.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-27T10:39:57.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-27T10:39:57.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TEE.ko 2024-05-27T10:39:57.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TPROXY.ko 2024-05-27T10:39:57.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TRACE.ko 2024-05-27T10:39:57.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_addrtype.ko 2024-05-27T10:39:57.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_bpf.ko 2024-05-27T10:39:57.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cgroup.ko 2024-05-27T10:39:57.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cluster.ko 2024-05-27T10:39:57.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_comment.ko 2024-05-27T10:39:57.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connbytes.ko 2024-05-27T10:39:57.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlabel.ko 2024-05-27T10:39:57.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlimit.ko 2024-05-27T10:39:57.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connmark.ko 2024-05-27T10:39:57.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_conntrack.ko 2024-05-27T10:39:57.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cpu.ko 2024-05-27T10:39:57.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dccp.ko 2024-05-27T10:39:57.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_devgroup.ko 2024-05-27T10:39:57.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dscp.ko 2024-05-27T10:39:57.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ecn.ko 2024-05-27T10:39:57.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_esp.ko 2024-05-27T10:39:57.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hashlimit.ko 2024-05-27T10:39:57.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_helper.ko 2024-05-27T10:39:57.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hl.ko 2024-05-27T10:39:57.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipcomp.ko 2024-05-27T10:39:57.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_iprange.ko 2024-05-27T10:39:57.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipvs.ko 2024-05-27T10:39:57.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_l2tp.ko 2024-05-27T10:39:57.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_length.ko 2024-05-27T10:39:57.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_limit.ko 2024-05-27T10:39:57.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mac.ko 2024-05-27T10:39:57.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mark.ko 2024-05-27T10:39:57.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_multiport.ko 2024-05-27T10:39:57.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nat.ko 2024-05-27T10:39:57.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nfacct.ko 2024-05-27T10:39:57.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_osf.ko 2024-05-27T10:39:57.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_owner.ko 2024-05-27T10:39:57.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_physdev.ko 2024-05-27T10:39:57.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_pkttype.ko 2024-05-27T10:39:57.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_policy.ko 2024-05-27T10:39:57.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_quota.ko 2024-05-27T10:39:57.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_rateest.ko 2024-05-27T10:39:57.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_realm.ko 2024-05-27T10:39:57.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_recent.ko 2024-05-27T10:39:57.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_sctp.ko 2024-05-27T10:39:57.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_set.ko 2024-05-27T10:39:57.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_socket.ko 2024-05-27T10:39:57.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_state.ko 2024-05-27T10:39:57.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_statistic.ko 2024-05-27T10:39:57.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_string.ko 2024-05-27T10:39:57.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpmss.ko 2024-05-27T10:39:57.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_time.ko 2024-05-27T10:39:57.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_u32.ko 2024-05-27T10:39:57.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink 2024-05-27T10:39:57.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/netlink_diag.ko 2024-05-27T10:39:57.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh 2024-05-27T10:39:57.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/nsh.ko 2024-05-27T10:39:57.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch 2024-05-27T10:39:57.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/openvswitch.ko 2024-05-27T10:39:57.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-geneve.ko 2024-05-27T10:39:57.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-gre.ko 2024-05-27T10:39:57.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-vxlan.ko 2024-05-27T10:39:57.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet 2024-05-27T10:39:57.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/af_packet_diag.ko 2024-05-27T10:39:57.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds 2024-05-27T10:39:57.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds.ko 2024-05-27T10:39:57.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_rdma.ko 2024-05-27T10:39:57.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_tcp.ko 2024-05-27T10:39:57.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched 2024-05-27T10:39:57.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_csum.ko 2024-05-27T10:39:57.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_gact.ko 2024-05-27T10:39:57.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_mirred.ko 2024-05-27T10:39:57.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_nat.ko 2024-05-27T10:39:57.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_pedit.ko 2024-05-27T10:39:57.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_police.ko 2024-05-27T10:39:57.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_simple.ko 2024-05-27T10:39:57.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_skbedit.ko 2024-05-27T10:39:57.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_vlan.ko 2024-05-27T10:39:57.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_basic.ko 2024-05-27T10:39:57.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_bpf.ko 2024-05-27T10:39:57.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_flow.ko 2024-05-27T10:39:57.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_fw.ko 2024-05-27T10:39:57.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_route.ko 2024-05-27T10:39:57.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_u32.ko 2024-05-27T10:39:57.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_cmp.ko 2024-05-27T10:39:57.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_ipset.ko 2024-05-27T10:39:57.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_meta.ko 2024-05-27T10:39:57.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_nbyte.ko 2024-05-27T10:39:57.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_text.ko 2024-05-27T10:39:57.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_u32.ko 2024-05-27T10:39:57.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_choke.ko 2024-05-27T10:39:57.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_codel.ko 2024-05-27T10:39:57.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_drr.ko 2024-05-27T10:39:57.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq.ko 2024-05-27T10:39:57.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_gred.ko 2024-05-27T10:39:57.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hfsc.ko 2024-05-27T10:39:57.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hhf.ko 2024-05-27T10:39:57.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_htb.ko 2024-05-27T10:39:57.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_ingress.ko 2024-05-27T10:39:57.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio.ko 2024-05-27T10:39:57.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio_lib.ko 2024-05-27T10:39:57.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_multiq.ko 2024-05-27T10:39:57.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_netem.ko 2024-05-27T10:39:57.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_pie.ko 2024-05-27T10:39:57.214 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_plug.ko 2024-05-27T10:39:57.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_prio.ko 2024-05-27T10:39:57.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_qfq.ko 2024-05-27T10:39:57.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_red.ko 2024-05-27T10:39:57.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfb.ko 2024-05-27T10:39:57.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfq.ko 2024-05-27T10:39:57.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_tbf.ko 2024-05-27T10:39:57.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_teql.ko 2024-05-27T10:39:57.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp 2024-05-27T10:39:57.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp.ko 2024-05-27T10:39:57.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp_diag.ko 2024-05-27T10:39:57.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc 2024-05-27T10:39:57.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss 2024-05-27T10:39:57.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-27T10:39:57.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-27T10:39:57.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/sunrpc.ko 2024-05-27T10:39:57.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma 2024-05-27T10:39:57.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-27T10:39:57.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc 2024-05-27T10:39:57.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc.ko 2024-05-27T10:39:57.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc_diag.ko 2024-05-27T10:39:57.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix 2024-05-27T10:39:57.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/unix_diag.ko 2024-05-27T10:39:57.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock 2024-05-27T10:39:57.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-27T10:39:57.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-27T10:39:57.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock.ko 2024-05-27T10:39:57.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-27T10:39:57.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-27T10:39:57.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm 2024-05-27T10:39:57.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-27T10:39:57.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security 2024-05-27T10:39:57.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys 2024-05-27T10:39:57.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys 2024-05-27T10:39:57.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-27T10:39:57.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys 2024-05-27T10:39:57.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys/trusted.ko 2024-05-27T10:39:57.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias 2024-05-27T10:39:57.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias.bin 2024-05-27T10:39:57.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin 2024-05-27T10:39:57.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.alias.bin 2024-05-27T10:39:57.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.bin 2024-05-27T10:39:57.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.modinfo 2024-05-27T10:39:57.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep 2024-05-27T10:39:57.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep.bin 2024-05-27T10:39:57.219 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.devname 2024-05-27T10:39:57.219 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.order 2024-05-27T10:39:57.219 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.softdep 2024-05-27T10:39:57.219 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols 2024-05-27T10:39:57.219 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols.bin 2024-05-27T10:39:57.219 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-05-27T10:39:57.223 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gb9459a26b088 2024-05-27T10:39:57.224 DEBUG:teuthology.orchestra.run.smithi047:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-27T10:39:57.248 INFO:teuthology.orchestra.run.smithi047.stdout:postinstall scriptlet (using /bin/sh): 2024-05-27T10:39:57.248 INFO:teuthology.orchestra.run.smithi047.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-27T10:39:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: /usr/bin/kernel-install add 6.9.0-gb9459a26b088 /lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-05-27T10:39:57.248 INFO:teuthology.orchestra.run.smithi047.stdout:fi 2024-05-27T10:39:57.249 INFO:teuthology.orchestra.run.smithi047.stdout:for file in vmlinuz System.map config; do 2024-05-27T10:39:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: if ! cmp --silent "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088"; then 2024-05-27T10:39:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: cp "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088" 2024-05-27T10:39:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: fi 2024-05-27T10:39:57.249 INFO:teuthology.orchestra.run.smithi047.stdout:done 2024-05-27T10:39:57.249 INFO:teuthology.orchestra.run.smithi047.stdout:if [ -d "/lib/modules/6.9.0-gb9459a26b088/dtb" ] && \ 2024-05-27T10:39:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: ! diff -rq "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" >/dev/null 2>&1; then 2024-05-27T10:39:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: rm -rf "/boot/dtb-6.9.0-gb9459a26b088" 2024-05-27T10:39:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: cp -r "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" 2024-05-27T10:39:57.250 INFO:teuthology.orchestra.run.smithi047.stdout:fi 2024-05-27T10:39:57.250 INFO:teuthology.orchestra.run.smithi047.stdout:if [ ! -e "/lib/modules/6.9.0-gb9459a26b088/modules.dep" ]; then 2024-05-27T10:39:57.250 INFO:teuthology.orchestra.run.smithi047.stdout: /usr/sbin/depmod 6.9.0-gb9459a26b088 2024-05-27T10:39:57.250 INFO:teuthology.orchestra.run.smithi047.stdout:fi 2024-05-27T10:39:57.250 INFO:teuthology.orchestra.run.smithi047.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-27T10:39:57.250 INFO:teuthology.orchestra.run.smithi047.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-27T10:39:57.250 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-install remove 6.9.0-gb9459a26b088 2024-05-27T10:39:57.250 INFO:teuthology.orchestra.run.smithi047.stdout:fi 2024-05-27T10:39:57.250 DEBUG:teuthology.orchestra.run.smithi047:> sudo rpm -qi grub2-tools 2024-05-27T10:39:57.322 INFO:teuthology.orchestra.run.smithi047.stdout:Name : grub2-tools 2024-05-27T10:39:57.322 INFO:teuthology.orchestra.run.smithi047.stdout:Epoch : 1 2024-05-27T10:39:57.322 INFO:teuthology.orchestra.run.smithi047.stdout:Version : 2.06 2024-05-27T10:39:57.322 INFO:teuthology.orchestra.run.smithi047.stdout:Release : 68.el9 2024-05-27T10:39:57.322 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: x86_64 2024-05-27T10:39:57.322 INFO:teuthology.orchestra.run.smithi047.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-27T10:39:57.322 INFO:teuthology.orchestra.run.smithi047.stdout:Group : Unspecified 2024-05-27T10:39:57.322 INFO:teuthology.orchestra.run.smithi047.stdout:Size : 8264254 2024-05-27T10:39:57.322 INFO:teuthology.orchestra.run.smithi047.stdout:License : GPLv3+ 2024-05-27T10:39:57.323 INFO:teuthology.orchestra.run.smithi047.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-27T10:39:57.323 INFO:teuthology.orchestra.run.smithi047.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-27T10:39:57.323 INFO:teuthology.orchestra.run.smithi047.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-27T10:39:57.323 INFO:teuthology.orchestra.run.smithi047.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-27T10:39:57.323 INFO:teuthology.orchestra.run.smithi047.stdout:Packager : builder@centos.org 2024-05-27T10:39:57.323 INFO:teuthology.orchestra.run.smithi047.stdout:Vendor : CentOS 2024-05-27T10:39:57.323 INFO:teuthology.orchestra.run.smithi047.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-27T10:39:57.323 INFO:teuthology.orchestra.run.smithi047.stdout:Summary : Support tools for GRUB. 2024-05-27T10:39:57.323 INFO:teuthology.orchestra.run.smithi047.stdout:Description : 2024-05-27T10:39:57.323 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:39:57.323 INFO:teuthology.orchestra.run.smithi047.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-27T10:39:57.324 INFO:teuthology.orchestra.run.smithi047.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-27T10:39:57.324 INFO:teuthology.orchestra.run.smithi047.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-27T10:39:57.324 INFO:teuthology.orchestra.run.smithi047.stdout:hardware devices. 2024-05-27T10:39:57.324 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:39:57.324 INFO:teuthology.orchestra.run.smithi047.stdout:This subpackage provides tools for support of all platforms. 2024-05-27T10:39:57.325 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-27T10:39:57.325 INFO:teuthology.task.kernel:Updating grub on smithi047 to boot 6.9.0-gb9459a26b088 2024-05-27T10:39:57.325 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-27T10:39:57.931 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-05-27T10:39:59.428 INFO:teuthology.orchestra.run.smithi047.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-27T10:39:59.453 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-05-27T10:39:59.455 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-05-27T10:39:59.471 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.ScUvnebDSg 2024-05-27T10:39:59.471 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ScUvnebDSg 2024-05-27T10:39:59.536 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.ScUvnebDSg 2024-05-27T10:39:59.685 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.ScUvnebDSg is 6KB 2024-05-27T10:39:59.733 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.ScUvnebDSg 2024-05-27T10:39:59.748 DEBUG:teuthology.orchestra.run.smithi047:> sudo /bin/ls /boot/loader/entries || true 2024-05-27T10:39:59.813 INFO:teuthology.orchestra.run.smithi047.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-27T10:39:59.813 INFO:teuthology.orchestra.run.smithi047.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-27T10:39:59.813 INFO:teuthology.orchestra.run.smithi047.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-27T10:39:59.813 INFO:teuthology.orchestra.run.smithi047.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088.conf 2024-05-27T10:39:59.814 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088 2024-05-27T10:39:59.970 DEBUG:teuthology.orchestra.run.smithi047:> sudo shutdown -r now 2024-05-27T10:40:12.430 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi053.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-27T10:40:12.430 DEBUG:teuthology.orchestra.run.smithi053:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-27T10:40:12.516 INFO:teuthology.orchestra.run.smithi053.stdout:/boot/System.map-6.9.0-gb9459a26b088 2024-05-27T10:40:12.517 INFO:teuthology.orchestra.run.smithi053.stdout:/boot/config-6.9.0-gb9459a26b088 2024-05-27T10:40:12.517 INFO:teuthology.orchestra.run.smithi053.stdout:/boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-27T10:40:12.517 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/System.map 2024-05-27T10:40:12.517 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/config 2024-05-27T10:40:12.517 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel 2024-05-27T10:40:12.517 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch 2024-05-27T10:40:12.517 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86 2024-05-27T10:40:12.517 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto 2024-05-27T10:40:12.517 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-27T10:40:12.517 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-27T10:40:12.517 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-27T10:40:12.517 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-27T10:40:12.517 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-27T10:40:12.518 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-27T10:40:12.518 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-27T10:40:12.518 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-27T10:40:12.518 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-27T10:40:12.518 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-27T10:40:12.518 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-27T10:40:12.518 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-27T10:40:12.518 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-27T10:40:12.518 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-27T10:40:12.518 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-27T10:40:12.518 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-27T10:40:12.518 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-27T10:40:12.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-27T10:40:12.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-27T10:40:12.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-27T10:40:12.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel 2024-05-27T10:40:12.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu 2024-05-27T10:40:12.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce 2024-05-27T10:40:12.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-27T10:40:12.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm 2024-05-27T10:40:12.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-27T10:40:12.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-27T10:40:12.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm.ko 2024-05-27T10:40:12.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto 2024-05-27T10:40:12.519 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ansi_cprng.ko 2024-05-27T10:40:12.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/anubis.ko 2024-05-27T10:40:12.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/arc4.ko 2024-05-27T10:40:12.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx 2024-05-27T10:40:12.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_memcpy.ko 2024-05-27T10:40:12.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_pq.ko 2024-05-27T10:40:12.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-27T10:40:12.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_tx.ko 2024-05-27T10:40:12.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_xor.ko 2024-05-27T10:40:12.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/raid6test.ko 2024-05-27T10:40:12.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authenc.ko 2024-05-27T10:40:12.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authencesn.ko 2024-05-27T10:40:12.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blake2b_generic.ko 2024-05-27T10:40:12.520 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_common.ko 2024-05-27T10:40:12.521 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_generic.ko 2024-05-27T10:40:12.521 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/camellia_generic.ko 2024-05-27T10:40:12.521 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast5_generic.ko 2024-05-27T10:40:12.521 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast6_generic.ko 2024-05-27T10:40:12.521 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast_common.ko 2024-05-27T10:40:12.521 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ccm.ko 2024-05-27T10:40:12.521 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cmac.ko 2024-05-27T10:40:12.521 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crc32_generic.ko 2024-05-27T10:40:12.521 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_engine.ko 2024-05-27T10:40:12.521 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_user.ko 2024-05-27T10:40:12.521 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cts.ko 2024-05-27T10:40:12.521 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/des_generic.ko 2024-05-27T10:40:12.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/dh_generic.ko 2024-05-27T10:40:12.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/echainiv.ko 2024-05-27T10:40:12.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/essiv.ko 2024-05-27T10:40:12.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/fcrypt.ko 2024-05-27T10:40:12.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/khazad.ko 2024-05-27T10:40:12.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4.ko 2024-05-27T10:40:12.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4hc.ko 2024-05-27T10:40:12.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/md4.ko 2024-05-27T10:40:12.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/michael_mic.ko 2024-05-27T10:40:12.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcbc.ko 2024-05-27T10:40:12.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcrypt.ko 2024-05-27T10:40:12.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/rmd160.ko 2024-05-27T10:40:12.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/seed.ko 2024-05-27T10:40:12.522 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/serpent_generic.ko 2024-05-27T10:40:12.523 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tcrypt.ko 2024-05-27T10:40:12.523 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tea.ko 2024-05-27T10:40:12.523 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_common.ko 2024-05-27T10:40:12.523 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_generic.ko 2024-05-27T10:40:12.523 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/vmac.ko 2024-05-27T10:40:12.523 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/wp512.ko 2024-05-27T10:40:12.523 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xcbc.ko 2024-05-27T10:40:12.523 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xor.ko 2024-05-27T10:40:12.523 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xxhash_generic.ko 2024-05-27T10:40:12.523 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers 2024-05-27T10:40:12.523 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi 2024-05-27T10:40:12.523 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-27T10:40:12.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_pad.ko 2024-05-27T10:40:12.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ec_sys.ko 2024-05-27T10:40:12.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/platform_profile.ko 2024-05-27T10:40:12.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbs.ko 2024-05-27T10:40:12.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbshc.ko 2024-05-27T10:40:12.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/video.ko 2024-05-27T10:40:12.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata 2024-05-27T10:40:12.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/acard-ahci.ko 2024-05-27T10:40:12.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci_platform.ko 2024-05-27T10:40:12.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ata_generic.ko 2024-05-27T10:40:12.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci_platform.ko 2024-05-27T10:40:12.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_acpi.ko 2024-05-27T10:40:12.524 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ali.ko 2024-05-27T10:40:12.525 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_amd.ko 2024-05-27T10:40:12.525 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_artop.ko 2024-05-27T10:40:12.525 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atiixp.ko 2024-05-27T10:40:12.525 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atp867x.ko 2024-05-27T10:40:12.525 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd640.ko 2024-05-27T10:40:12.525 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd64x.ko 2024-05-27T10:40:12.525 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cypress.ko 2024-05-27T10:40:12.525 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_efar.ko 2024-05-27T10:40:12.525 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt366.ko 2024-05-27T10:40:12.525 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt37x.ko 2024-05-27T10:40:12.525 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-27T10:40:12.525 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-27T10:40:12.525 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it8213.ko 2024-05-27T10:40:12.526 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it821x.ko 2024-05-27T10:40:12.526 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_jmicron.ko 2024-05-27T10:40:12.526 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_marvell.ko 2024-05-27T10:40:12.526 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_mpiix.ko 2024-05-27T10:40:12.526 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_netcell.ko 2024-05-27T10:40:12.526 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ninja32.ko 2024-05-27T10:40:12.526 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87410.ko 2024-05-27T10:40:12.526 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87415.ko 2024-05-27T10:40:12.526 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_oldpiix.ko 2024-05-27T10:40:12.526 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_opti.ko 2024-05-27T10:40:12.526 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_optidma.ko 2024-05-27T10:40:12.526 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pcmcia.ko 2024-05-27T10:40:12.526 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-27T10:40:12.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-27T10:40:12.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_piccolo.ko 2024-05-27T10:40:12.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rdc.ko 2024-05-27T10:40:12.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sch.ko 2024-05-27T10:40:12.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_serverworks.ko 2024-05-27T10:40:12.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sil680.ko 2024-05-27T10:40:12.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sis.ko 2024-05-27T10:40:12.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sl82c105.ko 2024-05-27T10:40:12.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_triflex.ko 2024-05-27T10:40:12.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_via.ko 2024-05-27T10:40:12.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pdc_adma.ko 2024-05-27T10:40:12.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_inic162x.ko 2024-05-27T10:40:12.527 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_mv.ko 2024-05-27T10:40:12.528 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_nv.ko 2024-05-27T10:40:12.528 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_promise.ko 2024-05-27T10:40:12.528 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_qstor.ko 2024-05-27T10:40:12.528 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil.ko 2024-05-27T10:40:12.528 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil24.ko 2024-05-27T10:40:12.528 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sis.ko 2024-05-27T10:40:12.528 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_svw.ko 2024-05-27T10:40:12.528 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sx4.ko 2024-05-27T10:40:12.528 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_uli.ko 2024-05-27T10:40:12.528 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_via.ko 2024-05-27T10:40:12.528 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_vsc.ko 2024-05-27T10:40:12.528 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay 2024-05-27T10:40:12.528 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ks0108.ko 2024-05-27T10:40:12.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base 2024-05-27T10:40:12.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap 2024-05-27T10:40:12.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-27T10:40:12.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-27T10:40:12.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma 2024-05-27T10:40:12.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/bcma.ko 2024-05-27T10:40:12.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block 2024-05-27T10:40:12.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe 2024-05-27T10:40:12.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/aoe.ko 2024-05-27T10:40:12.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/brd.ko 2024-05-27T10:40:12.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd 2024-05-27T10:40:12.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/drbd.ko 2024-05-27T10:40:12.529 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/floppy.ko 2024-05-27T10:40:12.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/loop.ko 2024-05-27T10:40:12.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx 2024-05-27T10:40:12.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-27T10:40:12.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/nbd.ko 2024-05-27T10:40:12.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk 2024-05-27T10:40:12.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/null_blk.ko 2024-05-27T10:40:12.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/pktcdvd.ko 2024-05-27T10:40:12.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/rbd.ko 2024-05-27T10:40:12.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/virtio_blk.ko 2024-05-27T10:40:12.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback 2024-05-27T10:40:12.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-27T10:40:12.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkfront.ko 2024-05-27T10:40:12.530 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram 2024-05-27T10:40:12.531 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/zram.ko 2024-05-27T10:40:12.531 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char 2024-05-27T10:40:12.531 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hangcheck-timer.ko 2024-05-27T10:40:12.531 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random 2024-05-27T10:40:12.531 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-27T10:40:12.531 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-27T10:40:12.531 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-27T10:40:12.531 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/via-rng.ko 2024-05-27T10:40:12.531 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-27T10:40:12.531 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi 2024-05-27T10:40:12.531 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-27T10:40:12.531 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-27T10:40:12.531 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-27T10:40:12.532 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-27T10:40:12.532 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-27T10:40:12.532 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-27T10:40:12.532 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/lp.ko 2024-05-27T10:40:12.532 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave 2024-05-27T10:40:12.532 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/mwave.ko 2024-05-27T10:40:12.532 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ppdev.ko 2024-05-27T10:40:12.532 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tlclk.ko 2024-05-27T10:40:12.532 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm 2024-05-27T10:40:12.532 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm.ko 2024-05-27T10:40:12.532 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-27T10:40:12.532 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-27T10:40:12.532 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-27T10:40:12.533 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-27T10:40:12.533 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-27T10:40:12.533 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/uv_mmtimer.ko 2024-05-27T10:40:12.533 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/virtio_console.ko 2024-05-27T10:40:12.533 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq 2024-05-27T10:40:12.533 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-27T10:40:12.533 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-27T10:40:12.533 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-27T10:40:12.533 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-27T10:40:12.533 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-27T10:40:12.533 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-27T10:40:12.533 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto 2024-05-27T10:40:12.533 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp 2024-05-27T10:40:12.534 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-27T10:40:12.534 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp.ko 2024-05-27T10:40:12.534 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel 2024-05-27T10:40:12.534 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat 2024-05-27T10:40:12.534 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common 2024-05-27T10:40:12.534 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-27T10:40:12.534 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-27T10:40:12.534 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-27T10:40:12.534 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-aes.ko 2024-05-27T10:40:12.534 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-sha.ko 2024-05-27T10:40:12.534 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio 2024-05-27T10:40:12.534 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-27T10:40:12.534 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca 2024-05-27T10:40:12.535 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/dca.ko 2024-05-27T10:40:12.535 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq 2024-05-27T10:40:12.535 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-27T10:40:12.535 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma 2024-05-27T10:40:12.535 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw 2024-05-27T10:40:12.535 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-27T10:40:12.535 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat 2024-05-27T10:40:12.535 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-27T10:40:12.535 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac 2024-05-27T10:40:12.535 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/amd64_edac.ko 2024-05-27T10:40:12.535 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/e752x_edac.ko 2024-05-27T10:40:12.535 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/edac_mce_amd.ko 2024-05-27T10:40:12.535 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3000_edac.ko 2024-05-27T10:40:12.535 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3200_edac.ko 2024-05-27T10:40:12.536 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5100_edac.ko 2024-05-27T10:40:12.536 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5400_edac.ko 2024-05-27T10:40:12.536 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7300_edac.ko 2024-05-27T10:40:12.536 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7core_edac.ko 2024-05-27T10:40:12.536 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i82975x_edac.ko 2024-05-27T10:40:12.536 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ie31200_edac.ko 2024-05-27T10:40:12.536 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/sb_edac.ko 2024-05-27T10:40:12.536 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/x38_edac.ko 2024-05-27T10:40:12.536 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware 2024-05-27T10:40:12.536 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/edd.ko 2024-05-27T10:40:12.536 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-27T10:40:12.536 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio 2024-05-27T10:40:12.536 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ich.ko 2024-05-27T10:40:12.537 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-27T10:40:12.537 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid 2024-05-27T10:40:12.537 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-appleir.ko 2024-05-27T10:40:12.537 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-aureal.ko 2024-05-27T10:40:12.537 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-axff.ko 2024-05-27T10:40:12.537 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-dr.ko 2024-05-27T10:40:12.537 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elecom.ko 2024-05-27T10:40:12.537 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elo.ko 2024-05-27T10:40:12.537 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-emsff.ko 2024-05-27T10:40:12.537 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gaff.ko 2024-05-27T10:40:12.537 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gt683r.ko 2024-05-27T10:40:12.537 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gyration.ko 2024-05-27T10:40:12.537 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-27T10:40:12.538 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-27T10:40:12.538 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtekff.ko 2024-05-27T10:40:12.538 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-hyperv.ko 2024-05-27T10:40:12.538 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-icade.ko 2024-05-27T10:40:12.538 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-keytouch.ko 2024-05-27T10:40:12.538 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kye.ko 2024-05-27T10:40:12.538 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lcpower.ko 2024-05-27T10:40:12.538 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-led.ko 2024-05-27T10:40:12.538 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lenovo.ko 2024-05-27T10:40:12.538 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-27T10:40:12.538 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-27T10:40:12.538 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-multitouch.ko 2024-05-27T10:40:12.539 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ortek.ko 2024-05-27T10:40:12.539 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-penmount.ko 2024-05-27T10:40:12.539 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-petalynx.ko 2024-05-27T10:40:12.539 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-picolcd.ko 2024-05-27T10:40:12.539 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-pl.ko 2024-05-27T10:40:12.539 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-plantronics.ko 2024-05-27T10:40:12.539 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-primax.ko 2024-05-27T10:40:12.539 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-rmi.ko 2024-05-27T10:40:12.539 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-27T10:40:12.539 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-common.ko 2024-05-27T10:40:12.539 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-27T10:40:12.539 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-27T10:40:12.539 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-27T10:40:12.540 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-27T10:40:12.540 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-27T10:40:12.540 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-27T10:40:12.540 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-27T10:40:12.540 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-27T10:40:12.540 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-27T10:40:12.540 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat.ko 2024-05-27T10:40:12.540 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-saitek.ko 2024-05-27T10:40:12.540 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-samsung.ko 2024-05-27T10:40:12.540 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-27T10:40:12.540 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sjoy.ko 2024-05-27T10:40:12.540 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sony.ko 2024-05-27T10:40:12.540 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-speedlink.ko 2024-05-27T10:40:12.541 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-steelseries.ko 2024-05-27T10:40:12.541 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sunplus.ko 2024-05-27T10:40:12.541 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-27T10:40:12.541 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tivo.ko 2024-05-27T10:40:12.541 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tmff.ko 2024-05-27T10:40:12.541 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-topseed.ko 2024-05-27T10:40:12.541 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-twinhan.ko 2024-05-27T10:40:12.541 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-uclogic.ko 2024-05-27T10:40:12.541 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-waltop.ko 2024-05-27T10:40:12.541 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-wiimote.ko 2024-05-27T10:40:12.541 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-xinmo.ko 2024-05-27T10:40:12.541 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zpff.ko 2024-05-27T10:40:12.542 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zydacron.ko 2024-05-27T10:40:12.542 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/uhid.ko 2024-05-27T10:40:12.542 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/wacom.ko 2024-05-27T10:40:12.542 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv 2024-05-27T10:40:12.542 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_balloon.ko 2024-05-27T10:40:12.542 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_utils.ko 2024-05-27T10:40:12.542 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_vmbus.ko 2024-05-27T10:40:12.542 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon 2024-05-27T10:40:12.542 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru.ko 2024-05-27T10:40:12.542 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru3.ko 2024-05-27T10:40:12.542 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-27T10:40:12.542 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7414.ko 2024-05-27T10:40:12.542 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7418.ko 2024-05-27T10:40:12.543 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adc128d818.ko 2024-05-27T10:40:12.543 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1025.ko 2024-05-27T10:40:12.543 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1026.ko 2024-05-27T10:40:12.543 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1029.ko 2024-05-27T10:40:12.543 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1031.ko 2024-05-27T10:40:12.543 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm9240.ko 2024-05-27T10:40:12.543 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ads7828.ko 2024-05-27T10:40:12.543 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7410.ko 2024-05-27T10:40:12.543 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7411.ko 2024-05-27T10:40:12.543 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7462.ko 2024-05-27T10:40:12.543 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7470.ko 2024-05-27T10:40:12.543 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7475.ko 2024-05-27T10:40:12.543 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7x10.ko 2024-05-27T10:40:12.543 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/amc6821.ko 2024-05-27T10:40:12.544 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/applesmc.ko 2024-05-27T10:40:12.544 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asb100.ko 2024-05-27T10:40:12.544 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asc7621.ko 2024-05-27T10:40:12.544 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-27T10:40:12.544 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/atxp1.ko 2024-05-27T10:40:12.544 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/coretemp.ko 2024-05-27T10:40:12.544 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-27T10:40:12.544 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dme1737.ko 2024-05-27T10:40:12.544 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds1621.ko 2024-05-27T10:40:12.544 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds620.ko 2024-05-27T10:40:12.544 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc1403.ko 2024-05-27T10:40:12.544 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc6w201.ko 2024-05-27T10:40:12.544 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71805f.ko 2024-05-27T10:40:12.545 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71882fg.ko 2024-05-27T10:40:12.545 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f75375s.ko 2024-05-27T10:40:12.545 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fam15h_power.ko 2024-05-27T10:40:12.545 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fschmd.ko 2024-05-27T10:40:12.545 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g760a.ko 2024-05-27T10:40:12.545 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g762.ko 2024-05-27T10:40:12.545 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl518sm.ko 2024-05-27T10:40:12.545 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl520sm.ko 2024-05-27T10:40:12.545 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-27T10:40:12.545 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5500_temp.ko 2024-05-27T10:40:12.545 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5k_amb.ko 2024-05-27T10:40:12.545 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmaem.ko 2024-05-27T10:40:12.545 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmpex.ko 2024-05-27T10:40:12.545 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina209.ko 2024-05-27T10:40:12.546 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina2xx.ko 2024-05-27T10:40:12.546 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/it87.ko 2024-05-27T10:40:12.546 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k10temp.ko 2024-05-27T10:40:12.546 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k8temp.ko 2024-05-27T10:40:12.546 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lineage-pem.ko 2024-05-27T10:40:12.546 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm63.ko 2024-05-27T10:40:12.546 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm73.ko 2024-05-27T10:40:12.546 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm75.ko 2024-05-27T10:40:12.546 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm77.ko 2024-05-27T10:40:12.546 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm78.ko 2024-05-27T10:40:12.546 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm80.ko 2024-05-27T10:40:12.546 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm83.ko 2024-05-27T10:40:12.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm85.ko 2024-05-27T10:40:12.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm87.ko 2024-05-27T10:40:12.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm90.ko 2024-05-27T10:40:12.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm92.ko 2024-05-27T10:40:12.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm93.ko 2024-05-27T10:40:12.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95234.ko 2024-05-27T10:40:12.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95241.ko 2024-05-27T10:40:12.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95245.ko 2024-05-27T10:40:12.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc2945.ko 2024-05-27T10:40:12.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4151.ko 2024-05-27T10:40:12.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4215.ko 2024-05-27T10:40:12.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4222.ko 2024-05-27T10:40:12.547 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4245.ko 2024-05-27T10:40:12.548 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4260.ko 2024-05-27T10:40:12.548 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4261.ko 2024-05-27T10:40:12.548 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max16065.ko 2024-05-27T10:40:12.548 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1619.ko 2024-05-27T10:40:12.548 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1668.ko 2024-05-27T10:40:12.548 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max197.ko 2024-05-27T10:40:12.548 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6639.ko 2024-05-27T10:40:12.548 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6650.ko 2024-05-27T10:40:12.548 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6697.ko 2024-05-27T10:40:12.548 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mcp3021.ko 2024-05-27T10:40:12.548 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6683.ko 2024-05-27T10:40:12.548 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775-core.ko 2024-05-27T10:40:12.548 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775.ko 2024-05-27T10:40:12.549 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct7802.ko 2024-05-27T10:40:12.549 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87360.ko 2024-05-27T10:40:12.549 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87427.ko 2024-05-27T10:40:12.549 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pcf8591.ko 2024-05-27T10:40:12.549 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus 2024-05-27T10:40:12.549 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-27T10:40:12.549 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-27T10:40:12.549 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-27T10:40:12.549 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-27T10:40:12.549 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-27T10:40:12.549 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-27T10:40:12.549 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-27T10:40:12.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-27T10:40:12.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-27T10:40:12.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-27T10:40:12.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-27T10:40:12.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-27T10:40:12.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/powr1220.ko 2024-05-27T10:40:12.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5627.ko 2024-05-27T10:40:12.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5636.ko 2024-05-27T10:40:12.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-27T10:40:12.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht15.ko 2024-05-27T10:40:12.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht21.ko 2024-05-27T10:40:12.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/shtc1.ko 2024-05-27T10:40:12.550 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sis5595.ko 2024-05-27T10:40:12.551 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47b397.ko 2024-05-27T10:40:12.551 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m1.ko 2024-05-27T10:40:12.551 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m192.ko 2024-05-27T10:40:12.551 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/thmc50.ko 2024-05-27T10:40:12.551 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp102.ko 2024-05-27T10:40:12.551 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp103.ko 2024-05-27T10:40:12.551 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp401.ko 2024-05-27T10:40:12.551 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp421.ko 2024-05-27T10:40:12.551 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via-cputemp.ko 2024-05-27T10:40:12.551 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via686a.ko 2024-05-27T10:40:12.551 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt1211.ko 2024-05-27T10:40:12.551 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt8231.ko 2024-05-27T10:40:12.552 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627ehf.ko 2024-05-27T10:40:12.552 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627hf.ko 2024-05-27T10:40:12.552 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83781d.ko 2024-05-27T10:40:12.552 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83791d.ko 2024-05-27T10:40:12.552 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83792d.ko 2024-05-27T10:40:12.552 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83793.ko 2024-05-27T10:40:12.552 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83795.ko 2024-05-27T10:40:12.552 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l785ts.ko 2024-05-27T10:40:12.552 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l786ng.ko 2024-05-27T10:40:12.552 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c 2024-05-27T10:40:12.552 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos 2024-05-27T10:40:12.552 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-27T10:40:12.552 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-27T10:40:12.553 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses 2024-05-27T10:40:12.553 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-27T10:40:12.553 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-27T10:40:12.553 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-27T10:40:12.553 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-27T10:40:12.553 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-27T10:40:12.553 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-27T10:40:12.553 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-27T10:40:12.553 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-27T10:40:12.553 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-27T10:40:12.553 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-27T10:40:12.553 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-27T10:40:12.553 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-27T10:40:12.553 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-27T10:40:12.554 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-27T10:40:12.554 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-27T10:40:12.554 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-27T10:40:12.554 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-27T10:40:12.554 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-27T10:40:12.554 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-27T10:40:12.554 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-27T10:40:12.554 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-27T10:40:12.554 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-27T10:40:12.554 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-27T10:40:12.554 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-dev.ko 2024-05-27T10:40:12.554 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-mux.ko 2024-05-27T10:40:12.554 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-27T10:40:12.555 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-smbus.ko 2024-05-27T10:40:12.555 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-stub.ko 2024-05-27T10:40:12.555 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband 2024-05-27T10:40:12.555 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core 2024-05-27T10:40:12.555 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-27T10:40:12.555 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_core.ko 2024-05-27T10:40:12.555 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-27T10:40:12.555 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-27T10:40:12.555 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-27T10:40:12.555 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-27T10:40:12.555 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-27T10:40:12.555 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw 2024-05-27T10:40:12.555 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4 2024-05-27T10:40:12.556 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-27T10:40:12.556 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4 2024-05-27T10:40:12.556 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-27T10:40:12.556 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5 2024-05-27T10:40:12.556 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-27T10:40:12.556 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca 2024-05-27T10:40:12.556 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-27T10:40:12.556 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp 2024-05-27T10:40:12.556 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib 2024-05-27T10:40:12.556 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-27T10:40:12.557 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser 2024-05-27T10:40:12.557 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-27T10:40:12.557 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert 2024-05-27T10:40:12.557 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-27T10:40:12.557 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp 2024-05-27T10:40:12.557 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-27T10:40:12.557 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt 2024-05-27T10:40:12.557 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-27T10:40:12.557 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input 2024-05-27T10:40:12.557 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport 2024-05-27T10:40:12.557 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-27T10:40:12.557 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-27T10:40:12.557 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/gameport.ko 2024-05-27T10:40:12.558 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/joydev.ko 2024-05-27T10:40:12.558 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard 2024-05-27T10:40:12.558 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-27T10:40:12.558 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse 2024-05-27T10:40:12.558 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/appletouch.ko 2024-05-27T10:40:12.558 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/bcm5974.ko 2024-05-27T10:40:12.558 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/cyapatp.ko 2024-05-27T10:40:12.558 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-27T10:40:12.558 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/sermouse.ko 2024-05-27T10:40:12.558 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-27T10:40:12.558 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-27T10:40:12.558 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-27T10:40:12.559 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4 2024-05-27T10:40:12.559 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-27T10:40:12.559 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio 2024-05-27T10:40:12.559 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/altera_ps2.ko 2024-05-27T10:40:12.559 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/arc_ps2.ko 2024-05-27T10:40:12.559 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-27T10:40:12.559 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serio_raw.ko 2024-05-27T10:40:12.559 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/sparse-keymap.ko 2024-05-27T10:40:12.559 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds 2024-05-27T10:40:12.559 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-blinkm.ko 2024-05-27T10:40:12.559 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3530.ko 2024-05-27T10:40:12.559 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp3944.ko 2024-05-27T10:40:12.559 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-ss4200.ko 2024-05-27T10:40:12.560 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger 2024-05-27T10:40:12.560 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-27T10:40:12.560 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-27T10:40:12.560 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-27T10:40:12.560 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-27T10:40:12.560 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-27T10:40:12.560 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-27T10:40:12.560 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-27T10:40:12.560 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-27T10:40:12.560 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-27T10:40:12.560 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md 2024-05-27T10:40:12.560 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache 2024-05-27T10:40:12.560 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/bcache.ko 2024-05-27T10:40:12.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bio-prison.ko 2024-05-27T10:40:12.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache-smq.ko 2024-05-27T10:40:12.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache.ko 2024-05-27T10:40:12.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-crypt.ko 2024-05-27T10:40:12.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-delay.ko 2024-05-27T10:40:12.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-flakey.ko 2024-05-27T10:40:12.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log-userspace.ko 2024-05-27T10:40:12.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-multipath.ko 2024-05-27T10:40:12.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-queue-length.ko 2024-05-27T10:40:12.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-raid.ko 2024-05-27T10:40:12.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-round-robin.ko 2024-05-27T10:40:12.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-service-time.ko 2024-05-27T10:40:12.561 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-switch.ko 2024-05-27T10:40:12.562 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-thin-pool.ko 2024-05-27T10:40:12.562 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-verity.ko 2024-05-27T10:40:12.562 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data 2024-05-27T10:40:12.562 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-27T10:40:12.562 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid0.ko 2024-05-27T10:40:12.562 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid1.ko 2024-05-27T10:40:12.562 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid10.ko 2024-05-27T10:40:12.562 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid456.ko 2024-05-27T10:40:12.562 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message 2024-05-27T10:40:12.562 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion 2024-05-27T10:40:12.562 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptbase.ko 2024-05-27T10:40:12.562 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptctl.ko 2024-05-27T10:40:12.563 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptfc.ko 2024-05-27T10:40:12.563 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptlan.ko 2024-05-27T10:40:12.563 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptsas.ko 2024-05-27T10:40:12.563 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptscsih.ko 2024-05-27T10:40:12.563 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptspi.ko 2024-05-27T10:40:12.563 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd 2024-05-27T10:40:12.563 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_ich.ko 2024-05-27T10:40:12.563 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_sch.ko 2024-05-27T10:40:12.563 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mfd-core.ko 2024-05-27T10:40:12.563 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/sm501.ko 2024-05-27T10:40:12.563 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/viperboard.ko 2024-05-27T10:40:12.563 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/vx855.ko 2024-05-27T10:40:12.564 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wl1273-core.ko 2024-05-27T10:40:12.564 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc 2024-05-27T10:40:12.564 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl 2024-05-27T10:40:12.564 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-27T10:40:12.564 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds9802als.ko 2024-05-27T10:40:12.564 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds990x.ko 2024-05-27T10:40:12.564 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/bh1770glc.ko 2024-05-27T10:40:12.564 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710 2024-05-27T10:40:12.564 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/cb710.ko 2024-05-27T10:40:12.564 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom 2024-05-27T10:40:12.564 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/at24.ko 2024-05-27T10:40:12.564 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-27T10:40:12.564 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/max6875.ko 2024-05-27T10:40:12.564 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/enclosure.ko 2024-05-27T10:40:12.564 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hpilo.ko 2024-05-27T10:40:12.565 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29003.ko 2024-05-27T10:40:12.565 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29020.ko 2024-05-27T10:40:12.565 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d 2024-05-27T10:40:12.565 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-27T10:40:12.565 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-27T10:40:12.565 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei 2024-05-27T10:40:12.565 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-me.ko 2024-05-27T10:40:12.565 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-txe.ko 2024-05-27T10:40:12.565 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei.ko 2024-05-27T10:40:12.565 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru 2024-05-27T10:40:12.565 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-27T10:40:12.566 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp 2024-05-27T10:40:12.566 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-27T10:40:12.566 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-27T10:40:12.566 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-27T10:40:12.566 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_7xx1.ko 2024-05-27T10:40:12.566 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_core.ko 2024-05-27T10:40:12.566 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tsl2550.ko 2024-05-27T10:40:12.566 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_balloon.ko 2024-05-27T10:40:12.566 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci 2024-05-27T10:40:12.566 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-27T10:40:12.566 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net 2024-05-27T10:40:12.566 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding 2024-05-27T10:40:12.566 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/bonding.ko 2024-05-27T10:40:12.566 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa 2024-05-27T10:40:12.567 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53 2024-05-27T10:40:12.567 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-27T10:40:12.567 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-27T10:40:12.567 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-27T10:40:12.567 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx 2024-05-27T10:40:12.567 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-27T10:40:12.567 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dummy.ko 2024-05-27T10:40:12.567 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/eql.ko 2024-05-27T10:40:12.567 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet 2024-05-27T10:40:12.567 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com 2024-05-27T10:40:12.567 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-27T10:40:12.567 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-27T10:40:12.567 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-27T10:40:12.568 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-27T10:40:12.568 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390 2024-05-27T10:40:12.568 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-27T10:40:12.568 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-27T10:40:12.568 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-27T10:40:12.568 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-27T10:40:12.568 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec 2024-05-27T10:40:12.568 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-27T10:40:12.568 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere 2024-05-27T10:40:12.568 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-27T10:40:12.568 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon 2024-05-27T10:40:12.568 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-27T10:40:12.568 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera 2024-05-27T10:40:12.569 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-27T10:40:12.569 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd 2024-05-27T10:40:12.569 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-27T10:40:12.569 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-27T10:40:12.569 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-27T10:40:12.569 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros 2024-05-27T10:40:12.569 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx 2024-05-27T10:40:12.569 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-27T10:40:12.569 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-27T10:40:12.569 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-27T10:40:12.569 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-27T10:40:12.569 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-27T10:40:12.569 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx 2024-05-27T10:40:12.570 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-27T10:40:12.570 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-27T10:40:12.570 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom 2024-05-27T10:40:12.570 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-27T10:40:12.570 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-27T10:40:12.570 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-27T10:40:12.570 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-27T10:40:12.570 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-27T10:40:12.570 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet 2024-05-27T10:40:12.570 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-27T10:40:12.570 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-27T10:40:12.570 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade 2024-05-27T10:40:12.570 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna 2024-05-27T10:40:12.571 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-27T10:40:12.571 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio 2024-05-27T10:40:12.571 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-27T10:40:12.571 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-27T10:40:12.571 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-27T10:40:12.571 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-27T10:40:12.571 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-27T10:40:12.571 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-27T10:40:12.571 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-27T10:40:12.571 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-27T10:40:12.571 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-27T10:40:12.571 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-27T10:40:12.571 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco 2024-05-27T10:40:12.572 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic 2024-05-27T10:40:12.572 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-27T10:40:12.572 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec 2024-05-27T10:40:12.572 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip 2024-05-27T10:40:12.572 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-27T10:40:12.572 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-27T10:40:12.572 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-27T10:40:12.572 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-27T10:40:12.572 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-27T10:40:12.572 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-27T10:40:12.572 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink 2024-05-27T10:40:12.572 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-27T10:40:12.572 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-27T10:40:12.573 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dnet.ko 2024-05-27T10:40:12.573 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex 2024-05-27T10:40:12.573 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet 2024-05-27T10:40:12.573 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-27T10:40:12.573 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ethoc.ko 2024-05-27T10:40:12.573 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fealnx.ko 2024-05-27T10:40:12.573 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel 2024-05-27T10:40:12.573 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-27T10:40:12.573 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000 2024-05-27T10:40:12.573 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-27T10:40:12.573 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e 2024-05-27T10:40:12.573 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-27T10:40:12.573 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k 2024-05-27T10:40:12.573 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-27T10:40:12.574 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e 2024-05-27T10:40:12.574 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-27T10:40:12.574 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf 2024-05-27T10:40:12.574 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-27T10:40:12.574 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb 2024-05-27T10:40:12.574 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-27T10:40:12.574 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf 2024-05-27T10:40:12.574 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-27T10:40:12.574 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-27T10:40:12.574 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-27T10:40:12.574 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-27T10:40:12.574 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-27T10:40:12.574 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/jme.ko 2024-05-27T10:40:12.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell 2024-05-27T10:40:12.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-27T10:40:12.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-27T10:40:12.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-27T10:40:12.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox 2024-05-27T10:40:12.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-27T10:40:12.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-27T10:40:12.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-27T10:40:12.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-27T10:40:12.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-27T10:40:12.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-27T10:40:12.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel 2024-05-27T10:40:12.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-27T10:40:12.575 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom 2024-05-27T10:40:12.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-27T10:40:12.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-27T10:40:12.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi 2024-05-27T10:40:12.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-27T10:40:12.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-27T10:40:12.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion 2024-05-27T10:40:12.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-27T10:40:12.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia 2024-05-27T10:40:12.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-27T10:40:12.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines 2024-05-27T10:40:12.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-27T10:40:12.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-27T10:40:12.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic 2024-05-27T10:40:12.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-27T10:40:12.576 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-27T10:40:12.577 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-27T10:40:12.577 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-27T10:40:12.577 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-27T10:40:12.577 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc 2024-05-27T10:40:12.577 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-27T10:40:12.577 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek 2024-05-27T10:40:12.577 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-27T10:40:12.577 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-27T10:40:12.577 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-27T10:40:12.577 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-27T10:40:12.577 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker 2024-05-27T10:40:12.577 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-27T10:40:12.577 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc 2024-05-27T10:40:12.578 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-27T10:40:12.578 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan 2024-05-27T10:40:12.578 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-27T10:40:12.578 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis 2024-05-27T10:40:12.578 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-27T10:40:12.578 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-27T10:40:12.578 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc 2024-05-27T10:40:12.578 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-27T10:40:12.578 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-27T10:40:12.578 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-27T10:40:12.578 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-27T10:40:12.578 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro 2024-05-27T10:40:12.578 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-27T10:40:12.579 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-27T10:40:12.579 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-27T10:40:12.579 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun 2024-05-27T10:40:12.579 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-27T10:40:12.579 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-27T10:40:12.579 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-27T10:40:12.579 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-27T10:40:12.579 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti 2024-05-27T10:40:12.579 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-27T10:40:12.579 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti 2024-05-27T10:40:12.579 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-27T10:40:12.579 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via 2024-05-27T10:40:12.579 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-27T10:40:12.580 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-27T10:40:12.580 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet 2024-05-27T10:40:12.580 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-27T10:40:12.580 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-27T10:40:12.580 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom 2024-05-27T10:40:12.580 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-27T10:40:12.580 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/geneve.ko 2024-05-27T10:40:12.580 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv 2024-05-27T10:40:12.580 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-27T10:40:12.580 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154 2024-05-27T10:40:12.580 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-27T10:40:12.580 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ifb.ko 2024-05-27T10:40:12.580 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan 2024-05-27T10:40:12.580 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-27T10:40:12.581 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvlan.ko 2024-05-27T10:40:12.581 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvtap.ko 2024-05-27T10:40:12.581 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio 2024-05-27T10:40:12.581 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio.ko 2024-05-27T10:40:12.581 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-27T10:40:12.581 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-27T10:40:12.581 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-27T10:40:12.581 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mii.ko 2024-05-27T10:40:12.581 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/net_failover.ko 2024-05-27T10:40:12.581 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/netconsole.ko 2024-05-27T10:40:12.581 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/nlmon.ko 2024-05-27T10:40:12.581 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs 2024-05-27T10:40:12.581 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-27T10:40:12.581 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-27T10:40:12.582 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy 2024-05-27T10:40:12.582 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/amd.ko 2024-05-27T10:40:12.582 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-27T10:40:12.582 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-27T10:40:12.582 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-27T10:40:12.582 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm87xx.ko 2024-05-27T10:40:12.582 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/broadcom.ko 2024-05-27T10:40:12.582 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/cicada.ko 2024-05-27T10:40:12.582 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/davicom.ko 2024-05-27T10:40:12.582 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/dp83640.ko 2024-05-27T10:40:12.582 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/et1011c.ko 2024-05-27T10:40:12.582 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/icplus.ko 2024-05-27T10:40:12.583 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/lxt.ko 2024-05-27T10:40:12.583 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/marvell.ko 2024-05-27T10:40:12.583 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/micrel.ko 2024-05-27T10:40:12.583 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/national.ko 2024-05-27T10:40:12.583 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/phylink.ko 2024-05-27T10:40:12.583 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/qsemi.ko 2024-05-27T10:40:12.583 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/realtek.ko 2024-05-27T10:40:12.583 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/smsc.ko 2024-05-27T10:40:12.583 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ste10Xp.ko 2024-05-27T10:40:12.583 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/vitesse.ko 2024-05-27T10:40:12.583 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp 2024-05-27T10:40:12.583 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-27T10:40:12.583 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_async.ko 2024-05-27T10:40:12.584 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-27T10:40:12.584 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-27T10:40:12.584 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-27T10:40:12.584 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-27T10:40:12.584 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppoe.ko 2024-05-27T10:40:12.584 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppox.ko 2024-05-27T10:40:12.584 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pptp.ko 2024-05-27T10:40:12.584 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip 2024-05-27T10:40:12.584 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slhc.ko 2024-05-27T10:40:12.584 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slip.ko 2024-05-27T10:40:12.584 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sungem_phy.ko 2024-05-27T10:40:12.584 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tap.ko 2024-05-27T10:40:12.584 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team 2024-05-27T10:40:12.585 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team.ko 2024-05-27T10:40:12.585 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-27T10:40:12.585 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-27T10:40:12.585 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-27T10:40:12.585 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_random.ko 2024-05-27T10:40:12.585 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-27T10:40:12.585 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tun.ko 2024-05-27T10:40:12.585 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/veth.ko 2024-05-27T10:40:12.585 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/virtio_net.ko 2024-05-27T10:40:12.585 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3 2024-05-27T10:40:12.585 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-27T10:40:12.585 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan 2024-05-27T10:40:12.585 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/vxlan.ko 2024-05-27T10:40:12.585 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback 2024-05-27T10:40:12.586 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-27T10:40:12.586 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netfront.ko 2024-05-27T10:40:12.586 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb 2024-05-27T10:40:12.586 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ntb.ko 2024-05-27T10:40:12.586 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme 2024-05-27T10:40:12.586 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host 2024-05-27T10:40:12.586 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme-core.ko 2024-05-27T10:40:12.586 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme.ko 2024-05-27T10:40:12.586 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport 2024-05-27T10:40:12.586 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport.ko 2024-05-27T10:40:12.586 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_cs.ko 2024-05-27T10:40:12.586 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_pc.ko 2024-05-27T10:40:12.586 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_serial.ko 2024-05-27T10:40:12.587 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci 2024-05-27T10:40:12.587 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug 2024-05-27T10:40:12.587 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-27T10:40:12.587 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie 2024-05-27T10:40:12.587 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-27T10:40:12.587 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/xen-pcifront.ko 2024-05-27T10:40:12.587 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia 2024-05-27T10:40:12.587 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/i82092.ko 2024-05-27T10:40:12.587 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pd6729.ko 2024-05-27T10:40:12.587 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-27T10:40:12.587 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl 2024-05-27T10:40:12.587 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel 2024-05-27T10:40:12.587 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-27T10:40:12.588 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform 2024-05-27T10:40:12.588 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86 2024-05-27T10:40:12.588 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-27T10:40:12.588 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acerhdf.ko 2024-05-27T10:40:12.588 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-27T10:40:12.588 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-27T10:40:12.588 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-27T10:40:12.588 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-27T10:40:12.588 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-27T10:40:12.588 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-27T10:40:12.588 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-27T10:40:12.588 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-27T10:40:12.588 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-27T10:40:12.588 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/hdaps.ko 2024-05-27T10:40:12.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel 2024-05-27T10:40:12.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-27T10:40:12.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel_ips.ko 2024-05-27T10:40:12.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-27T10:40:12.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-27T10:40:12.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-27T10:40:12.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-27T10:40:12.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-27T10:40:12.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-27T10:40:12.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-27T10:40:12.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-27T10:40:12.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-27T10:40:12.589 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi.ko 2024-05-27T10:40:12.590 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap 2024-05-27T10:40:12.590 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-27T10:40:12.590 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-27T10:40:12.590 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps 2024-05-27T10:40:12.590 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients 2024-05-27T10:40:12.590 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-27T10:40:12.590 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-27T10:40:12.590 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps_parport.ko 2024-05-27T10:40:12.590 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/pps_core.ko 2024-05-27T10:40:12.590 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp 2024-05-27T10:40:12.590 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp.ko 2024-05-27T10:40:12.590 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp_kvm.ko 2024-05-27T10:40:12.590 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras 2024-05-27T10:40:12.591 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd 2024-05-27T10:40:12.591 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl 2024-05-27T10:40:12.591 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-27T10:40:12.591 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/fmpm.ko 2024-05-27T10:40:12.591 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc 2024-05-27T10:40:12.591 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-27T10:40:12.591 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-27T10:40:12.591 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-27T10:40:12.591 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-27T10:40:12.591 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-27T10:40:12.591 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-27T10:40:12.591 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-27T10:40:12.591 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-27T10:40:12.592 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-27T10:40:12.592 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-27T10:40:12.592 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-em3027.ko 2024-05-27T10:40:12.592 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-27T10:40:12.592 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-27T10:40:12.592 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-27T10:40:12.592 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-27T10:40:12.592 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-27T10:40:12.592 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-27T10:40:12.592 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max6900.ko 2024-05-27T10:40:12.592 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-27T10:40:12.592 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-27T10:40:12.592 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-27T10:40:12.593 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-27T10:40:12.593 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-27T10:40:12.593 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-27T10:40:12.593 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-27T10:40:12.593 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-27T10:40:12.593 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-27T10:40:12.593 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-27T10:40:12.593 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-27T10:40:12.593 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-27T10:40:12.593 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-x1205.ko 2024-05-27T10:40:12.593 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi 2024-05-27T10:40:12.593 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-9xxx.ko 2024-05-27T10:40:12.593 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-sas.ko 2024-05-27T10:40:12.593 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-xxxx.ko 2024-05-27T10:40:12.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/BusLogic.ko 2024-05-27T10:40:12.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/a100u2w.ko 2024-05-27T10:40:12.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid 2024-05-27T10:40:12.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-27T10:40:12.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/advansys.ko 2024-05-27T10:40:12.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx 2024-05-27T10:40:12.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-27T10:40:12.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-27T10:40:12.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/am53c974.ko 2024-05-27T10:40:12.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr 2024-05-27T10:40:12.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-27T10:40:12.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/atp870u.ko 2024-05-27T10:40:12.594 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi 2024-05-27T10:40:12.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-27T10:40:12.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa 2024-05-27T10:40:12.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/bfa.ko 2024-05-27T10:40:12.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc 2024-05-27T10:40:12.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-27T10:40:12.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i 2024-05-27T10:40:12.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-27T10:40:12.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ch.ko 2024-05-27T10:40:12.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor 2024-05-27T10:40:12.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-27T10:40:12.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi 2024-05-27T10:40:12.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-27T10:40:12.595 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-27T10:40:12.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-27T10:40:12.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-27T10:40:12.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-27T10:40:12.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dc395x.ko 2024-05-27T10:40:12.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler 2024-05-27T10:40:12.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-27T10:40:12.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-27T10:40:12.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-27T10:40:12.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-27T10:40:12.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dmx3191d.ko 2024-05-27T10:40:12.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r 2024-05-27T10:40:12.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-27T10:40:12.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esp_scsi.ko 2024-05-27T10:40:12.596 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe 2024-05-27T10:40:12.597 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-27T10:40:12.597 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-27T10:40:12.597 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic 2024-05-27T10:40:12.597 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/fnic.ko 2024-05-27T10:40:12.597 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hpsa.ko 2024-05-27T10:40:12.597 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hptiop.ko 2024-05-27T10:40:12.597 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hv_storvsc.ko 2024-05-27T10:40:12.597 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/initio.ko 2024-05-27T10:40:12.597 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ipr.ko 2024-05-27T10:40:12.597 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ips.ko 2024-05-27T10:40:12.597 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci 2024-05-27T10:40:12.597 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/isci.ko 2024-05-27T10:40:12.597 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-27T10:40:12.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-27T10:40:12.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc 2024-05-27T10:40:12.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/libfc.ko 2024-05-27T10:40:12.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi.ko 2024-05-27T10:40:12.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-27T10:40:12.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas 2024-05-27T10:40:12.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/libsas.ko 2024-05-27T10:40:12.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc 2024-05-27T10:40:12.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-27T10:40:12.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid 2024-05-27T10:40:12.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid.ko 2024-05-27T10:40:12.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-27T10:40:12.598 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-27T10:40:12.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-27T10:40:12.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas 2024-05-27T10:40:12.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-27T10:40:12.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas 2024-05-27T10:40:12.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-27T10:40:12.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvumi.ko 2024-05-27T10:40:12.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001 2024-05-27T10:40:12.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-27T10:40:12.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pmcraid.ko 2024-05-27T10:40:12.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla1280.ko 2024-05-27T10:40:12.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx 2024-05-27T10:40:12.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-27T10:40:12.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-27T10:40:12.599 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx 2024-05-27T10:40:12.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-27T10:40:12.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/raid_class.ko 2024-05-27T10:40:12.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_debug.ko 2024-05-27T10:40:12.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-27T10:40:12.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-27T10:40:12.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-27T10:40:12.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-27T10:40:12.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-27T10:40:12.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ses.ko 2024-05-27T10:40:12.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/st.ko 2024-05-27T10:40:12.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/stex.ko 2024-05-27T10:40:12.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2 2024-05-27T10:40:12.600 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-27T10:40:12.601 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/virtio_scsi.ko 2024-05-27T10:40:12.601 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-27T10:40:12.601 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/wd719x.ko 2024-05-27T10:40:12.601 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb 2024-05-27T10:40:12.601 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ssb.ko 2024-05-27T10:40:12.601 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target 2024-05-27T10:40:12.601 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi 2024-05-27T10:40:12.601 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-27T10:40:12.601 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback 2024-05-27T10:40:12.601 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-27T10:40:12.601 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_file.ko 2024-05-27T10:40:12.601 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_iblock.ko 2024-05-27T10:40:12.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_mod.ko 2024-05-27T10:40:12.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_pscsi.ko 2024-05-27T10:40:12.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_user.ko 2024-05-27T10:40:12.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc 2024-05-27T10:40:12.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-27T10:40:12.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal 2024-05-27T10:40:12.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel 2024-05-27T10:40:12.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal 2024-05-27T10:40:12.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-27T10:40:12.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-27T10:40:12.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-27T10:40:12.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-27T10:40:12.602 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-27T10:40:12.603 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-27T10:40:12.603 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-27T10:40:12.603 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-27T10:40:12.603 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-27T10:40:12.603 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-27T10:40:12.603 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-27T10:40:12.603 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-27T10:40:12.603 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-27T10:40:12.603 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-27T10:40:12.603 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-27T10:40:12.603 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-27T10:40:12.603 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-27T10:40:12.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-27T10:40:12.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty 2024-05-27T10:40:12.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless 2024-05-27T10:40:12.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-27T10:40:12.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_gsm.ko 2024-05-27T10:40:12.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_hdlc.ko 2024-05-27T10:40:12.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/nozomi.ko 2024-05-27T10:40:12.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial 2024-05-27T10:40:12.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250 2024-05-27T10:40:12.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-27T10:40:12.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/arc_uart.ko 2024-05-27T10:40:12.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm 2024-05-27T10:40:12.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-27T10:40:12.604 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs 2024-05-27T10:40:12.605 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core 2024-05-27T10:40:12.605 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-27T10:40:12.605 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host 2024-05-27T10:40:12.605 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-27T10:40:12.605 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio 2024-05-27T10:40:12.605 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio.ko 2024-05-27T10:40:12.605 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_aec.ko 2024-05-27T10:40:12.605 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_cif.ko 2024-05-27T10:40:12.605 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pci_generic.ko 2024-05-27T10:40:12.605 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_sercos3.ko 2024-05-27T10:40:12.605 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb 2024-05-27T10:40:12.605 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class 2024-05-27T10:40:12.606 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-acm.ko 2024-05-27T10:40:12.606 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-27T10:40:12.606 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usblp.ko 2024-05-27T10:40:12.606 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usbtmc.ko 2024-05-27T10:40:12.606 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host 2024-05-27T10:40:12.606 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-27T10:40:12.606 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image 2024-05-27T10:40:12.606 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/mdc800.ko 2024-05-27T10:40:12.606 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/microtek.ko 2024-05-27T10:40:12.606 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc 2024-05-27T10:40:12.606 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/adutux.ko 2024-05-27T10:40:12.606 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/appledisplay.ko 2024-05-27T10:40:12.606 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi26.ko 2024-05-27T10:40:12.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi62.ko 2024-05-27T10:40:12.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ezusb.ko 2024-05-27T10:40:12.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/idmouse.ko 2024-05-27T10:40:12.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/iowarrior.ko 2024-05-27T10:40:12.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-27T10:40:12.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ldusb.ko 2024-05-27T10:40:12.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/legousbtower.ko 2024-05-27T10:40:12.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga 2024-05-27T10:40:12.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-27T10:40:12.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-27T10:40:12.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usb3503.ko 2024-05-27T10:40:12.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usblcd.ko 2024-05-27T10:40:12.607 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-27T10:40:12.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/uss720.ko 2024-05-27T10:40:12.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/yurex.ko 2024-05-27T10:40:12.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy 2024-05-27T10:40:12.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-generic.ko 2024-05-27T10:40:12.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial 2024-05-27T10:40:12.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/aircable.ko 2024-05-27T10:40:12.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ark3116.ko 2024-05-27T10:40:12.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-27T10:40:12.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ch341.ko 2024-05-27T10:40:12.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cp210x.ko 2024-05-27T10:40:12.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cyberjack.ko 2024-05-27T10:40:12.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-27T10:40:12.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-27T10:40:12.608 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/empeg.ko 2024-05-27T10:40:12.609 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-27T10:40:12.609 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-27T10:40:12.609 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-27T10:40:12.609 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_ti.ko 2024-05-27T10:40:12.609 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipaq.ko 2024-05-27T10:40:12.609 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipw.ko 2024-05-27T10:40:12.609 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ir-usb.ko 2024-05-27T10:40:12.609 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-27T10:40:12.609 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan.ko 2024-05-27T10:40:12.609 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-27T10:40:12.609 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-27T10:40:12.609 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-27T10:40:12.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mct_u232.ko 2024-05-27T10:40:12.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7720.ko 2024-05-27T10:40:12.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7840.ko 2024-05-27T10:40:12.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/navman.ko 2024-05-27T10:40:12.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/omninet.ko 2024-05-27T10:40:12.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/opticon.ko 2024-05-27T10:40:12.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/option.ko 2024-05-27T10:40:12.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/oti6858.ko 2024-05-27T10:40:12.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/pl2303.ko 2024-05-27T10:40:12.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcaux.ko 2024-05-27T10:40:12.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcserial.ko 2024-05-27T10:40:12.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/quatech2.ko 2024-05-27T10:40:12.610 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/safe_serial.ko 2024-05-27T10:40:12.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/sierra.ko 2024-05-27T10:40:12.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-27T10:40:12.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ssu100.ko 2024-05-27T10:40:12.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/symbolserial.ko 2024-05-27T10:40:12.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-27T10:40:12.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-27T10:40:12.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_debug.ko 2024-05-27T10:40:12.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-27T10:40:12.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/visor.ko 2024-05-27T10:40:12.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/whiteheat.ko 2024-05-27T10:40:12.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-27T10:40:12.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage 2024-05-27T10:40:12.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/uas.ko 2024-05-27T10:40:12.611 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-27T10:40:12.612 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-27T10:40:12.612 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-27T10:40:12.612 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-27T10:40:12.612 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-27T10:40:12.612 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-27T10:40:12.612 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-27T10:40:12.612 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-karma.ko 2024-05-27T10:40:12.612 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-27T10:40:12.612 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-27T10:40:12.612 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-27T10:40:12.612 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-27T10:40:12.612 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-27T10:40:12.612 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/usb-storage.ko 2024-05-27T10:40:12.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip 2024-05-27T10:40:12.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-27T10:40:12.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-27T10:40:12.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-27T10:40:12.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio 2024-05-27T10:40:12.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci 2024-05-27T10:40:12.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-27T10:40:12.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-27T10:40:12.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio.ko 2024-05-27T10:40:12.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-27T10:40:12.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost 2024-05-27T10:40:12.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost.ko 2024-05-27T10:40:12.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-27T10:40:12.613 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_net.ko 2024-05-27T10:40:12.614 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_scsi.ko 2024-05-27T10:40:12.614 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video 2024-05-27T10:40:12.614 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight 2024-05-27T10:40:12.614 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/apple_bl.ko 2024-05-27T10:40:12.614 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lcd.ko 2024-05-27T10:40:12.614 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-27T10:40:12.614 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio 2024-05-27T10:40:12.614 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio.ko 2024-05-27T10:40:12.614 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_balloon.ko 2024-05-27T10:40:12.614 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_mmio.ko 2024-05-27T10:40:12.614 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci.ko 2024-05-27T10:40:12.614 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-27T10:40:12.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-27T10:40:12.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_ring.ko 2024-05-27T10:40:12.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1 2024-05-27T10:40:12.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters 2024-05-27T10:40:12.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2482.ko 2024-05-27T10:40:12.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2490.ko 2024-05-27T10:40:12.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves 2024-05-27T10:40:12.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-27T10:40:12.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-27T10:40:12.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-27T10:40:12.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-27T10:40:12.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-27T10:40:12.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-27T10:40:12.615 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-27T10:40:12.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-27T10:40:12.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-27T10:40:12.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-27T10:40:12.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-27T10:40:12.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/wire.ko 2024-05-27T10:40:12.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog 2024-05-27T10:40:12.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-27T10:40:12.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-27T10:40:12.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-27T10:40:12.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/hpwdt.ko 2024-05-27T10:40:12.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/i6300esb.ko 2024-05-27T10:40:12.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-27T10:40:12.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-27T10:40:12.616 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ib700wdt.ko 2024-05-27T10:40:12.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ibmasr.ko 2024-05-27T10:40:12.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-27T10:40:12.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-27T10:40:12.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it87_wdt.ko 2024-05-27T10:40:12.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/machzwd.ko 2024-05-27T10:40:12.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/nv_tco.ko 2024-05-27T10:40:12.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-27T10:40:12.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-27T10:40:12.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-27T10:40:12.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-27T10:40:12.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/softdog.ko 2024-05-27T10:40:12.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-27T10:40:12.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/via_wdt.ko 2024-05-27T10:40:12.617 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-27T10:40:12.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-27T10:40:12.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-27T10:40:12.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wdt_pci.ko 2024-05-27T10:40:12.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/xen_wdt.ko 2024-05-27T10:40:12.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen 2024-05-27T10:40:12.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-27T10:40:12.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-evtchn.ko 2024-05-27T10:40:12.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntalloc.ko 2024-05-27T10:40:12.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntdev.ko 2024-05-27T10:40:12.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback 2024-05-27T10:40:12.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-27T10:40:12.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-privcmd.ko 2024-05-27T10:40:12.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs 2024-05-27T10:40:12.618 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-27T10:40:12.619 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs 2024-05-27T10:40:12.619 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p 2024-05-27T10:40:12.619 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/9p.ko 2024-05-27T10:40:12.619 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs 2024-05-27T10:40:12.619 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/affs.ko 2024-05-27T10:40:12.619 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs 2024-05-27T10:40:12.619 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/befs.ko 2024-05-27T10:40:12.619 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/binfmt_misc.ko 2024-05-27T10:40:12.619 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs 2024-05-27T10:40:12.619 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/btrfs.ko 2024-05-27T10:40:12.619 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles 2024-05-27T10:40:12.619 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/cachefiles.ko 2024-05-27T10:40:12.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph 2024-05-27T10:40:12.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ceph.ko 2024-05-27T10:40:12.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda 2024-05-27T10:40:12.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/coda.ko 2024-05-27T10:40:12.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs 2024-05-27T10:40:12.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/cramfs.ko 2024-05-27T10:40:12.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm 2024-05-27T10:40:12.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/dlm.ko 2024-05-27T10:40:12.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs 2024-05-27T10:40:12.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-27T10:40:12.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs 2024-05-27T10:40:12.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/f2fs.ko 2024-05-27T10:40:12.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat 2024-05-27T10:40:12.620 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/fat.ko 2024-05-27T10:40:12.621 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/msdos.ko 2024-05-27T10:40:12.621 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/vfat.ko 2024-05-27T10:40:12.621 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse 2024-05-27T10:40:12.621 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/cuse.ko 2024-05-27T10:40:12.621 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/fuse.ko 2024-05-27T10:40:12.621 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2 2024-05-27T10:40:12.621 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/gfs2.ko 2024-05-27T10:40:12.621 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs 2024-05-27T10:40:12.621 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/hfs.ko 2024-05-27T10:40:12.621 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus 2024-05-27T10:40:12.621 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/hfsplus.ko 2024-05-27T10:40:12.621 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs 2024-05-27T10:40:12.622 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/isofs.ko 2024-05-27T10:40:12.622 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs 2024-05-27T10:40:12.622 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/jfs.ko 2024-05-27T10:40:12.622 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd 2024-05-27T10:40:12.622 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/lockd.ko 2024-05-27T10:40:12.622 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix 2024-05-27T10:40:12.622 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/minix.ko 2024-05-27T10:40:12.622 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs 2024-05-27T10:40:12.622 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/netfs.ko 2024-05-27T10:40:12.622 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs 2024-05-27T10:40:12.622 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout 2024-05-27T10:40:12.622 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-27T10:40:12.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout 2024-05-27T10:40:12.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-27T10:40:12.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout 2024-05-27T10:40:12.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-27T10:40:12.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfs.ko 2024-05-27T10:40:12.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv3.ko 2024-05-27T10:40:12.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv4.ko 2024-05-27T10:40:12.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common 2024-05-27T10:40:12.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/grace.ko 2024-05-27T10:40:12.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/nfs_acl.ko 2024-05-27T10:40:12.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd 2024-05-27T10:40:12.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/nfsd.ko 2024-05-27T10:40:12.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2 2024-05-27T10:40:12.623 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/nilfs2.ko 2024-05-27T10:40:12.624 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls 2024-05-27T10:40:12.624 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-celtic.ko 2024-05-27T10:40:12.624 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-centeuro.ko 2024-05-27T10:40:12.624 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-croatian.ko 2024-05-27T10:40:12.624 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-cyrillic.ko 2024-05-27T10:40:12.624 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-gaelic.ko 2024-05-27T10:40:12.624 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-greek.ko 2024-05-27T10:40:12.624 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-iceland.ko 2024-05-27T10:40:12.624 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-inuit.ko 2024-05-27T10:40:12.624 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-roman.ko 2024-05-27T10:40:12.624 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-romanian.ko 2024-05-27T10:40:12.624 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-turkish.ko 2024-05-27T10:40:12.624 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1250.ko 2024-05-27T10:40:12.625 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1251.ko 2024-05-27T10:40:12.625 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1255.ko 2024-05-27T10:40:12.625 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp737.ko 2024-05-27T10:40:12.625 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp775.ko 2024-05-27T10:40:12.625 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp850.ko 2024-05-27T10:40:12.625 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp852.ko 2024-05-27T10:40:12.625 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp855.ko 2024-05-27T10:40:12.625 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp857.ko 2024-05-27T10:40:12.625 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp860.ko 2024-05-27T10:40:12.625 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp861.ko 2024-05-27T10:40:12.625 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp862.ko 2024-05-27T10:40:12.625 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp863.ko 2024-05-27T10:40:12.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp864.ko 2024-05-27T10:40:12.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp865.ko 2024-05-27T10:40:12.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp866.ko 2024-05-27T10:40:12.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp869.ko 2024-05-27T10:40:12.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp874.ko 2024-05-27T10:40:12.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp932.ko 2024-05-27T10:40:12.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp936.ko 2024-05-27T10:40:12.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp949.ko 2024-05-27T10:40:12.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp950.ko 2024-05-27T10:40:12.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_euc-jp.ko 2024-05-27T10:40:12.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-1.ko 2024-05-27T10:40:12.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-13.ko 2024-05-27T10:40:12.626 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-14.ko 2024-05-27T10:40:12.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-15.ko 2024-05-27T10:40:12.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-2.ko 2024-05-27T10:40:12.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-3.ko 2024-05-27T10:40:12.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-4.ko 2024-05-27T10:40:12.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-5.ko 2024-05-27T10:40:12.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-6.ko 2024-05-27T10:40:12.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-7.ko 2024-05-27T10:40:12.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-9.ko 2024-05-27T10:40:12.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-r.ko 2024-05-27T10:40:12.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-ru.ko 2024-05-27T10:40:12.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-u.ko 2024-05-27T10:40:12.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-27T10:40:12.627 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_utf8.ko 2024-05-27T10:40:12.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2 2024-05-27T10:40:12.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster 2024-05-27T10:40:12.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-27T10:40:12.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm 2024-05-27T10:40:12.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-27T10:40:12.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs 2024-05-27T10:40:12.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-27T10:40:12.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2.ko 2024-05-27T10:40:12.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-27T10:40:12.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-27T10:40:12.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-27T10:40:12.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs 2024-05-27T10:40:12.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/overlay.ko 2024-05-27T10:40:12.628 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore 2024-05-27T10:40:12.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ramoops.ko 2024-05-27T10:40:12.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs 2024-05-27T10:40:12.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/reiserfs.ko 2024-05-27T10:40:12.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs 2024-05-27T10:40:12.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/romfs.ko 2024-05-27T10:40:12.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb 2024-05-27T10:40:12.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client 2024-05-27T10:40:12.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/cifs.ko 2024-05-27T10:40:12.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common 2024-05-27T10:40:12.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_arc4.ko 2024-05-27T10:40:12.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_md4.ko 2024-05-27T10:40:12.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs 2024-05-27T10:40:12.629 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/squashfs.ko 2024-05-27T10:40:12.630 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv 2024-05-27T10:40:12.630 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/sysv.ko 2024-05-27T10:40:12.630 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf 2024-05-27T10:40:12.630 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/udf.ko 2024-05-27T10:40:12.630 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs 2024-05-27T10:40:12.630 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ufs.ko 2024-05-27T10:40:12.630 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs 2024-05-27T10:40:12.630 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/xfs.ko 2024-05-27T10:40:12.630 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel 2024-05-27T10:40:12.630 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu 2024-05-27T10:40:12.630 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu/rcutorture.ko 2024-05-27T10:40:12.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/torture.ko 2024-05-27T10:40:12.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace 2024-05-27T10:40:12.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-27T10:40:12.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib 2024-05-27T10:40:12.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/asn1_encoder.ko 2024-05-27T10:40:12.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc-itu-t.ko 2024-05-27T10:40:12.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc8.ko 2024-05-27T10:40:12.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto 2024-05-27T10:40:12.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libarc4.ko 2024-05-27T10:40:12.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libdes.ko 2024-05-27T10:40:12.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/libcrc32c.ko 2024-05-27T10:40:12.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lru_cache.ko 2024-05-27T10:40:12.631 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4 2024-05-27T10:40:12.632 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4_compress.ko 2024-05-27T10:40:12.632 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4hc_compress.ko 2024-05-27T10:40:12.632 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math 2024-05-27T10:40:12.632 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/cordic.ko 2024-05-27T10:40:12.632 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6 2024-05-27T10:40:12.632 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/raid6_pq.ko 2024-05-27T10:40:12.632 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon 2024-05-27T10:40:12.632 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-27T10:40:12.632 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_bm.ko 2024-05-27T10:40:12.632 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_fsm.ko 2024-05-27T10:40:12.632 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_kmp.ko 2024-05-27T10:40:12.632 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd 2024-05-27T10:40:12.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd/zstd_compress.ko 2024-05-27T10:40:12.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm 2024-05-27T10:40:12.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm/hwpoison-inject.ko 2024-05-27T10:40:12.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net 2024-05-27T10:40:12.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan 2024-05-27T10:40:12.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/6lowpan.ko 2024-05-27T10:40:12.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_dest.ko 2024-05-27T10:40:12.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_fragment.ko 2024-05-27T10:40:12.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_hop.ko 2024-05-27T10:40:12.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-27T10:40:12.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_mobility.ko 2024-05-27T10:40:12.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_routing.ko 2024-05-27T10:40:12.633 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_udp.ko 2024-05-27T10:40:12.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802 2024-05-27T10:40:12.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/garp.ko 2024-05-27T10:40:12.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/mrp.ko 2024-05-27T10:40:12.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/p8022.ko 2024-05-27T10:40:12.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/psnap.ko 2024-05-27T10:40:12.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/stp.ko 2024-05-27T10:40:12.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q 2024-05-27T10:40:12.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/8021q.ko 2024-05-27T10:40:12.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p 2024-05-27T10:40:12.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet.ko 2024-05-27T10:40:12.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_fd.ko 2024-05-27T10:40:12.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_rdma.ko 2024-05-27T10:40:12.634 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_virtio.ko 2024-05-27T10:40:12.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv 2024-05-27T10:40:12.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/batman-adv.ko 2024-05-27T10:40:12.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge 2024-05-27T10:40:12.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/br_netfilter.ko 2024-05-27T10:40:12.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/bridge.ko 2024-05-27T10:40:12.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter 2024-05-27T10:40:12.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-27T10:40:12.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-27T10:40:12.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-27T10:40:12.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-27T10:40:12.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-27T10:40:12.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-27T10:40:12.635 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-27T10:40:12.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-27T10:40:12.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-27T10:40:12.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-27T10:40:12.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-27T10:40:12.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-27T10:40:12.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-27T10:40:12.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-27T10:40:12.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-27T10:40:12.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-27T10:40:12.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-27T10:40:12.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-27T10:40:12.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-27T10:40:12.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-27T10:40:12.636 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtables.ko 2024-05-27T10:40:12.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-27T10:40:12.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-27T10:40:12.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-27T10:40:12.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph 2024-05-27T10:40:12.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/libceph.ko 2024-05-27T10:40:12.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core 2024-05-27T10:40:12.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/failover.ko 2024-05-27T10:40:12.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/pktgen.ko 2024-05-27T10:40:12.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp 2024-05-27T10:40:12.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp.ko 2024-05-27T10:40:12.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_diag.ko 2024-05-27T10:40:12.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv4.ko 2024-05-27T10:40:12.637 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv6.ko 2024-05-27T10:40:12.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver 2024-05-27T10:40:12.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver/dns_resolver.ko 2024-05-27T10:40:12.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa 2024-05-27T10:40:12.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/dsa_core.ko 2024-05-27T10:40:12.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_brcm.ko 2024-05-27T10:40:12.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_dsa.ko 2024-05-27T10:40:12.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_none.ko 2024-05-27T10:40:12.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_trailer.ko 2024-05-27T10:40:12.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154 2024-05-27T10:40:12.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan 2024-05-27T10:40:12.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-27T10:40:12.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154.ko 2024-05-27T10:40:12.638 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-27T10:40:12.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4 2024-05-27T10:40:12.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ah4.ko 2024-05-27T10:40:12.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/esp4.ko 2024-05-27T10:40:12.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/fou.ko 2024-05-27T10:40:12.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/gre.ko 2024-05-27T10:40:12.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/inet_diag.ko 2024-05-27T10:40:12.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_gre.ko 2024-05-27T10:40:12.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_tunnel.ko 2024-05-27T10:40:12.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_vti.ko 2024-05-27T10:40:12.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipcomp.ko 2024-05-27T10:40:12.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipip.ko 2024-05-27T10:40:12.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter 2024-05-27T10:40:12.639 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-27T10:40:12.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-27T10:40:12.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-27T10:40:12.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-27T10:40:12.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-27T10:40:12.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-27T10:40:12.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-27T10:40:12.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-27T10:40:12.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-27T10:40:12.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-27T10:40:12.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-27T10:40:12.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-27T10:40:12.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-27T10:40:12.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-27T10:40:12.640 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-27T10:40:12.641 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-27T10:40:12.641 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-27T10:40:12.641 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-27T10:40:12.641 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-27T10:40:12.641 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-27T10:40:12.641 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-27T10:40:12.641 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_bic.ko 2024-05-27T10:40:12.641 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_dctcp.ko 2024-05-27T10:40:12.641 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_diag.ko 2024-05-27T10:40:12.641 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_highspeed.ko 2024-05-27T10:40:12.641 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_htcp.ko 2024-05-27T10:40:12.641 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_hybla.ko 2024-05-27T10:40:12.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_illinois.ko 2024-05-27T10:40:12.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_lp.ko 2024-05-27T10:40:12.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_scalable.ko 2024-05-27T10:40:12.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_vegas.ko 2024-05-27T10:40:12.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_veno.ko 2024-05-27T10:40:12.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_westwood.ko 2024-05-27T10:40:12.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_yeah.ko 2024-05-27T10:40:12.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tunnel4.ko 2024-05-27T10:40:12.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_diag.ko 2024-05-27T10:40:12.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_tunnel.ko 2024-05-27T10:40:12.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-27T10:40:12.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6 2024-05-27T10:40:12.642 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ah6.ko 2024-05-27T10:40:12.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/esp6.ko 2024-05-27T10:40:12.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/fou6.ko 2024-05-27T10:40:12.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_tunnel.ko 2024-05-27T10:40:12.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-27T10:40:12.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_vti.ko 2024-05-27T10:40:12.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ipcomp6.ko 2024-05-27T10:40:12.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter 2024-05-27T10:40:12.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-27T10:40:12.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-27T10:40:12.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-27T10:40:12.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-27T10:40:12.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-27T10:40:12.643 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-27T10:40:12.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-27T10:40:12.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-27T10:40:12.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-27T10:40:12.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-27T10:40:12.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-27T10:40:12.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-27T10:40:12.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-27T10:40:12.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-27T10:40:12.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-27T10:40:12.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-27T10:40:12.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-27T10:40:12.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-27T10:40:12.644 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-27T10:40:12.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-27T10:40:12.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-27T10:40:12.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-27T10:40:12.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-27T10:40:12.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-27T10:40:12.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/sit.ko 2024-05-27T10:40:12.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/tunnel6.ko 2024-05-27T10:40:12.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-27T10:40:12.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key 2024-05-27T10:40:12.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key/af_key.ko 2024-05-27T10:40:12.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp 2024-05-27T10:40:12.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_core.ko 2024-05-27T10:40:12.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-27T10:40:12.645 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_eth.ko 2024-05-27T10:40:12.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip.ko 2024-05-27T10:40:12.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip6.ko 2024-05-27T10:40:12.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_netlink.ko 2024-05-27T10:40:12.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ppp.ko 2024-05-27T10:40:12.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc 2024-05-27T10:40:12.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc.ko 2024-05-27T10:40:12.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154 2024-05-27T10:40:12.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/mac802154.ko 2024-05-27T10:40:12.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls 2024-05-27T10:40:12.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/mpls_gso.ko 2024-05-27T10:40:12.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter 2024-05-27T10:40:12.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset 2024-05-27T10:40:12.646 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set.ko 2024-05-27T10:40:12.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-27T10:40:12.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-27T10:40:12.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-27T10:40:12.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-27T10:40:12.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-27T10:40:12.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-27T10:40:12.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-27T10:40:12.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-27T10:40:12.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-27T10:40:12.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-27T10:40:12.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-27T10:40:12.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-27T10:40:12.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-27T10:40:12.647 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-27T10:40:12.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-27T10:40:12.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs 2024-05-27T10:40:12.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-27T10:40:12.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-27T10:40:12.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-27T10:40:12.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-27T10:40:12.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-27T10:40:12.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-27T10:40:12.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-27T10:40:12.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-27T10:40:12.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-27T10:40:12.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-27T10:40:12.648 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-27T10:40:12.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-27T10:40:12.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-27T10:40:12.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-27T10:40:12.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conncount.ko 2024-05-27T10:40:12.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack.ko 2024-05-27T10:40:12.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-27T10:40:12.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-27T10:40:12.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-27T10:40:12.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-27T10:40:12.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-27T10:40:12.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-27T10:40:12.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-27T10:40:12.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-27T10:40:12.649 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-27T10:40:12.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-27T10:40:12.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-27T10:40:12.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-27T10:40:12.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-27T10:40:12.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table.ko 2024-05-27T10:40:12.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-27T10:40:12.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_log_syslog.ko 2024-05-27T10:40:12.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat.ko 2024-05-27T10:40:12.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-27T10:40:12.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-27T10:40:12.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_irc.ko 2024-05-27T10:40:12.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_sip.ko 2024-05-27T10:40:12.650 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-27T10:40:12.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-27T10:40:12.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_tables.ko 2024-05-27T10:40:12.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink.ko 2024-05-27T10:40:12.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-27T10:40:12.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_log.ko 2024-05-27T10:40:12.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-27T10:40:12.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-27T10:40:12.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_chain_nat.ko 2024-05-27T10:40:12.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_compat.ko 2024-05-27T10:40:12.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_ct.ko 2024-05-27T10:40:12.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-27T10:40:12.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fib.ko 2024-05-27T10:40:12.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-27T10:40:12.651 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_hash.ko 2024-05-27T10:40:12.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_limit.ko 2024-05-27T10:40:12.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_log.ko 2024-05-27T10:40:12.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_masq.ko 2024-05-27T10:40:12.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_nat.ko 2024-05-27T10:40:12.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_numgen.ko 2024-05-27T10:40:12.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_queue.ko 2024-05-27T10:40:12.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_quota.ko 2024-05-27T10:40:12.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_redir.ko 2024-05-27T10:40:12.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject.ko 2024-05-27T10:40:12.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject_inet.ko 2024-05-27T10:40:12.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_socket.ko 2024-05-27T10:40:12.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_tunnel.ko 2024-05-27T10:40:12.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_AUDIT.ko 2024-05-27T10:40:12.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-27T10:40:12.652 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-27T10:40:12.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-27T10:40:12.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CT.ko 2024-05-27T10:40:12.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_DSCP.ko 2024-05-27T10:40:12.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HL.ko 2024-05-27T10:40:12.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HMARK.ko 2024-05-27T10:40:12.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-27T10:40:12.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LED.ko 2024-05-27T10:40:12.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LOG.ko 2024-05-27T10:40:12.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-27T10:40:12.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NETMAP.ko 2024-05-27T10:40:12.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFLOG.ko 2024-05-27T10:40:12.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-27T10:40:12.653 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_RATEEST.ko 2024-05-27T10:40:12.654 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-27T10:40:12.654 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_SECMARK.ko 2024-05-27T10:40:12.654 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-27T10:40:12.654 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-27T10:40:12.654 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TEE.ko 2024-05-27T10:40:12.654 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TPROXY.ko 2024-05-27T10:40:12.654 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TRACE.ko 2024-05-27T10:40:12.654 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_addrtype.ko 2024-05-27T10:40:12.654 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_bpf.ko 2024-05-27T10:40:12.654 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cgroup.ko 2024-05-27T10:40:12.654 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cluster.ko 2024-05-27T10:40:12.654 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_comment.ko 2024-05-27T10:40:12.654 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connbytes.ko 2024-05-27T10:40:12.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlabel.ko 2024-05-27T10:40:12.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlimit.ko 2024-05-27T10:40:12.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connmark.ko 2024-05-27T10:40:12.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_conntrack.ko 2024-05-27T10:40:12.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cpu.ko 2024-05-27T10:40:12.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dccp.ko 2024-05-27T10:40:12.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_devgroup.ko 2024-05-27T10:40:12.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dscp.ko 2024-05-27T10:40:12.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ecn.ko 2024-05-27T10:40:12.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_esp.ko 2024-05-27T10:40:12.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hashlimit.ko 2024-05-27T10:40:12.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_helper.ko 2024-05-27T10:40:12.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hl.ko 2024-05-27T10:40:12.655 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipcomp.ko 2024-05-27T10:40:12.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_iprange.ko 2024-05-27T10:40:12.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipvs.ko 2024-05-27T10:40:12.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_l2tp.ko 2024-05-27T10:40:12.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_length.ko 2024-05-27T10:40:12.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_limit.ko 2024-05-27T10:40:12.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mac.ko 2024-05-27T10:40:12.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mark.ko 2024-05-27T10:40:12.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_multiport.ko 2024-05-27T10:40:12.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nat.ko 2024-05-27T10:40:12.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nfacct.ko 2024-05-27T10:40:12.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_osf.ko 2024-05-27T10:40:12.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_owner.ko 2024-05-27T10:40:12.656 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_physdev.ko 2024-05-27T10:40:12.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_pkttype.ko 2024-05-27T10:40:12.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_policy.ko 2024-05-27T10:40:12.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_quota.ko 2024-05-27T10:40:12.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_rateest.ko 2024-05-27T10:40:12.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_realm.ko 2024-05-27T10:40:12.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_recent.ko 2024-05-27T10:40:12.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_sctp.ko 2024-05-27T10:40:12.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_set.ko 2024-05-27T10:40:12.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_socket.ko 2024-05-27T10:40:12.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_state.ko 2024-05-27T10:40:12.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_statistic.ko 2024-05-27T10:40:12.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_string.ko 2024-05-27T10:40:12.657 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpmss.ko 2024-05-27T10:40:12.658 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_time.ko 2024-05-27T10:40:12.658 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_u32.ko 2024-05-27T10:40:12.658 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink 2024-05-27T10:40:12.658 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/netlink_diag.ko 2024-05-27T10:40:12.658 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh 2024-05-27T10:40:12.658 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/nsh.ko 2024-05-27T10:40:12.658 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch 2024-05-27T10:40:12.658 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/openvswitch.ko 2024-05-27T10:40:12.658 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-geneve.ko 2024-05-27T10:40:12.658 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-gre.ko 2024-05-27T10:40:12.658 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-vxlan.ko 2024-05-27T10:40:12.658 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet 2024-05-27T10:40:12.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/af_packet_diag.ko 2024-05-27T10:40:12.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds 2024-05-27T10:40:12.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds.ko 2024-05-27T10:40:12.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_rdma.ko 2024-05-27T10:40:12.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_tcp.ko 2024-05-27T10:40:12.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched 2024-05-27T10:40:12.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_csum.ko 2024-05-27T10:40:12.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_gact.ko 2024-05-27T10:40:12.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_mirred.ko 2024-05-27T10:40:12.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_nat.ko 2024-05-27T10:40:12.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_pedit.ko 2024-05-27T10:40:12.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_police.ko 2024-05-27T10:40:12.659 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_simple.ko 2024-05-27T10:40:12.660 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_skbedit.ko 2024-05-27T10:40:12.660 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_vlan.ko 2024-05-27T10:40:12.660 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_basic.ko 2024-05-27T10:40:12.660 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_bpf.ko 2024-05-27T10:40:12.660 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_flow.ko 2024-05-27T10:40:12.660 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_fw.ko 2024-05-27T10:40:12.660 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_route.ko 2024-05-27T10:40:12.660 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_u32.ko 2024-05-27T10:40:12.660 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_cmp.ko 2024-05-27T10:40:12.660 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_ipset.ko 2024-05-27T10:40:12.660 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_meta.ko 2024-05-27T10:40:12.660 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_nbyte.ko 2024-05-27T10:40:12.660 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_text.ko 2024-05-27T10:40:12.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_u32.ko 2024-05-27T10:40:12.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_choke.ko 2024-05-27T10:40:12.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_codel.ko 2024-05-27T10:40:12.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_drr.ko 2024-05-27T10:40:12.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq.ko 2024-05-27T10:40:12.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_gred.ko 2024-05-27T10:40:12.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hfsc.ko 2024-05-27T10:40:12.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hhf.ko 2024-05-27T10:40:12.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_htb.ko 2024-05-27T10:40:12.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_ingress.ko 2024-05-27T10:40:12.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio.ko 2024-05-27T10:40:12.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio_lib.ko 2024-05-27T10:40:12.661 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_multiq.ko 2024-05-27T10:40:12.662 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_netem.ko 2024-05-27T10:40:12.662 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_pie.ko 2024-05-27T10:40:12.662 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_plug.ko 2024-05-27T10:40:12.662 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_prio.ko 2024-05-27T10:40:12.662 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_qfq.ko 2024-05-27T10:40:12.662 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_red.ko 2024-05-27T10:40:12.662 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfb.ko 2024-05-27T10:40:12.662 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfq.ko 2024-05-27T10:40:12.662 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_tbf.ko 2024-05-27T10:40:12.662 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_teql.ko 2024-05-27T10:40:12.662 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp 2024-05-27T10:40:12.662 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp.ko 2024-05-27T10:40:12.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp_diag.ko 2024-05-27T10:40:12.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc 2024-05-27T10:40:12.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss 2024-05-27T10:40:12.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-27T10:40:12.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-27T10:40:12.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/sunrpc.ko 2024-05-27T10:40:12.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma 2024-05-27T10:40:12.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-27T10:40:12.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc 2024-05-27T10:40:12.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc.ko 2024-05-27T10:40:12.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc_diag.ko 2024-05-27T10:40:12.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix 2024-05-27T10:40:12.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/unix_diag.ko 2024-05-27T10:40:12.663 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock 2024-05-27T10:40:12.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-27T10:40:12.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-27T10:40:12.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock.ko 2024-05-27T10:40:12.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-27T10:40:12.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-27T10:40:12.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm 2024-05-27T10:40:12.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-27T10:40:12.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security 2024-05-27T10:40:12.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys 2024-05-27T10:40:12.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys 2024-05-27T10:40:12.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-27T10:40:12.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys 2024-05-27T10:40:12.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys/trusted.ko 2024-05-27T10:40:12.664 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias 2024-05-27T10:40:12.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias.bin 2024-05-27T10:40:12.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin 2024-05-27T10:40:12.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.alias.bin 2024-05-27T10:40:12.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.bin 2024-05-27T10:40:12.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.modinfo 2024-05-27T10:40:12.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep 2024-05-27T10:40:12.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep.bin 2024-05-27T10:40:12.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.devname 2024-05-27T10:40:12.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.order 2024-05-27T10:40:12.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.softdep 2024-05-27T10:40:12.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols 2024-05-27T10:40:12.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols.bin 2024-05-27T10:40:12.665 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-05-27T10:40:12.669 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gb9459a26b088 2024-05-27T10:40:12.669 DEBUG:teuthology.orchestra.run.smithi053:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-27T10:40:12.695 INFO:teuthology.orchestra.run.smithi053.stdout:postinstall scriptlet (using /bin/sh): 2024-05-27T10:40:12.695 INFO:teuthology.orchestra.run.smithi053.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-27T10:40:12.695 INFO:teuthology.orchestra.run.smithi053.stdout: /usr/bin/kernel-install add 6.9.0-gb9459a26b088 /lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-05-27T10:40:12.695 INFO:teuthology.orchestra.run.smithi053.stdout:fi 2024-05-27T10:40:12.696 INFO:teuthology.orchestra.run.smithi053.stdout:for file in vmlinuz System.map config; do 2024-05-27T10:40:12.696 INFO:teuthology.orchestra.run.smithi053.stdout: if ! cmp --silent "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088"; then 2024-05-27T10:40:12.696 INFO:teuthology.orchestra.run.smithi053.stdout: cp "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088" 2024-05-27T10:40:12.696 INFO:teuthology.orchestra.run.smithi053.stdout: fi 2024-05-27T10:40:12.696 INFO:teuthology.orchestra.run.smithi053.stdout:done 2024-05-27T10:40:12.696 INFO:teuthology.orchestra.run.smithi053.stdout:if [ -d "/lib/modules/6.9.0-gb9459a26b088/dtb" ] && \ 2024-05-27T10:40:12.696 INFO:teuthology.orchestra.run.smithi053.stdout: ! diff -rq "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" >/dev/null 2>&1; then 2024-05-27T10:40:12.696 INFO:teuthology.orchestra.run.smithi053.stdout: rm -rf "/boot/dtb-6.9.0-gb9459a26b088" 2024-05-27T10:40:12.696 INFO:teuthology.orchestra.run.smithi053.stdout: cp -r "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" 2024-05-27T10:40:12.696 INFO:teuthology.orchestra.run.smithi053.stdout:fi 2024-05-27T10:40:12.696 INFO:teuthology.orchestra.run.smithi053.stdout:if [ ! -e "/lib/modules/6.9.0-gb9459a26b088/modules.dep" ]; then 2024-05-27T10:40:12.696 INFO:teuthology.orchestra.run.smithi053.stdout: /usr/sbin/depmod 6.9.0-gb9459a26b088 2024-05-27T10:40:12.696 INFO:teuthology.orchestra.run.smithi053.stdout:fi 2024-05-27T10:40:12.697 INFO:teuthology.orchestra.run.smithi053.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-27T10:40:12.697 INFO:teuthology.orchestra.run.smithi053.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-27T10:40:12.697 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-install remove 6.9.0-gb9459a26b088 2024-05-27T10:40:12.697 INFO:teuthology.orchestra.run.smithi053.stdout:fi 2024-05-27T10:40:12.698 DEBUG:teuthology.orchestra.run.smithi053:> sudo rpm -qi grub2-tools 2024-05-27T10:40:12.775 INFO:teuthology.orchestra.run.smithi053.stdout:Name : grub2-tools 2024-05-27T10:40:12.775 INFO:teuthology.orchestra.run.smithi053.stdout:Epoch : 1 2024-05-27T10:40:12.775 INFO:teuthology.orchestra.run.smithi053.stdout:Version : 2.06 2024-05-27T10:40:12.775 INFO:teuthology.orchestra.run.smithi053.stdout:Release : 68.el9 2024-05-27T10:40:12.775 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: x86_64 2024-05-27T10:40:12.775 INFO:teuthology.orchestra.run.smithi053.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-27T10:40:12.775 INFO:teuthology.orchestra.run.smithi053.stdout:Group : Unspecified 2024-05-27T10:40:12.776 INFO:teuthology.orchestra.run.smithi053.stdout:Size : 8264254 2024-05-27T10:40:12.776 INFO:teuthology.orchestra.run.smithi053.stdout:License : GPLv3+ 2024-05-27T10:40:12.776 INFO:teuthology.orchestra.run.smithi053.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-27T10:40:12.776 INFO:teuthology.orchestra.run.smithi053.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-27T10:40:12.776 INFO:teuthology.orchestra.run.smithi053.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-27T10:40:12.776 INFO:teuthology.orchestra.run.smithi053.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-27T10:40:12.776 INFO:teuthology.orchestra.run.smithi053.stdout:Packager : builder@centos.org 2024-05-27T10:40:12.776 INFO:teuthology.orchestra.run.smithi053.stdout:Vendor : CentOS 2024-05-27T10:40:12.776 INFO:teuthology.orchestra.run.smithi053.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-27T10:40:12.776 INFO:teuthology.orchestra.run.smithi053.stdout:Summary : Support tools for GRUB. 2024-05-27T10:40:12.776 INFO:teuthology.orchestra.run.smithi053.stdout:Description : 2024-05-27T10:40:12.776 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:40:12.776 INFO:teuthology.orchestra.run.smithi053.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-27T10:40:12.776 INFO:teuthology.orchestra.run.smithi053.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-27T10:40:12.777 INFO:teuthology.orchestra.run.smithi053.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-27T10:40:12.777 INFO:teuthology.orchestra.run.smithi053.stdout:hardware devices. 2024-05-27T10:40:12.777 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:40:12.777 INFO:teuthology.orchestra.run.smithi053.stdout:This subpackage provides tools for support of all platforms. 2024-05-27T10:40:12.778 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-27T10:40:12.778 INFO:teuthology.task.kernel:Updating grub on smithi053 to boot 6.9.0-gb9459a26b088 2024-05-27T10:40:12.778 DEBUG:teuthology.orchestra.run.smithi053:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-27T10:40:13.371 INFO:teuthology.orchestra.run.smithi053.stderr:Generating grub configuration file ... 2024-05-27T10:40:14.841 INFO:teuthology.orchestra.run.smithi053.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-27T10:40:14.877 INFO:teuthology.orchestra.run.smithi053.stderr:done 2024-05-27T10:40:14.879 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-05-27T10:40:14.908 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.pZESFNbCKO 2024-05-27T10:40:14.909 DEBUG:teuthology.orchestra.run.smithi053:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pZESFNbCKO 2024-05-27T10:40:14.979 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.pZESFNbCKO 2024-05-27T10:40:15.120 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.pZESFNbCKO is 6KB 2024-05-27T10:40:15.169 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.pZESFNbCKO 2024-05-27T10:40:15.184 DEBUG:teuthology.orchestra.run.smithi053:> sudo /bin/ls /boot/loader/entries || true 2024-05-27T10:40:15.246 INFO:teuthology.orchestra.run.smithi053.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-27T10:40:15.246 INFO:teuthology.orchestra.run.smithi053.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-27T10:40:15.247 INFO:teuthology.orchestra.run.smithi053.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-27T10:40:15.247 INFO:teuthology.orchestra.run.smithi053.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088.conf 2024-05-27T10:40:15.248 DEBUG:teuthology.orchestra.run.smithi053:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088 2024-05-27T10:40:15.421 DEBUG:teuthology.orchestra.run.smithi053:> sudo shutdown -r now 2024-05-27T10:40:29.986 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-27T10:40:29.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-27T10:40:29.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T10:40:45.438 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-27T10:40:45.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-05-27T10:40:45.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T10:40:48.414 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-05-27T10:40:57.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-27T10:40:57.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T10:41:03.774 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-05-27T10:41:12.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-05-27T10:41:12.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T10:41:31.166 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-05-27T10:41:43.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-05-27T10:41:43.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T10:41:44.913 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-05-27T10:41:45.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-05-27T10:41:45.637 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-gb9459a26b088"... 2024-05-27T10:41:45.638 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-05-27T10:41:45.683 INFO:teuthology.orchestra.run.smithi053.stdout:6.9.0-gb9459a26b088 2024-05-27T10:41:45.683 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gb9459a26b088 vs 6.9.0-gb9459a26b088 2024-05-27T10:41:45.683 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-27T10:41:45.683 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-27T10:41:46.685 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-27T10:41:46.685 DEBUG:teuthology.orchestra.run.smithi053:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-27T10:41:46.833 INFO:teuthology.orchestra.run.smithi053.stdout:ttyS1 2024-05-27T10:41:46.927 DEBUG:teuthology.parallel:result is None 2024-05-27T10:41:57.426 DEBUG:teuthology.orchestra.remote:timed out 2024-05-27T10:42:09.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-27T10:42:09.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T10:42:09.862 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-05-27T10:42:10.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-27T10:42:10.471 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-gb9459a26b088"... 2024-05-27T10:42:10.472 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-05-27T10:42:10.528 INFO:teuthology.orchestra.run.smithi047.stdout:6.9.0-gb9459a26b088 2024-05-27T10:42:10.528 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gb9459a26b088 vs 6.9.0-gb9459a26b088 2024-05-27T10:42:10.528 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-27T10:42:10.528 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-27T10:42:11.529 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-27T10:42:11.529 DEBUG:teuthology.orchestra.run.smithi047:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-27T10:42:11.663 INFO:teuthology.orchestra.run.smithi047.stdout:ttyS1 2024-05-27T10:42:11.724 DEBUG:teuthology.parallel:result is None 2024-05-27T10:42:11.725 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-27T10:42:11.731 INFO:teuthology.task.internal:Creating test directory... 2024-05-27T10:42:11.731 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-27T10:42:11.738 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-27T10:42:11.800 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-27T10:42:11.806 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-27T10:42:11.831 INFO:teuthology.task.internal:Creating archive directory... 2024-05-27T10:42:11.831 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-27T10:42:11.838 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-27T10:42:11.912 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-27T10:42:11.918 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-27T10:42:11.918 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-27T10:42:11.926 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-27T10:42:12.019 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-27T10:42:12.024 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-27T10:42:12.053 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-27T10:42:12.056 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-27T10:42:12.061 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-27T10:42:12.067 INFO:teuthology.task.internal:Configuring sudo... 2024-05-27T10:42:12.067 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-27T10:42:12.074 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-27T10:42:12.161 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-27T10:42:12.462 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-27T10:42:12.463 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-27T10:42:12.470 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-27T10:42:12.530 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-27T10:42:12.622 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-27T10:42:12.717 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-27T10:42:12.798 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-27T10:42:12.890 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:42:12.890 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-27T10:42:12.981 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-27T10:42:13.074 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-27T10:42:13.173 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-27T10:42:13.262 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-27T10:42:13.352 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:42:13.352 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-27T10:42:13.439 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-05-27T10:42:13.447 DEBUG:teuthology.orchestra.run.smithi053:> sudo service rsyslog restart 2024-05-27T10:42:13.559 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-27T10:42:13.601 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-27T10:42:14.119 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-27T10:42:14.128 INFO:teuthology.task.internal:Starting timer... 2024-05-27T10:42:14.128 INFO:teuthology.run_tasks:Running task pcp... 2024-05-27T10:42:14.172 INFO:teuthology.run_tasks:Running task selinux... 2024-05-27T10:42:14.208 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-27T10:42:14.208 DEBUG:teuthology.orchestra.run.smithi047:> sudo service auditd rotate 2024-05-27T10:42:14.331 INFO:teuthology.orchestra.run.smithi047.stdout:Rotating logs: 2024-05-27T10:42:14.335 DEBUG:teuthology.orchestra.run.smithi053:> sudo service auditd rotate 2024-05-27T10:42:14.468 INFO:teuthology.orchestra.run.smithi053.stdout:Rotating logs: 2024-05-27T10:42:14.473 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-27T10:42:14.473 DEBUG:teuthology.orchestra.run.smithi047:> /usr/sbin/getenforce 2024-05-27T10:42:14.530 INFO:teuthology.orchestra.run.smithi047.stdout:Permissive 2024-05-27T10:42:14.530 DEBUG:teuthology.orchestra.run.smithi053:> /usr/sbin/getenforce 2024-05-27T10:42:14.587 INFO:teuthology.orchestra.run.smithi053.stdout:Permissive 2024-05-27T10:42:14.587 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi047.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi053.front.sepia.ceph.com': 'permissive'} 2024-05-27T10:42:14.587 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-27T10:42:14.663 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T10:42:14.664 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-27T10:42:14.749 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T10:42:14.750 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-27T10:42:14.750 DEBUG:teuthology.orchestra.run.smithi047:> sudo /usr/sbin/setenforce permissive 2024-05-27T10:42:14.821 DEBUG:teuthology.orchestra.run.smithi053:> sudo /usr/sbin/setenforce permissive 2024-05-27T10:42:14.904 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-27T10:42:14.913 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-27T10:42:14.927 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-27T10:42:14.928 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi047.front.sepia.ceph.com,smithi053.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-27T10:48:41.893 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi047.front.sepia.ceph.com'), Remote(name='ubuntu@smithi053.front.sepia.ceph.com')] 2024-05-27T10:48:41.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-27T10:48:41.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T10:48:42.012 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-05-27T10:48:42.168 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-27T10:48:42.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-05-27T10:48:42.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T10:48:42.282 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-05-27T10:48:42.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-05-27T10:48:42.455 INFO:teuthology.run_tasks:Running task clock... 2024-05-27T10:48:42.465 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-27T10:48:42.466 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-27T10:48:42.466 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-27T10:48:42.474 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-27T10:48:42.474 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-27T10:48:42.566 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-27T10:48:42.573 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-27T10:48:42.615 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-27T10:48:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-27T10:48:42.694 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: ntpd: command not found 2024-05-27T10:48:42.695 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: ntpd: command not found 2024-05-27T10:48:42.728 INFO:teuthology.orchestra.run.smithi047.stdout:506 Cannot talk to daemon 2024-05-27T10:48:42.729 INFO:teuthology.orchestra.run.smithi053.stdout:506 Cannot talk to daemon 2024-05-27T10:48:42.772 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-27T10:48:42.772 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-27T10:48:42.816 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-27T10:48:42.817 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-27T10:48:42.954 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-05-27T10:48:42.957 INFO:teuthology.orchestra.run.smithi053.stderr:bash: line 1: ntpq: command not found 2024-05-27T10:48:42.963 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-27T10:48:42.963 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-05-27T10:48:42.964 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T10:48:42.964 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T10:48:42.964 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T10:48:42.964 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T10:48:42.968 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-27T10:48:42.968 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2024-05-27T10:48:42.968 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T10:48:42.968 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T10:48:42.968 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T10:48:42.968 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T10:48:42.969 INFO:teuthology.run_tasks:Running task install... 2024-05-27T10:48:42.977 DEBUG:teuthology.task.install:project ceph 2024-05-27T10:48:42.978 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '81797d879079e1a392b37a9c23a946594f658c50'}} 2024-05-27T10:48:42.978 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '81797d879079e1a392b37a9c23a946594f658c50'} 2024-05-27T10:48:42.978 INFO:teuthology.task.install:Using flavor: default 2024-05-27T10:48:43.029 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-27T10:48:43.029 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-27T10:48:43.029 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81797d879079e1a392b37a9c23a946594f658c50', 'tag': None, 'wait_for_package': False} 2024-05-27T10:48:43.030 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=81797d879079e1a392b37a9c23a946594f658c50 2024-05-27T10:48:43.037 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81797d879079e1a392b37a9c23a946594f658c50', 'tag': None, 'wait_for_package': False} 2024-05-27T10:48:43.037 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=81797d879079e1a392b37a9c23a946594f658c50 2024-05-27T10:48:43.253 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-clone-stats/81797d879079e1a392b37a9c23a946594f658c50/centos/9/flavors/default/ 2024-05-27T10:48:43.253 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3154.g81797d87 2024-05-27T10:48:43.272 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-clone-stats/81797d879079e1a392b37a9c23a946594f658c50/centos/9/flavors/default/ 2024-05-27T10:48:43.272 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3154.g81797d87 2024-05-27T10:48:43.428 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-clone-stats/81797d879079e1a392b37a9c23a946594f658c50/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-clone-stats/81797d879079e1a392b37a9c23a946594f658c50/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-clone-stats/81797d879079e1a392b37a9c23a946594f658c50/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-27T10:48:43.428 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:48:43.428 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-27T10:48:43.444 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-clone-stats/81797d879079e1a392b37a9c23a946594f658c50/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-clone-stats/81797d879079e1a392b37a9c23a946594f658c50/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-clone-stats/81797d879079e1a392b37a9c23a946594f658c50/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-27T10:48:43.444 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:48:43.444 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-27T10:48:43.526 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-27T10:48:43.526 DEBUG:teuthology.orchestra.run.smithi047:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81797d879079e1a392b37a9c23a946594f658c50/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-27T10:48:43.538 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-27T10:48:43.538 DEBUG:teuthology.orchestra.run.smithi053:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81797d879079e1a392b37a9c23a946594f658c50/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-27T10:48:43.661 DEBUG:teuthology.orchestra.run.smithi047:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-27T10:48:43.675 DEBUG:teuthology.orchestra.run.smithi053:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-27T10:48:43.781 DEBUG:teuthology.orchestra.run.smithi047:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-27T10:48:43.793 DEBUG:teuthology.orchestra.run.smithi053:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-27T10:48:43.867 INFO:teuthology.orchestra.run.smithi047.stdout:check_obsoletes = 1 2024-05-27T10:48:43.872 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum clean all 2024-05-27T10:48:43.877 INFO:teuthology.orchestra.run.smithi053.stdout:check_obsoletes = 1 2024-05-27T10:48:43.882 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum clean all 2024-05-27T10:48:44.200 INFO:teuthology.orchestra.run.smithi047.stdout:45 files removed 2024-05-27T10:48:44.217 INFO:teuthology.orchestra.run.smithi053.stdout:45 files removed 2024-05-27T10:48:44.240 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-27T10:48:44.259 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-27T10:48:45.241 INFO:teuthology.orchestra.run.smithi047.stdout:ceph packages for x86_64 154 kB/s | 83 kB 00:00 2024-05-27T10:48:45.293 INFO:teuthology.orchestra.run.smithi053.stdout:ceph packages for x86_64 143 kB/s | 83 kB 00:00 2024-05-27T10:48:45.741 INFO:teuthology.orchestra.run.smithi047.stdout:ceph noarch packages 29 kB/s | 12 kB 00:00 2024-05-27T10:48:45.861 INFO:teuthology.orchestra.run.smithi053.stdout:ceph noarch packages 25 kB/s | 12 kB 00:00 2024-05-27T10:48:46.258 INFO:teuthology.orchestra.run.smithi047.stdout:ceph source packages 4.4 kB/s | 1.9 kB 00:00 2024-05-27T10:48:46.436 INFO:teuthology.orchestra.run.smithi053.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2024-05-27T10:48:47.068 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.1 MB 00:00 2024-05-27T10:48:48.082 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.1 MB 00:01 2024-05-27T10:48:50.275 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-05-27T10:48:57.575 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 1.9 MB/s | 6.2 MB 00:03 2024-05-27T10:48:59.492 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 17 kB 00:00 2024-05-27T10:49:01.140 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-05-27T10:49:04.243 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:15 2024-05-27T10:49:07.477 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-05-27T10:49:09.793 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.2 MB 00:01 2024-05-27T10:49:10.026 INFO:teuthology.orchestra.run.smithi047.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-27T10:49:10.027 INFO:teuthology.orchestra.run.smithi047.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-27T10:49:10.048 INFO:teuthology.orchestra.run.smithi047.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-27T10:49:10.049 INFO:teuthology.orchestra.run.smithi047.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-27T10:49:10.051 INFO:teuthology.orchestra.run.smithi047.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-27T10:49:10.052 INFO:teuthology.orchestra.run.smithi047.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-27T10:49:10.055 INFO:teuthology.orchestra.run.smithi047.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-27T10:49:10.058 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-27T10:49:10.059 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-27T10:49:10.138 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-05-27T10:49:10.163 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-05-27T10:49:10.163 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-05-27T10:49:10.164 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-05-27T10:49:10.164 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-05-27T10:49:10.164 INFO:teuthology.orchestra.run.smithi047.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-27T10:49:10.164 INFO:teuthology.orchestra.run.smithi047.stdout: ceph x86_64 2:19.0.0-3154.g81797d87.el9 ceph 6.6 k 2024-05-27T10:49:10.164 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base x86_64 2:19.0.0-3154.g81797d87.el9 ceph 5.4 M 2024-05-27T10:49:10.164 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse x86_64 2:19.0.0-3154.g81797d87.el9 ceph 890 k 2024-05-27T10:49:10.164 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3154.g81797d87.el9 ceph 145 k 2024-05-27T10:49:10.164 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr x86_64 2:19.0.0-3154.g81797d87.el9 ceph 1.5 M 2024-05-27T10:49:10.164 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 142 k 2024-05-27T10:49:10.164 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 3.5 M 2024-05-27T10:49:10.164 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 7.4 M 2024-05-27T10:49:10.164 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 49 k 2024-05-27T10:49:10.165 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw x86_64 2:19.0.0-3154.g81797d87.el9 ceph 11 M 2024-05-27T10:49:10.165 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test x86_64 2:19.0.0-3154.g81797d87.el9 ceph 49 M 2024-05-27T10:49:10.165 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 273 k 2024-05-27T10:49:10.165 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 763 k 2024-05-27T10:49:10.165 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror x86_64 2:19.0.0-3154.g81797d87.el9 ceph 224 k 2024-05-27T10:49:10.165 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-shell x86_64 2:19.0.0-3154.g81797d87.el9 ceph 27 k 2024-05-27T10:49:10.165 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 18 k 2024-05-27T10:49:10.165 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-05-27T10:49:10.165 INFO:teuthology.orchestra.run.smithi047.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-27T10:49:10.165 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-27T10:49:10.165 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel x86_64 2:19.0.0-3154.g81797d87.el9 ceph 32 k 2024-05-27T10:49:10.166 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2 x86_64 2:19.0.0-3154.g81797d87.el9 ceph 747 k 2024-05-27T10:49:10.166 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel x86_64 2:19.0.0-3154.g81797d87.el9 ceph 127 k 2024-05-27T10:49:10.166 INFO:teuthology.orchestra.run.smithi047.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-27T10:49:10.166 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-27T10:49:10.166 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-27T10:49:10.166 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-27T10:49:10.166 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-27T10:49:10.166 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-27T10:49:10.166 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs x86_64 2:19.0.0-3154.g81797d87.el9 ceph 161 k 2024-05-27T10:49:10.166 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados x86_64 2:19.0.0-3154.g81797d87.el9 ceph 321 k 2024-05-27T10:49:10.166 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd x86_64 2:19.0.0-3154.g81797d87.el9 ceph 298 k 2024-05-27T10:49:10.166 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw x86_64 2:19.0.0-3154.g81797d87.el9 ceph 99 k 2024-05-27T10:49:10.167 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse x86_64 2:19.0.0-3154.g81797d87.el9 ceph 85 k 2024-05-27T10:49:10.167 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror x86_64 2:19.0.0-3154.g81797d87.el9 ceph 3.1 M 2024-05-27T10:49:10.167 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd x86_64 2:19.0.0-3154.g81797d87.el9 ceph 170 k 2024-05-27T10:49:10.167 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-27T10:49:10.167 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrading: 2024-05-27T10:49:10.167 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-27T10:49:10.167 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-27T10:49:10.167 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-27T10:49:10.167 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-27T10:49:10.167 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-05-27T10:49:10.167 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-05-27T10:49:10.167 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-05-27T10:49:10.168 INFO:teuthology.orchestra.run.smithi047.stdout: librados2 x86_64 2:19.0.0-3154.g81797d87.el9 ceph 3.4 M 2024-05-27T10:49:10.168 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1 x86_64 2:19.0.0-3154.g81797d87.el9 ceph 3.1 M 2024-05-27T10:49:10.168 INFO:teuthology.orchestra.run.smithi047.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-27T10:49:10.168 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-27T10:49:10.168 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-05-27T10:49:10.168 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-27T10:49:10.168 INFO:teuthology.orchestra.run.smithi047.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-27T10:49:10.168 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-27T10:49:10.168 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common x86_64 2:19.0.0-3154.g81797d87.el9 ceph 21 M 2024-05-27T10:49:10.168 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 34 k 2024-05-27T10:49:10.168 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds x86_64 2:19.0.0-3154.g81797d87.el9 ceph 2.4 M 2024-05-27T10:49:10.168 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 252 k 2024-05-27T10:49:10.169 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon x86_64 2:19.0.0-3154.g81797d87.el9 ceph 4.7 M 2024-05-27T10:49:10.169 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd x86_64 2:19.0.0-3154.g81797d87.el9 ceph 17 M 2024-05-27T10:49:10.169 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 16 k 2024-05-27T10:49:10.169 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux x86_64 2:19.0.0-3154.g81797d87.el9 ceph 25 k 2024-05-27T10:49:10.169 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-27T10:49:10.169 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-27T10:49:10.169 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-27T10:49:10.169 INFO:teuthology.orchestra.run.smithi047.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-27T10:49:10.169 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-27T10:49:10.169 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-27T10:49:10.169 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-27T10:49:10.169 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-27T10:49:10.169 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite x86_64 2:19.0.0-3154.g81797d87.el9 ceph 163 k 2024-05-27T10:49:10.170 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-27T10:49:10.170 INFO:teuthology.orchestra.run.smithi047.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-27T10:49:10.170 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-27T10:49:10.170 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-27T10:49:10.170 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-27T10:49:10.170 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 x86_64 2:19.0.0-3154.g81797d87.el9 ceph 501 k 2024-05-27T10:49:10.170 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-27T10:49:10.170 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2 x86_64 2:19.0.0-3154.g81797d87.el9 ceph 5.4 M 2024-05-27T10:49:10.170 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-27T10:49:10.170 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-27T10:49:10.170 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-27T10:49:10.170 INFO:teuthology.orchestra.run.smithi047.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-27T10:49:10.170 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-27T10:49:10.171 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-27T10:49:10.171 INFO:teuthology.orchestra.run.smithi047.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-27T10:49:10.171 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-27T10:49:10.171 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-27T10:49:10.171 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-27T10:49:10.171 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-27T10:49:10.171 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-27T10:49:10.171 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-27T10:49:10.171 INFO:teuthology.orchestra.run.smithi047.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-27T10:49:10.171 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-27T10:49:10.171 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-27T10:49:10.171 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-27T10:49:10.171 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse x86_64 2:19.0.0-3154.g81797d87.el9 ceph 45 k 2024-05-27T10:49:10.172 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common x86_64 2:19.0.0-3154.g81797d87.el9 ceph 135 k 2024-05-27T10:49:10.172 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-27T10:49:10.172 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-27T10:49:10.172 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-27T10:49:10.172 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-27T10:49:10.172 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-27T10:49:10.172 INFO:teuthology.orchestra.run.smithi047.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-05-27T10:49:10.172 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-27T10:49:10.172 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-27T10:49:10.172 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-27T10:49:10.172 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-27T10:49:10.172 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-27T10:49:10.172 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-27T10:49:10.173 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-27T10:49:10.173 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-27T10:49:10.173 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-27T10:49:10.173 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-27T10:49:10.173 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-05-27T10:49:10.173 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-27T10:49:10.173 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-27T10:49:10.173 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-27T10:49:10.173 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-27T10:49:10.173 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-27T10:49:10.173 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-27T10:49:10.173 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-27T10:49:10.173 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-27T10:49:10.173 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-27T10:49:10.174 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-27T10:49:10.174 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-27T10:49:10.174 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-27T10:49:10.174 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-27T10:49:10.174 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-27T10:49:10.174 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-27T10:49:10.174 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-27T10:49:10.174 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-27T10:49:10.174 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-27T10:49:10.174 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-27T10:49:10.174 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-27T10:49:10.174 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-27T10:49:10.174 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-27T10:49:10.174 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-27T10:49:10.175 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-27T10:49:10.175 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-27T10:49:10.175 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-27T10:49:10.175 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-27T10:49:10.175 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-27T10:49:10.175 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-27T10:49:10.175 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-27T10:49:10.175 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-27T10:49:10.175 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-27T10:49:10.175 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-27T10:49:10.175 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-27T10:49:10.175 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-27T10:49:10.175 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-27T10:49:10.176 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-27T10:49:10.176 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-27T10:49:10.176 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-27T10:49:10.176 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-27T10:49:10.176 INFO:teuthology.orchestra.run.smithi047.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-27T10:49:10.176 INFO:teuthology.orchestra.run.smithi047.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-27T10:49:10.176 INFO:teuthology.orchestra.run.smithi047.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-27T10:49:10.176 INFO:teuthology.orchestra.run.smithi047.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-27T10:49:10.176 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-27T10:49:10.176 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-27T10:49:10.176 INFO:teuthology.orchestra.run.smithi047.stdout:Installing weak dependencies: 2024-05-27T10:49:10.176 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-27T10:49:10.176 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:49:10.176 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-05-27T10:49:10.177 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-05-27T10:49:10.177 INFO:teuthology.orchestra.run.smithi047.stdout:Install 148 Packages 2024-05-27T10:49:10.177 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrade 11 Packages 2024-05-27T10:49:10.177 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:49:10.177 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 226 M 2024-05-27T10:49:10.177 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-05-27T10:49:11.188 INFO:teuthology.orchestra.run.smithi047.stdout:(1/159): ceph-19.0.0-3154.g81797d87.el9.x86_64. 26 kB/s | 6.6 kB 00:00 2024-05-27T10:49:11.396 INFO:teuthology.orchestra.run.smithi047.stdout:(2/159): ceph-fuse-19.0.0-3154.g81797d87.el9.x8 4.2 MB/s | 890 kB 00:00 2024-05-27T10:49:11.455 INFO:teuthology.orchestra.run.smithi047.stdout:(3/159): ceph-immutable-object-cache-19.0.0-315 2.5 MB/s | 145 kB 00:00 2024-05-27T10:49:11.527 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 17 kB 00:00 2024-05-27T10:49:11.755 INFO:teuthology.orchestra.run.smithi047.stdout:(4/159): ceph-mds-19.0.0-3154.g81797d87.el9.x86 7.9 MB/s | 2.4 MB 00:00 2024-05-27T10:49:11.972 INFO:teuthology.orchestra.run.smithi047.stdout:(5/159): ceph-base-19.0.0-3154.g81797d87.el9.x8 5.2 MB/s | 5.4 MB 00:01 2024-05-27T10:49:12.030 INFO:teuthology.orchestra.run.smithi047.stdout:(6/159): ceph-mgr-19.0.0-3154.g81797d87.el9.x86 5.5 MB/s | 1.5 MB 00:00 2024-05-27T10:49:12.597 INFO:teuthology.orchestra.run.smithi047.stdout:(7/159): ceph-mon-19.0.0-3154.g81797d87.el9.x86 7.5 MB/s | 4.7 MB 00:00 2024-05-27T10:49:13.706 INFO:teuthology.orchestra.run.smithi047.stdout:(8/159): ceph-osd-19.0.0-3154.g81797d87.el9.x86 10 MB/s | 17 MB 00:01 2024-05-27T10:49:13.780 INFO:teuthology.orchestra.run.smithi047.stdout:(9/159): ceph-selinux-19.0.0-3154.g81797d87.el9 346 kB/s | 25 kB 00:00 2024-05-27T10:49:14.057 INFO:teuthology.orchestra.run.smithi047.stdout:(10/159): ceph-common-19.0.0-3154.g81797d87.el9 6.8 MB/s | 21 MB 00:03 2024-05-27T10:49:14.232 INFO:teuthology.orchestra.run.smithi047.stdout:(11/159): ceph-radosgw-19.0.0-3154.g81797d87.el 6.5 MB/s | 11 MB 00:01 2024-05-27T10:49:14.265 INFO:teuthology.orchestra.run.smithi047.stdout:(12/159): cephfs-mirror-19.0.0-3154.g81797d87.e 1.1 MB/s | 224 kB 00:00 2024-05-27T10:49:14.299 INFO:teuthology.orchestra.run.smithi047.stdout:(13/159): cephfs-shell-19.0.0-3154.g81797d87.el 411 kB/s | 27 kB 00:00 2024-05-27T10:49:14.333 INFO:teuthology.orchestra.run.smithi047.stdout:(14/159): libcephfs-devel-19.0.0-3154.g81797d87 480 kB/s | 32 kB 00:00 2024-05-27T10:49:14.408 INFO:teuthology.orchestra.run.smithi047.stdout:(15/159): libcephsqlite-19.0.0-3154.g81797d87.e 2.1 MB/s | 163 kB 00:00 2024-05-27T10:49:14.458 INFO:teuthology.orchestra.run.smithi047.stdout:(16/159): libcephfs2-19.0.0-3154.g81797d87.el9. 4.6 MB/s | 747 kB 00:00 2024-05-27T10:49:14.492 INFO:teuthology.orchestra.run.smithi047.stdout:(17/159): librados-devel-19.0.0-3154.g81797d87. 1.5 MB/s | 127 kB 00:00 2024-05-27T10:49:14.559 INFO:teuthology.orchestra.run.smithi047.stdout:(18/159): libradosstriper1-19.0.0-3154.g81797d8 4.9 MB/s | 501 kB 00:00 2024-05-27T10:49:14.650 INFO:teuthology.orchestra.run.smithi047.stdout:(19/159): python3-ceph-argparse-19.0.0-3154.g81 498 kB/s | 45 kB 00:00 2024-05-27T10:49:14.759 INFO:teuthology.orchestra.run.smithi047.stdout:(20/159): python3-ceph-common-19.0.0-3154.g8179 1.2 MB/s | 135 kB 00:00 2024-05-27T10:49:14.851 INFO:teuthology.orchestra.run.smithi047.stdout:(21/159): python3-cephfs-19.0.0-3154.g81797d87. 1.7 MB/s | 161 kB 00:00 2024-05-27T10:49:14.952 INFO:teuthology.orchestra.run.smithi047.stdout:(22/159): python3-rados-19.0.0-3154.g81797d87.e 3.2 MB/s | 321 kB 00:00 2024-05-27T10:49:15.077 INFO:teuthology.orchestra.run.smithi047.stdout:(23/159): librgw2-19.0.0-3154.g81797d87.el9.x86 9.2 MB/s | 5.4 MB 00:00 2024-05-27T10:49:15.110 INFO:teuthology.orchestra.run.smithi047.stdout:(24/159): python3-rbd-19.0.0-3154.g81797d87.el9 1.9 MB/s | 298 kB 00:00 2024-05-27T10:49:15.161 INFO:teuthology.orchestra.run.smithi047.stdout:(25/159): python3-rgw-19.0.0-3154.g81797d87.el9 1.2 MB/s | 99 kB 00:00 2024-05-27T10:49:15.195 INFO:teuthology.orchestra.run.smithi047.stdout:(26/159): rbd-fuse-19.0.0-3154.g81797d87.el9.x8 1.0 MB/s | 85 kB 00:00 2024-05-27T10:49:15.295 INFO:teuthology.orchestra.run.smithi047.stdout:(27/159): rbd-nbd-19.0.0-3154.g81797d87.el9.x86 1.7 MB/s | 170 kB 00:00 2024-05-27T10:49:15.322 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 5.9 MB/s | 21 MB 00:03 2024-05-27T10:49:15.387 INFO:teuthology.orchestra.run.smithi047.stdout:(28/159): ceph-grafana-dashboards-19.0.0-3154.g 379 kB/s | 34 kB 00:00 2024-05-27T10:49:15.529 INFO:teuthology.orchestra.run.smithi047.stdout:(29/159): rbd-mirror-19.0.0-3154.g81797d87.el9. 8.4 MB/s | 3.1 MB 00:00 2024-05-27T10:49:15.562 INFO:teuthology.orchestra.run.smithi047.stdout:(30/159): ceph-mgr-cephadm-19.0.0-3154.g81797d8 816 kB/s | 142 kB 00:00 2024-05-27T10:49:16.021 INFO:teuthology.orchestra.run.smithi047.stdout:(31/159): ceph-mgr-dashboard-19.0.0-3154.g81797 7.2 MB/s | 3.5 MB 00:00 2024-05-27T10:49:16.121 INFO:teuthology.orchestra.run.smithi047.stdout:(32/159): ceph-mgr-modules-core-19.0.0-3154.g81 2.5 MB/s | 252 kB 00:00 2024-05-27T10:49:16.213 INFO:teuthology.orchestra.run.smithi047.stdout:(33/159): ceph-mgr-rook-19.0.0-3154.g81797d87.e 543 kB/s | 49 kB 00:00 2024-05-27T10:49:16.314 INFO:teuthology.orchestra.run.smithi047.stdout:(34/159): ceph-prometheus-alerts-19.0.0-3154.g8 166 kB/s | 16 kB 00:00 2024-05-27T10:49:16.447 INFO:teuthology.orchestra.run.smithi047.stdout:(35/159): ceph-mgr-diskprediction-local-19.0.0- 8.3 MB/s | 7.4 MB 00:00 2024-05-27T10:49:16.489 INFO:teuthology.orchestra.run.smithi047.stdout:(36/159): ceph-volume-19.0.0-3154.g81797d87.el9 1.5 MB/s | 273 kB 00:00 2024-05-27T10:49:16.556 INFO:teuthology.orchestra.run.smithi047.stdout:(37/159): cephadm-19.0.0-3154.g81797d87.el9.noa 6.9 MB/s | 763 kB 00:00 2024-05-27T10:49:16.581 INFO:teuthology.orchestra.run.smithi047.stdout:(38/159): cephfs-top-19.0.0-3154.g81797d87.el9. 200 kB/s | 18 kB 00:00 2024-05-27T10:49:17.440 INFO:teuthology.orchestra.run.smithi047.stdout:(39/159): ceph-test-19.0.0-3154.g81797d87.el9.x 13 MB/s | 49 MB 00:03 2024-05-27T10:49:17.765 INFO:teuthology.orchestra.run.smithi047.stdout:(40/159): fuse-2.9.9-15.el9.x86_64.rpm 66 kB/s | 80 kB 00:01 2024-05-27T10:49:18.107 INFO:teuthology.orchestra.run.smithi047.stdout:(41/159): libgfortran-11.4.1-3.el9.x86_64.rpm 527 kB/s | 803 kB 00:01 2024-05-27T10:49:18.332 INFO:teuthology.orchestra.run.smithi047.stdout:(42/159): libquadmath-11.4.1-3.el9.x86_64.rpm 220 kB/s | 195 kB 00:00 2024-05-27T10:49:18.724 INFO:teuthology.orchestra.run.smithi047.stdout:(43/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 264 kB/s | 253 kB 00:00 2024-05-27T10:49:19.208 INFO:teuthology.orchestra.run.smithi047.stdout:(44/159): python3-cryptography-36.0.1-4.el9.x86 1.1 MB/s | 1.2 MB 00:01 2024-05-27T10:49:19.241 INFO:teuthology.orchestra.run.smithi047.stdout:(45/159): python3-ply-3.11-14.el9.noarch.rpm 127 kB/s | 106 kB 00:00 2024-05-27T10:49:19.592 INFO:teuthology.orchestra.run.smithi047.stdout:(46/159): python3-pycparser-2.20-6.el9.noarch.r 156 kB/s | 135 kB 00:00 2024-05-27T10:49:19.800 INFO:teuthology.orchestra.run.smithi047.stdout:(47/159): automake-1.16.2-8.el9.noarch.rpm 3.3 MB/s | 689 kB 00:00 2024-05-27T10:49:19.892 INFO:teuthology.orchestra.run.smithi047.stdout:(48/159): bison-3.7.4-5.el9.x86_64.rpm 10 MB/s | 943 kB 00:00 2024-05-27T10:49:19.943 INFO:teuthology.orchestra.run.smithi047.stdout:(49/159): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-05-27T10:49:19.984 INFO:teuthology.orchestra.run.smithi047.stdout:(50/159): elfutils-libelf-devel-0.191-4.el9.x86 533 kB/s | 22 kB 00:00 2024-05-27T10:49:20.018 INFO:teuthology.orchestra.run.smithi047.stdout:(51/159): python3-requests-2.25.1-8.el9.noarch. 154 kB/s | 125 kB 00:00 2024-05-27T10:49:20.052 INFO:teuthology.orchestra.run.smithi047.stdout:(52/159): flex-2.6.4-9.el9.x86_64.rpm 4.7 MB/s | 313 kB 00:00 2024-05-27T10:49:20.136 INFO:teuthology.orchestra.run.smithi047.stdout:(53/159): python3-urllib3-1.26.5-5.el9.noarch.r 240 kB/s | 215 kB 00:00 2024-05-27T10:49:20.161 INFO:teuthology.orchestra.run.smithi047.stdout:(54/159): flexiblas-3.0.4-8.el9.x86_64.rpm 232 kB/s | 33 kB 00:00 2024-05-27T10:49:20.261 INFO:teuthology.orchestra.run.smithi047.stdout:(55/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-05-27T10:49:20.278 INFO:teuthology.orchestra.run.smithi047.stdout:(56/159): libaio-devel-0.3.111-13.el9.x86_64.rp 96 kB/s | 11 kB 00:00 2024-05-27T10:49:20.295 INFO:teuthology.orchestra.run.smithi047.stdout:(57/159): flexiblas-openblas-openmp-3.0.4-8.el9 137 kB/s | 18 kB 00:00 2024-05-27T10:49:20.329 INFO:teuthology.orchestra.run.smithi047.stdout:(58/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 160 kB 00:00 2024-05-27T10:49:20.362 INFO:teuthology.orchestra.run.smithi047.stdout:(59/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 544 kB/s | 45 kB 00:00 2024-05-27T10:49:20.412 INFO:teuthology.orchestra.run.smithi047.stdout:(60/159): libtool-2.4.6-45.el9.x86_64.rpm 6.9 MB/s | 582 kB 00:00 2024-05-27T10:49:20.438 INFO:teuthology.orchestra.run.smithi047.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 342 kB/s | 25 kB 00:00 2024-05-27T10:49:20.463 INFO:teuthology.orchestra.run.smithi047.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 958 kB/s | 47 kB 00:00 2024-05-27T10:49:20.522 INFO:teuthology.orchestra.run.smithi047.stdout:(63/159): librdkafka-1.6.1-102.el9.x86_64.rpm 2.9 MB/s | 662 kB 00:00 2024-05-27T10:49:20.555 INFO:teuthology.orchestra.run.smithi047.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-05-27T10:49:20.580 INFO:teuthology.orchestra.run.smithi047.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 611 kB/s | 35 kB 00:00 2024-05-27T10:49:20.614 INFO:teuthology.orchestra.run.smithi047.stdout:(66/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-05-27T10:49:20.789 INFO:teuthology.orchestra.run.smithi047.stdout:(67/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-05-27T10:49:20.840 INFO:teuthology.orchestra.run.smithi047.stdout:(68/159): postgresql-13.14-1.el9.x86_64.rpm 7.1 MB/s | 1.6 MB 00:00 2024-05-27T10:49:20.940 INFO:teuthology.orchestra.run.smithi047.stdout:(69/159): openblas-openmp-0.3.21-2.el9.x86_64.r 12 MB/s | 4.7 MB 00:00 2024-05-27T10:49:20.965 INFO:teuthology.orchestra.run.smithi047.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 1.0 MB/s | 133 kB 00:00 2024-05-27T10:49:21.015 INFO:teuthology.orchestra.run.smithi047.stdout:(71/159): postgresql-contrib-13.14-1.el9.x86_64 4.0 MB/s | 911 kB 00:00 2024-05-27T10:49:21.066 INFO:teuthology.orchestra.run.smithi047.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.8 MB/s | 87 kB 00:00 2024-05-27T10:49:21.116 INFO:teuthology.orchestra.run.smithi047.stdout:(73/159): protobuf-3.14.0-13.el9.x86_64.rpm 6.8 MB/s | 1.0 MB 00:00 2024-05-27T10:49:21.166 INFO:teuthology.orchestra.run.smithi047.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-05-27T10:49:21.233 INFO:teuthology.orchestra.run.smithi047.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 3.6 MB/s | 244 kB 00:00 2024-05-27T10:49:21.292 INFO:teuthology.orchestra.run.smithi047.stdout:(76/159): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-05-27T10:49:21.334 INFO:teuthology.orchestra.run.smithi047.stdout:(77/159): python3-jsonpatch-1.21-16.el9.noarch. 626 kB/s | 26 kB 00:00 2024-05-27T10:49:21.477 INFO:teuthology.orchestra.run.smithi047.stdout:(78/159): postgresql-server-13.14-1.el9.x86_64. 11 MB/s | 5.8 MB 00:00 2024-05-27T10:49:21.510 INFO:teuthology.orchestra.run.smithi047.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 110 kB/s | 19 kB 00:00 2024-05-27T10:49:21.543 INFO:teuthology.orchestra.run.smithi047.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 2.6 MB/s | 172 kB 00:00 2024-05-27T10:49:21.569 INFO:teuthology.orchestra.run.smithi047.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 600 kB/s | 35 kB 00:00 2024-05-27T10:49:21.627 INFO:teuthology.orchestra.run.smithi047.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.3 MB/s | 250 kB 00:00 2024-05-27T10:49:21.744 INFO:teuthology.orchestra.run.smithi047.stdout:(83/159): python3-babel-2.9.1-2.el9.noarch.rpm 8.8 MB/s | 6.0 MB 00:00 2024-05-27T10:49:21.754 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-05-27T10:49:21.778 INFO:teuthology.orchestra.run.smithi047.stdout:(84/159): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-05-27T10:49:21.803 INFO:teuthology.orchestra.run.smithi047.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-27T10:49:21.829 INFO:teuthology.orchestra.run.smithi047.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 856 kB/s | 42 kB 00:00 2024-05-27T10:49:21.862 INFO:teuthology.orchestra.run.smithi047.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 4.6 MB/s | 269 kB 00:00 2024-05-27T10:49:21.896 INFO:teuthology.orchestra.run.smithi047.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.4 MB/s | 159 kB 00:00 2024-05-27T10:49:21.929 INFO:teuthology.orchestra.run.smithi047.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-05-27T10:49:21.946 INFO:teuthology.orchestra.run.smithi047.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-05-27T10:49:21.972 INFO:teuthology.orchestra.run.smithi047.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-05-27T10:49:22.030 INFO:teuthology.orchestra.run.smithi047.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 731 kB/s | 42 kB 00:00 2024-05-27T10:49:22.072 INFO:teuthology.orchestra.run.smithi047.stdout:(93/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.1 MB/s | 44 kB 00:00 2024-05-27T10:49:22.181 INFO:teuthology.orchestra.run.smithi047.stdout:(94/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.0 MB/s | 5.1 MB 00:00 2024-05-27T10:49:22.214 INFO:teuthology.orchestra.run.smithi047.stdout:(95/159): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-05-27T10:49:22.240 INFO:teuthology.orchestra.run.smithi047.stdout:(96/159): qatlib-service-24.02.0-1.el9.x86_64.r 623 kB/s | 36 kB 00:00 2024-05-27T10:49:22.265 INFO:teuthology.orchestra.run.smithi047.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 963 kB/s | 47 kB 00:00 2024-05-27T10:49:22.298 INFO:teuthology.orchestra.run.smithi047.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 5.2 MB/s | 305 kB 00:00 2024-05-27T10:49:22.324 INFO:teuthology.orchestra.run.smithi047.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-05-27T10:49:22.349 INFO:teuthology.orchestra.run.smithi047.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-05-27T10:49:22.374 INFO:teuthology.orchestra.run.smithi047.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-05-27T10:49:22.429 INFO:teuthology.orchestra.run.smithi047.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 570 kB/s | 45 kB 00:00 2024-05-27T10:49:22.775 INFO:teuthology.orchestra.run.smithi047.stdout:(103/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-05-27T10:49:22.792 INFO:teuthology.orchestra.run.smithi047.stdout:(104/159): lua-devel-5.4.4-4.el9.x86_64.rpm 54 kB/s | 22 kB 00:00 2024-05-27T10:49:23.301 INFO:teuthology.orchestra.run.smithi047.stdout:(105/159): protobuf-compiler-3.14.0-13.el9.x86_ 992 kB/s | 863 kB 00:00 2024-05-27T10:49:23.336 INFO:teuthology.orchestra.run.smithi047.stdout:(106/159): abseil-cpp-20211102.0-3.el9.x86_64.r 983 kB/s | 548 kB 00:00 2024-05-27T10:49:23.359 INFO:teuthology.orchestra.run.smithi047.stdout:(107/159): gperftools-libs-2.9.1-2.el9.x86_64.r 546 kB/s | 309 kB 00:00 2024-05-27T10:49:23.510 INFO:teuthology.orchestra.run.smithi047.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 333 kB/s | 26 kB 00:00 2024-05-27T10:49:23.593 INFO:teuthology.orchestra.run.smithi047.stdout:(109/159): liboath-2.6.7-2.el9.x86_64.rpm 590 kB/s | 49 kB 00:00 2024-05-27T10:49:23.619 INFO:teuthology.orchestra.run.smithi047.stdout:(110/159): grpc-data-1.46.7-10.el9.noarch.rpm 61 kB/s | 19 kB 00:00 2024-05-27T10:49:23.669 INFO:teuthology.orchestra.run.smithi047.stdout:(111/159): libunwind-1.6.2-1.el9.x86_64.rpm 906 kB/s | 67 kB 00:00 2024-05-27T10:49:23.786 INFO:teuthology.orchestra.run.smithi047.stdout:(112/159): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-05-27T10:49:23.870 INFO:teuthology.orchestra.run.smithi047.stdout:(113/159): luarocks-3.9.2-5.el9.noarch.rpm 605 kB/s | 151 kB 00:00 2024-05-27T10:49:23.912 INFO:teuthology.orchestra.run.smithi047.stdout:(114/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.4 MB/s | 839 kB 00:00 2024-05-27T10:49:23.953 INFO:teuthology.orchestra.run.smithi047.stdout:(115/159): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-05-27T10:49:23.979 INFO:teuthology.orchestra.run.smithi047.stdout:(116/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 403 kB/s | 43 kB 00:00 2024-05-27T10:49:24.004 INFO:teuthology.orchestra.run.smithi047.stdout:(117/159): python3-cachetools-4.2.4-1.el9.noarc 352 kB/s | 32 kB 00:00 2024-05-27T10:49:24.029 INFO:teuthology.orchestra.run.smithi047.stdout:(118/159): python3-certifi-2021.10.8-2.el9.noar 200 kB/s | 15 kB 00:00 2024-05-27T10:49:24.096 INFO:teuthology.orchestra.run.smithi047.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-05-27T10:49:24.121 INFO:teuthology.orchestra.run.smithi047.stdout:(120/159): python3-cheroot-8.6.0-4.el9.noarch.r 1.2 MB/s | 172 kB 00:00 2024-05-27T10:49:24.155 INFO:teuthology.orchestra.run.smithi047.stdout:(121/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-05-27T10:49:24.188 INFO:teuthology.orchestra.run.smithi047.stdout:(122/159): python3-google-auth-2.29.0-1.el9.noa 2.2 MB/s | 206 kB 00:00 2024-05-27T10:49:24.239 INFO:teuthology.orchestra.run.smithi047.stdout:(123/159): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-05-27T10:49:24.272 INFO:teuthology.orchestra.run.smithi047.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 129 kB/s | 11 kB 00:00 2024-05-27T10:49:24.314 INFO:teuthology.orchestra.run.smithi047.stdout:(125/159): python3-jaraco-classes-3.2.1-5.el9.n 238 kB/s | 18 kB 00:00 2024-05-27T10:49:24.339 INFO:teuthology.orchestra.run.smithi053.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-27T10:49:24.341 INFO:teuthology.orchestra.run.smithi053.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-27T10:49:24.361 INFO:teuthology.orchestra.run.smithi053.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-27T10:49:24.363 INFO:teuthology.orchestra.run.smithi053.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-27T10:49:24.364 INFO:teuthology.orchestra.run.smithi053.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-27T10:49:24.364 INFO:teuthology.orchestra.run.smithi047.stdout:(126/159): python3-jaraco-collections-3.0.0-8.e 254 kB/s | 23 kB 00:00 2024-05-27T10:49:24.365 INFO:teuthology.orchestra.run.smithi053.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-27T10:49:24.368 INFO:teuthology.orchestra.run.smithi053.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-27T10:49:24.371 INFO:teuthology.orchestra.run.smithi053.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-27T10:49:24.373 INFO:teuthology.orchestra.run.smithi053.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-27T10:49:24.390 INFO:teuthology.orchestra.run.smithi047.stdout:(127/159): python3-jaraco-functools-3.5.0-2.el9 260 kB/s | 19 kB 00:00 2024-05-27T10:49:24.451 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-27T10:49:24.470 INFO:teuthology.orchestra.run.smithi053.stdout:======================================================================================= 2024-05-27T10:49:24.470 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-05-27T10:49:24.470 INFO:teuthology.orchestra.run.smithi053.stdout:======================================================================================= 2024-05-27T10:49:24.470 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-05-27T10:49:24.470 INFO:teuthology.orchestra.run.smithi053.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-27T10:49:24.470 INFO:teuthology.orchestra.run.smithi053.stdout: ceph x86_64 2:19.0.0-3154.g81797d87.el9 ceph 6.6 k 2024-05-27T10:49:24.470 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base x86_64 2:19.0.0-3154.g81797d87.el9 ceph 5.4 M 2024-05-27T10:49:24.470 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse x86_64 2:19.0.0-3154.g81797d87.el9 ceph 890 k 2024-05-27T10:49:24.471 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3154.g81797d87.el9 ceph 145 k 2024-05-27T10:49:24.471 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr x86_64 2:19.0.0-3154.g81797d87.el9 ceph 1.5 M 2024-05-27T10:49:24.471 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 142 k 2024-05-27T10:49:24.471 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 3.5 M 2024-05-27T10:49:24.471 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 7.4 M 2024-05-27T10:49:24.471 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 49 k 2024-05-27T10:49:24.471 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw x86_64 2:19.0.0-3154.g81797d87.el9 ceph 11 M 2024-05-27T10:49:24.471 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test x86_64 2:19.0.0-3154.g81797d87.el9 ceph 49 M 2024-05-27T10:49:24.471 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 273 k 2024-05-27T10:49:24.471 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 763 k 2024-05-27T10:49:24.471 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-mirror x86_64 2:19.0.0-3154.g81797d87.el9 ceph 224 k 2024-05-27T10:49:24.471 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-shell x86_64 2:19.0.0-3154.g81797d87.el9 ceph 27 k 2024-05-27T10:49:24.472 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-top noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 18 k 2024-05-27T10:49:24.472 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-05-27T10:49:24.472 INFO:teuthology.orchestra.run.smithi053.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-27T10:49:24.472 INFO:teuthology.orchestra.run.smithi053.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-27T10:49:24.472 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel x86_64 2:19.0.0-3154.g81797d87.el9 ceph 32 k 2024-05-27T10:49:24.472 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2 x86_64 2:19.0.0-3154.g81797d87.el9 ceph 747 k 2024-05-27T10:49:24.472 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel x86_64 2:19.0.0-3154.g81797d87.el9 ceph 127 k 2024-05-27T10:49:24.472 INFO:teuthology.orchestra.run.smithi053.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-27T10:49:24.472 INFO:teuthology.orchestra.run.smithi053.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-27T10:49:24.472 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-27T10:49:24.472 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-27T10:49:24.472 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-27T10:49:24.472 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-27T10:49:24.473 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs x86_64 2:19.0.0-3154.g81797d87.el9 ceph 161 k 2024-05-27T10:49:24.473 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados x86_64 2:19.0.0-3154.g81797d87.el9 ceph 321 k 2024-05-27T10:49:24.473 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd x86_64 2:19.0.0-3154.g81797d87.el9 ceph 298 k 2024-05-27T10:49:24.473 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw x86_64 2:19.0.0-3154.g81797d87.el9 ceph 99 k 2024-05-27T10:49:24.473 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse x86_64 2:19.0.0-3154.g81797d87.el9 ceph 85 k 2024-05-27T10:49:24.473 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror x86_64 2:19.0.0-3154.g81797d87.el9 ceph 3.1 M 2024-05-27T10:49:24.473 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd x86_64 2:19.0.0-3154.g81797d87.el9 ceph 170 k 2024-05-27T10:49:24.473 INFO:teuthology.orchestra.run.smithi053.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-27T10:49:24.473 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrading: 2024-05-27T10:49:24.473 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-27T10:49:24.473 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-27T10:49:24.473 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-27T10:49:24.474 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-27T10:49:24.474 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-05-27T10:49:24.474 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-05-27T10:49:24.474 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-05-27T10:49:24.474 INFO:teuthology.orchestra.run.smithi053.stdout: librados2 x86_64 2:19.0.0-3154.g81797d87.el9 ceph 3.4 M 2024-05-27T10:49:24.474 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1 x86_64 2:19.0.0-3154.g81797d87.el9 ceph 3.1 M 2024-05-27T10:49:24.474 INFO:teuthology.orchestra.run.smithi053.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-27T10:49:24.474 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-27T10:49:24.474 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-05-27T10:49:24.474 INFO:teuthology.orchestra.run.smithi053.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-27T10:49:24.474 INFO:teuthology.orchestra.run.smithi053.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-27T10:49:24.474 INFO:teuthology.orchestra.run.smithi053.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-27T10:49:24.475 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common x86_64 2:19.0.0-3154.g81797d87.el9 ceph 21 M 2024-05-27T10:49:24.475 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 34 k 2024-05-27T10:49:24.475 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds x86_64 2:19.0.0-3154.g81797d87.el9 ceph 2.4 M 2024-05-27T10:49:24.475 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 252 k 2024-05-27T10:49:24.475 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon x86_64 2:19.0.0-3154.g81797d87.el9 ceph 4.7 M 2024-05-27T10:49:24.475 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd x86_64 2:19.0.0-3154.g81797d87.el9 ceph 17 M 2024-05-27T10:49:24.475 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 16 k 2024-05-27T10:49:24.475 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux x86_64 2:19.0.0-3154.g81797d87.el9 ceph 25 k 2024-05-27T10:49:24.475 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-27T10:49:24.475 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-27T10:49:24.475 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-27T10:49:24.476 INFO:teuthology.orchestra.run.smithi053.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-27T10:49:24.476 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-27T10:49:24.476 INFO:teuthology.orchestra.run.smithi053.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-27T10:49:24.476 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-27T10:49:24.476 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-27T10:49:24.476 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite x86_64 2:19.0.0-3154.g81797d87.el9 ceph 163 k 2024-05-27T10:49:24.476 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-27T10:49:24.476 INFO:teuthology.orchestra.run.smithi053.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-27T10:49:24.476 INFO:teuthology.orchestra.run.smithi053.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-27T10:49:24.476 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-27T10:49:24.476 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-27T10:49:24.476 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1 x86_64 2:19.0.0-3154.g81797d87.el9 ceph 501 k 2024-05-27T10:49:24.476 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-27T10:49:24.476 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2 x86_64 2:19.0.0-3154.g81797d87.el9 ceph 5.4 M 2024-05-27T10:49:24.477 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-27T10:49:24.477 INFO:teuthology.orchestra.run.smithi053.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-27T10:49:24.477 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-27T10:49:24.477 INFO:teuthology.orchestra.run.smithi053.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-27T10:49:24.477 INFO:teuthology.orchestra.run.smithi053.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-27T10:49:24.477 INFO:teuthology.orchestra.run.smithi053.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-27T10:49:24.477 INFO:teuthology.orchestra.run.smithi053.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-27T10:49:24.477 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-27T10:49:24.477 INFO:teuthology.orchestra.run.smithi053.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-27T10:49:24.477 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-27T10:49:24.477 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-27T10:49:24.477 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-27T10:49:24.477 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-27T10:49:24.478 INFO:teuthology.orchestra.run.smithi053.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-27T10:49:24.478 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-27T10:49:24.478 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-27T10:49:24.478 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-27T10:49:24.478 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse x86_64 2:19.0.0-3154.g81797d87.el9 ceph 45 k 2024-05-27T10:49:24.478 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common x86_64 2:19.0.0-3154.g81797d87.el9 ceph 135 k 2024-05-27T10:49:24.478 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-27T10:49:24.478 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-27T10:49:24.478 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-27T10:49:24.478 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-27T10:49:24.478 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-27T10:49:24.478 INFO:teuthology.orchestra.run.smithi053.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-05-27T10:49:24.478 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-27T10:49:24.479 INFO:teuthology.orchestra.run.smithi053.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-27T10:49:24.479 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-27T10:49:24.479 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-27T10:49:24.479 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-27T10:49:24.479 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-27T10:49:24.479 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-27T10:49:24.479 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-27T10:49:24.479 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-27T10:49:24.479 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-27T10:49:24.480 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-05-27T10:49:24.480 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-27T10:49:24.480 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-27T10:49:24.480 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-27T10:49:24.480 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-27T10:49:24.480 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-27T10:49:24.480 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-27T10:49:24.480 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-27T10:49:24.480 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-27T10:49:24.480 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-27T10:49:24.480 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-27T10:49:24.480 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-27T10:49:24.480 INFO:teuthology.orchestra.run.smithi053.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-27T10:49:24.481 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-27T10:49:24.481 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-27T10:49:24.481 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-27T10:49:24.481 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-27T10:49:24.481 INFO:teuthology.orchestra.run.smithi053.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-27T10:49:24.481 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-27T10:49:24.481 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-27T10:49:24.481 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-27T10:49:24.481 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-27T10:49:24.481 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-27T10:49:24.481 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-27T10:49:24.481 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-27T10:49:24.481 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-27T10:49:24.482 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-27T10:49:24.482 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-27T10:49:24.482 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-27T10:49:24.482 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-27T10:49:24.482 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-27T10:49:24.482 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-27T10:49:24.482 INFO:teuthology.orchestra.run.smithi053.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-27T10:49:24.482 INFO:teuthology.orchestra.run.smithi053.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-27T10:49:24.482 INFO:teuthology.orchestra.run.smithi053.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-27T10:49:24.482 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-27T10:49:24.482 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-27T10:49:24.482 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-27T10:49:24.482 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-27T10:49:24.483 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-27T10:49:24.483 INFO:teuthology.orchestra.run.smithi053.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-27T10:49:24.483 INFO:teuthology.orchestra.run.smithi053.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-27T10:49:24.483 INFO:teuthology.orchestra.run.smithi053.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-27T10:49:24.483 INFO:teuthology.orchestra.run.smithi053.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-27T10:49:24.483 INFO:teuthology.orchestra.run.smithi053.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-27T10:49:24.483 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-27T10:49:24.483 INFO:teuthology.orchestra.run.smithi053.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-27T10:49:24.483 INFO:teuthology.orchestra.run.smithi053.stdout:Installing weak dependencies: 2024-05-27T10:49:24.483 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-27T10:49:24.483 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:49:24.483 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-05-27T10:49:24.483 INFO:teuthology.orchestra.run.smithi053.stdout:======================================================================================= 2024-05-27T10:49:24.484 INFO:teuthology.orchestra.run.smithi053.stdout:Install 148 Packages 2024-05-27T10:49:24.484 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrade 11 Packages 2024-05-27T10:49:24.484 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:49:24.484 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 226 M 2024-05-27T10:49:24.484 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-05-27T10:49:24.642 INFO:teuthology.orchestra.run.smithi047.stdout:(128/159): python3-grpcio-1.46.7-10.el9.x86_64. 3.9 MB/s | 2.0 MB 00:00 2024-05-27T10:49:24.716 INFO:teuthology.orchestra.run.smithi047.stdout:(129/159): python3-jaraco-text-3.2.0-6.el9.noar 56 kB/s | 20 kB 00:00 2024-05-27T10:49:24.741 INFO:teuthology.orchestra.run.smithi047.stdout:(130/159): python3-logutils-0.3.5-21.el9.noarch 473 kB/s | 46 kB 00:00 2024-05-27T10:49:24.799 INFO:teuthology.orchestra.run.smithi047.stdout:(131/159): python3-kubernetes-26.1.0-2.el9.noar 2.5 MB/s | 1.0 MB 00:00 2024-05-27T10:49:24.825 INFO:teuthology.orchestra.run.smithi047.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 697 kB/s | 58 kB 00:00 2024-05-27T10:49:24.842 INFO:teuthology.orchestra.run.smithi047.stdout:(133/159): python3-more-itertools-8.12.0-2.el9. 632 kB/s | 79 kB 00:00 2024-05-27T10:49:24.884 INFO:teuthology.orchestra.run.smithi047.stdout:(134/159): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-05-27T10:49:24.909 INFO:teuthology.orchestra.run.smithi047.stdout:(135/159): python3-portend-3.1.0-2.el9.noarch.r 198 kB/s | 16 kB 00:00 2024-05-27T10:49:24.934 INFO:teuthology.orchestra.run.smithi047.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 982 kB/s | 90 kB 00:00 2024-05-27T10:49:24.976 INFO:teuthology.orchestra.run.smithi047.stdout:(137/159): python3-pyperclip-1.8.2-2.el9.noarch 309 kB/s | 28 kB 00:00 2024-05-27T10:49:25.001 INFO:teuthology.orchestra.run.smithi047.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 336 kB/s | 31 kB 00:00 2024-05-27T10:49:25.035 INFO:teuthology.orchestra.run.smithi047.stdout:(139/159): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-05-27T10:49:25.060 INFO:teuthology.orchestra.run.smithi047.stdout:(140/159): python3-rsa-4.9-2.el9.noarch.rpm 711 kB/s | 59 kB 00:00 2024-05-27T10:49:25.086 INFO:teuthology.orchestra.run.smithi047.stdout:(141/159): python3-tempora-5.0.0-2.el9.noarch.r 431 kB/s | 36 kB 00:00 2024-05-27T10:49:25.119 INFO:teuthology.orchestra.run.smithi047.stdout:(142/159): python3-typing-extensions-4.4.0-2.el 612 kB/s | 51 kB 00:00 2024-05-27T10:49:25.153 INFO:teuthology.orchestra.run.smithi047.stdout:(143/159): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-05-27T10:49:25.178 INFO:teuthology.orchestra.run.smithi047.stdout:(144/159): python3-websocket-client-1.2.3-2.el9 981 kB/s | 90 kB 00:00 2024-05-27T10:49:25.220 INFO:teuthology.orchestra.run.smithi047.stdout:(145/159): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-05-27T10:49:25.246 INFO:teuthology.orchestra.run.smithi047.stdout:(146/159): python3-zc-lockfile-2.0-10.el9.noarc 218 kB/s | 20 kB 00:00 2024-05-27T10:49:25.302 INFO:teuthology.orchestra.run.smithi047.stdout:(147/159): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2024-05-27T10:49:25.379 INFO:teuthology.orchestra.run.smithi047.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-05-27T10:49:25.514 INFO:teuthology.orchestra.run.smithi053.stdout:(1/159): ceph-19.0.0-3154.g81797d87.el9.x86_64. 19 kB/s | 6.6 kB 00:00 2024-05-27T10:49:25.580 INFO:teuthology.orchestra.run.smithi047.stdout:(149/159): librados2-19.0.0-3154.g81797d87.el9. 10 MB/s | 3.4 MB 00:00 2024-05-27T10:49:25.838 INFO:teuthology.orchestra.run.smithi047.stdout:(150/159): librbd1-19.0.0-3154.g81797d87.el9.x8 5.9 MB/s | 3.1 MB 00:00 2024-05-27T10:49:25.956 INFO:teuthology.orchestra.run.smithi053.stdout:(2/159): ceph-fuse-19.0.0-3154.g81797d87.el9.x8 2.0 MB/s | 890 kB 00:00 2024-05-27T10:49:26.065 INFO:teuthology.orchestra.run.smithi053.stdout:(3/159): ceph-immutable-object-cache-19.0.0-315 1.3 MB/s | 145 kB 00:00 2024-05-27T10:49:26.290 INFO:teuthology.orchestra.run.smithi053.stdout:(4/159): ceph-base-19.0.0-3154.g81797d87.el9.x8 4.8 MB/s | 5.4 MB 00:01 2024-05-27T10:49:26.507 INFO:teuthology.orchestra.run.smithi053.stdout:(5/159): ceph-mgr-19.0.0-3154.g81797d87.el9.x86 6.9 MB/s | 1.5 MB 00:00 2024-05-27T10:49:26.630 INFO:teuthology.orchestra.run.smithi047.stdout:(151/159): NetworkManager-1.47.90-1.el9.x86_64. 1.8 MB/s | 2.3 MB 00:01 2024-05-27T10:49:26.656 INFO:teuthology.orchestra.run.smithi047.stdout:(152/159): NetworkManager-team-1.47.90-1.el9.x8 51 kB/s | 41 kB 00:00 2024-05-27T10:49:26.757 INFO:teuthology.orchestra.run.smithi053.stdout:(6/159): ceph-mds-19.0.0-3154.g81797d87.el9.x86 3.4 MB/s | 2.4 MB 00:00 2024-05-27T10:49:26.839 INFO:teuthology.orchestra.run.smithi047.stdout:(153/159): NetworkManager-libnm-1.47.90-1.el9.x 1.4 MB/s | 1.8 MB 00:01 2024-05-27T10:49:27.049 INFO:teuthology.orchestra.run.smithi053.stdout:(7/159): ceph-mon-19.0.0-3154.g81797d87.el9.x86 8.7 MB/s | 4.7 MB 00:00 2024-05-27T10:49:27.423 INFO:teuthology.orchestra.run.smithi047.stdout:(154/159): elfutils-debuginfod-client-0.191-4.e 48 kB/s | 37 kB 00:00 2024-05-27T10:49:27.541 INFO:teuthology.orchestra.run.smithi053.stdout:(8/159): ceph-common-19.0.0-3154.g81797d87.el9. 8.9 MB/s | 21 MB 00:02 2024-05-27T10:49:27.591 INFO:teuthology.orchestra.run.smithi053.stdout:(9/159): ceph-selinux-19.0.0-3154.g81797d87.el9 517 kB/s | 25 kB 00:00 2024-05-27T10:49:27.648 INFO:teuthology.orchestra.run.smithi047.stdout:(155/159): NetworkManager-tui-1.47.90-1.el9.x86 244 kB/s | 248 kB 00:01 2024-05-27T10:49:27.748 INFO:teuthology.orchestra.run.smithi047.stdout:(156/159): elfutils-libelf-0.191-4.el9.x86_64.r 228 kB/s | 207 kB 00:00 2024-05-27T10:49:28.125 INFO:teuthology.orchestra.run.smithi053.stdout:(10/159): ceph-radosgw-19.0.0-3154.g81797d87.el 9.9 MB/s | 11 MB 00:01 2024-05-27T10:49:28.194 INFO:teuthology.orchestra.run.smithi053.stdout:(11/159): cephfs-mirror-19.0.0-3154.g81797d87.e 3.3 MB/s | 224 kB 00:00 2024-05-27T10:49:28.267 INFO:teuthology.orchestra.run.smithi053.stdout:(12/159): cephfs-shell-19.0.0-3154.g81797d87.el 366 kB/s | 27 kB 00:00 2024-05-27T10:49:28.325 INFO:teuthology.orchestra.run.smithi053.stdout:(13/159): libcephfs-devel-19.0.0-3154.g81797d87 552 kB/s | 32 kB 00:00 2024-05-27T10:49:28.374 INFO:teuthology.orchestra.run.smithi047.stdout:(157/159): elfutils-libs-0.191-4.el9.x86_64.rpm 273 kB/s | 260 kB 00:00 2024-05-27T10:49:28.459 INFO:teuthology.orchestra.run.smithi053.stdout:(14/159): libcephfs2-19.0.0-3154.g81797d87.el9. 5.5 MB/s | 747 kB 00:00 2024-05-27T10:49:28.534 INFO:teuthology.orchestra.run.smithi053.stdout:(15/159): libcephsqlite-19.0.0-3154.g81797d87.e 2.2 MB/s | 163 kB 00:00 2024-05-27T10:49:28.593 INFO:teuthology.orchestra.run.smithi053.stdout:(16/159): librados-devel-19.0.0-3154.g81797d87. 2.2 MB/s | 127 kB 00:00 2024-05-27T10:49:28.677 INFO:teuthology.orchestra.run.smithi053.stdout:(17/159): libradosstriper1-19.0.0-3154.g81797d8 5.9 MB/s | 501 kB 00:00 2024-05-27T10:49:28.807 INFO:teuthology.orchestra.run.smithi047.stdout:(158/159): openssl-3.2.1-1.el9.x86_64.rpm 1.2 MB/s | 1.3 MB 00:01 2024-05-27T10:49:29.007 INFO:teuthology.orchestra.run.smithi047.stdout:(159/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 1.9 MB/s | 2.4 MB 00:01 2024-05-27T10:49:29.021 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-05-27T10:49:29.021 INFO:teuthology.orchestra.run.smithi047.stdout:Total 12 MB/s | 226 MB 00:18 2024-05-27T10:49:29.252 INFO:teuthology.orchestra.run.smithi053.stdout:(18/159): librgw2-19.0.0-3154.g81797d87.el9.x86 9.3 MB/s | 5.4 MB 00:00 2024-05-27T10:49:29.319 INFO:teuthology.orchestra.run.smithi053.stdout:(19/159): python3-ceph-argparse-19.0.0-3154.g81 686 kB/s | 45 kB 00:00 2024-05-27T10:49:29.394 INFO:teuthology.orchestra.run.smithi053.stdout:(20/159): python3-ceph-common-19.0.0-3154.g8179 1.8 MB/s | 135 kB 00:00 2024-05-27T10:49:29.461 INFO:teuthology.orchestra.run.smithi053.stdout:(21/159): python3-cephfs-19.0.0-3154.g81797d87. 2.4 MB/s | 161 kB 00:00 2024-05-27T10:49:29.544 INFO:teuthology.orchestra.run.smithi053.stdout:(22/159): python3-rados-19.0.0-3154.g81797d87.e 3.8 MB/s | 321 kB 00:00 2024-05-27T10:49:29.796 INFO:teuthology.orchestra.run.smithi053.stdout:(23/159): ceph-osd-19.0.0-3154.g81797d87.el9.x8 5.5 MB/s | 17 MB 00:03 2024-05-27T10:49:29.854 INFO:teuthology.orchestra.run.smithi053.stdout:(24/159): python3-rbd-19.0.0-3154.g81797d87.el9 968 kB/s | 298 kB 00:00 2024-05-27T10:49:29.887 INFO:teuthology.orchestra.run.smithi053.stdout:(25/159): python3-rgw-19.0.0-3154.g81797d87.el9 1.1 MB/s | 99 kB 00:00 2024-05-27T10:49:29.913 INFO:teuthology.orchestra.run.smithi053.stdout:(26/159): rbd-fuse-19.0.0-3154.g81797d87.el9.x8 1.4 MB/s | 85 kB 00:00 2024-05-27T10:49:29.971 INFO:teuthology.orchestra.run.smithi053.stdout:(27/159): rbd-nbd-19.0.0-3154.g81797d87.el9.x86 2.9 MB/s | 170 kB 00:00 2024-05-27T10:49:30.021 INFO:teuthology.orchestra.run.smithi053.stdout:(28/159): ceph-grafana-dashboards-19.0.0-3154.g 694 kB/s | 34 kB 00:00 2024-05-27T10:49:30.097 INFO:teuthology.orchestra.run.smithi053.stdout:(29/159): ceph-mgr-cephadm-19.0.0-3154.g81797d8 1.9 MB/s | 142 kB 00:00 2024-05-27T10:49:30.414 INFO:teuthology.orchestra.run.smithi053.stdout:(30/159): rbd-mirror-19.0.0-3154.g81797d87.el9. 5.9 MB/s | 3.1 MB 00:00 2024-05-27T10:49:30.514 INFO:teuthology.orchestra.run.smithi053.stdout:(31/159): ceph-mgr-dashboard-19.0.0-3154.g81797 8.5 MB/s | 3.5 MB 00:00 2024-05-27T10:49:30.598 INFO:teuthology.orchestra.run.smithi053.stdout:(32/159): ceph-mgr-modules-core-19.0.0-3154.g81 3.0 MB/s | 252 kB 00:00 2024-05-27T10:49:30.673 INFO:teuthology.orchestra.run.smithi053.stdout:(33/159): ceph-mgr-rook-19.0.0-3154.g81797d87.e 666 kB/s | 49 kB 00:00 2024-05-27T10:49:30.749 INFO:teuthology.orchestra.run.smithi053.stdout:(34/159): ceph-prometheus-alerts-19.0.0-3154.g8 222 kB/s | 16 kB 00:00 2024-05-27T10:49:30.815 INFO:teuthology.orchestra.run.smithi053.stdout:(35/159): ceph-volume-19.0.0-3154.g81797d87.el9 4.1 MB/s | 273 kB 00:00 2024-05-27T10:49:31.349 INFO:teuthology.orchestra.run.smithi053.stdout:(36/159): ceph-test-19.0.0-3154.g81797d87.el9.x 13 MB/s | 49 MB 00:03 2024-05-27T10:49:31.408 INFO:teuthology.orchestra.run.smithi053.stdout:(37/159): cephadm-19.0.0-3154.g81797d87.el9.noa 1.3 MB/s | 763 kB 00:00 2024-05-27T10:49:31.433 INFO:teuthology.orchestra.run.smithi053.stdout:(38/159): cephfs-top-19.0.0-3154.g81797d87.el9. 222 kB/s | 18 kB 00:00 2024-05-27T10:49:31.658 INFO:teuthology.orchestra.run.smithi053.stdout:(39/159): fuse-2.9.9-15.el9.x86_64.rpm 322 kB/s | 80 kB 00:00 2024-05-27T10:49:31.834 INFO:teuthology.orchestra.run.smithi053.stdout:(40/159): ceph-mgr-diskprediction-local-19.0.0- 5.2 MB/s | 7.4 MB 00:01 2024-05-27T10:49:31.867 INFO:teuthology.orchestra.run.smithi053.stdout:(41/159): libquadmath-11.4.1-3.el9.x86_64.rpm 941 kB/s | 195 kB 00:00 2024-05-27T10:49:31.967 INFO:teuthology.orchestra.run.smithi053.stdout:(42/159): libgfortran-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 803 kB 00:00 2024-05-27T10:49:32.034 INFO:teuthology.orchestra.run.smithi053.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-05-27T10:49:32.076 INFO:teuthology.orchestra.run.smithi053.stdout:(44/159): python3-cryptography-36.0.1-4.el9.x86 5.9 MB/s | 1.2 MB 00:00 2024-05-27T10:49:32.110 INFO:teuthology.orchestra.run.smithi053.stdout:(45/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 921 kB/s | 253 kB 00:00 2024-05-27T10:49:32.135 INFO:teuthology.orchestra.run.smithi053.stdout:(46/159): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-05-27T10:49:32.160 INFO:teuthology.orchestra.run.smithi053.stdout:(47/159): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-05-27T10:49:32.194 INFO:teuthology.orchestra.run.smithi053.stdout:(48/159): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-05-27T10:49:32.228 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-05-27T10:49:32.336 INFO:teuthology.orchestra.run.smithi053.stdout:(49/159): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-05-27T10:49:32.361 INFO:teuthology.orchestra.run.smithi053.stdout:(50/159): boost-program-options-1.75.0-8.el9.x8 644 kB/s | 107 kB 00:00 2024-05-27T10:49:32.395 INFO:teuthology.orchestra.run.smithi053.stdout:(51/159): elfutils-libelf-devel-0.191-4.el9.x86 376 kB/s | 22 kB 00:00 2024-05-27T10:49:32.437 INFO:teuthology.orchestra.run.smithi053.stdout:(52/159): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-05-27T10:49:32.487 INFO:teuthology.orchestra.run.smithi053.stdout:(53/159): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-05-27T10:49:32.498 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-05-27T10:49:32.499 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-05-27T10:49:32.512 INFO:teuthology.orchestra.run.smithi053.stdout:(54/159): flexiblas-3.0.4-8.el9.x86_64.rpm 281 kB/s | 33 kB 00:00 2024-05-27T10:49:32.571 INFO:teuthology.orchestra.run.smithi053.stdout:(55/159): flexiblas-openblas-openmp-3.0.4-8.el9 319 kB/s | 18 kB 00:00 2024-05-27T10:49:32.596 INFO:teuthology.orchestra.run.smithi053.stdout:(56/159): libaio-devel-0.3.111-13.el9.x86_64.rp 135 kB/s | 11 kB 00:00 2024-05-27T10:49:32.705 INFO:teuthology.orchestra.run.smithi053.stdout:(57/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-05-27T10:49:32.722 INFO:teuthology.orchestra.run.smithi053.stdout:(58/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 364 kB/s | 45 kB 00:00 2024-05-27T10:49:32.747 INFO:teuthology.orchestra.run.smithi053.stdout:(59/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-05-27T10:49:32.798 INFO:teuthology.orchestra.run.smithi053.stdout:(60/159): libtool-2.4.6-45.el9.x86_64.rpm 7.6 MB/s | 582 kB 00:00 2024-05-27T10:49:32.823 INFO:teuthology.orchestra.run.smithi053.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 343 kB/s | 25 kB 00:00 2024-05-27T10:49:32.856 INFO:teuthology.orchestra.run.smithi053.stdout:(62/159): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-05-27T10:49:32.882 INFO:teuthology.orchestra.run.smithi053.stdout:(63/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 572 kB/s | 47 kB 00:00 2024-05-27T10:49:32.915 INFO:teuthology.orchestra.run.smithi053.stdout:(64/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-05-27T10:49:32.943 INFO:teuthology.orchestra.run.smithi053.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 615 kB/s | 35 kB 00:00 2024-05-27T10:49:32.974 INFO:teuthology.orchestra.run.smithi053.stdout:(66/159): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-05-27T10:49:33.191 INFO:teuthology.orchestra.run.smithi053.stdout:(67/159): postgresql-13.14-1.el9.x86_64.rpm 7.4 MB/s | 1.6 MB 00:00 2024-05-27T10:49:33.316 INFO:teuthology.orchestra.run.smithi053.stdout:(68/159): openblas-openmp-0.3.21-2.el9.x86_64.r 12 MB/s | 4.7 MB 00:00 2024-05-27T10:49:33.358 INFO:teuthology.orchestra.run.smithi053.stdout:(69/159): postgresql-contrib-13.14-1.el9.x86_64 5.4 MB/s | 911 kB 00:00 2024-05-27T10:49:33.450 INFO:teuthology.orchestra.run.smithi053.stdout:(70/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 8.7 MB/s | 4.4 MB 00:00 2024-05-27T10:49:33.475 INFO:teuthology.orchestra.run.smithi053.stdout:(71/159): postgresql-private-libs-13.14-1.el9.x 844 kB/s | 133 kB 00:00 2024-05-27T10:49:33.534 INFO:teuthology.orchestra.run.smithi053.stdout:(72/159): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-05-27T10:49:33.560 INFO:teuthology.orchestra.run.smithi053.stdout:(73/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-05-27T10:49:33.618 INFO:teuthology.orchestra.run.smithi053.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-05-27T10:49:33.685 INFO:teuthology.orchestra.run.smithi053.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 3.6 MB/s | 244 kB 00:00 2024-05-27T10:49:33.752 INFO:teuthology.orchestra.run.smithi053.stdout:(76/159): python3-jinja2-2.11.3-6.el9.noarch.rp 3.7 MB/s | 248 kB 00:00 2024-05-27T10:49:33.861 INFO:teuthology.orchestra.run.smithi053.stdout:(77/159): postgresql-server-13.14-1.el9.x86_64. 12 MB/s | 5.8 MB 00:00 2024-05-27T10:49:33.886 INFO:teuthology.orchestra.run.smithi053.stdout:(78/159): python3-jsonpatch-1.21-16.el9.noarch. 193 kB/s | 26 kB 00:00 2024-05-27T10:49:33.911 INFO:teuthology.orchestra.run.smithi053.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 389 kB/s | 19 kB 00:00 2024-05-27T10:49:33.945 INFO:teuthology.orchestra.run.smithi053.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-05-27T10:49:34.003 INFO:teuthology.orchestra.run.smithi053.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 381 kB/s | 35 kB 00:00 2024-05-27T10:49:34.137 INFO:teuthology.orchestra.run.smithi053.stdout:(82/159): python3-babel-2.9.1-2.el9.noarch.rpm 9.9 MB/s | 6.0 MB 00:00 2024-05-27T10:49:34.171 INFO:teuthology.orchestra.run.smithi053.stdout:(83/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-05-27T10:49:34.204 INFO:teuthology.orchestra.run.smithi053.stdout:(84/159): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-05-27T10:49:34.230 INFO:teuthology.orchestra.run.smithi053.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-27T10:49:34.263 INFO:teuthology.orchestra.run.smithi053.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 729 kB/s | 42 kB 00:00 2024-05-27T10:49:34.297 INFO:teuthology.orchestra.run.smithi053.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 269 kB 00:00 2024-05-27T10:49:34.331 INFO:teuthology.orchestra.run.smithi053.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.4 MB/s | 159 kB 00:00 2024-05-27T10:49:34.364 INFO:teuthology.orchestra.run.smithi053.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-05-27T10:49:34.390 INFO:teuthology.orchestra.run.smithi053.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 883 kB/s | 51 kB 00:00 2024-05-27T10:49:34.432 INFO:teuthology.orchestra.run.smithi053.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 809 kB/s | 54 kB 00:00 2024-05-27T10:49:34.540 INFO:teuthology.orchestra.run.smithi053.stdout:(92/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.6 MB/s | 5.1 MB 00:00 2024-05-27T10:49:34.565 INFO:teuthology.orchestra.run.smithi053.stdout:(93/159): python3-toml-0.10.2-6.el9.noarch.rpm 314 kB/s | 42 kB 00:00 2024-05-27T10:49:34.599 INFO:teuthology.orchestra.run.smithi053.stdout:(94/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 767 kB/s | 44 kB 00:00 2024-05-27T10:49:34.641 INFO:teuthology.orchestra.run.smithi053.stdout:(95/159): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-05-27T10:49:34.675 INFO:teuthology.orchestra.run.smithi053.stdout:(96/159): qatlib-service-24.02.0-1.el9.x86_64.r 481 kB/s | 36 kB 00:00 2024-05-27T10:49:34.700 INFO:teuthology.orchestra.run.smithi053.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 819 kB/s | 47 kB 00:00 2024-05-27T10:49:34.742 INFO:teuthology.orchestra.run.smithi053.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-05-27T10:49:34.767 INFO:teuthology.orchestra.run.smithi053.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 873 kB/s | 58 kB 00:00 2024-05-27T10:49:34.830 INFO:teuthology.orchestra.run.smithi053.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.1 MB/s | 94 kB 00:00 2024-05-27T10:49:34.859 INFO:teuthology.orchestra.run.smithi053.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 698 kB/s | 64 kB 00:00 2024-05-27T10:49:34.885 INFO:teuthology.orchestra.run.smithi053.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 833 kB/s | 45 kB 00:00 2024-05-27T10:49:35.343 INFO:teuthology.orchestra.run.smithi053.stdout:(103/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-05-27T10:49:35.512 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-05-27T10:49:35.513 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-05-27T10:49:35.852 INFO:teuthology.orchestra.run.smithi053.stdout:(104/159): lua-devel-5.4.4-4.el9.x86_64.rpm 22 kB/s | 22 kB 00:00 2024-05-27T10:49:36.260 INFO:teuthology.orchestra.run.smithi053.stdout:(105/159): protobuf-compiler-3.14.0-13.el9.x86_ 628 kB/s | 863 kB 00:01 2024-05-27T10:49:36.294 INFO:teuthology.orchestra.run.smithi053.stdout:(106/159): abseil-cpp-20211102.0-3.el9.x86_64.r 662 kB/s | 548 kB 00:00 2024-05-27T10:49:36.628 INFO:teuthology.orchestra.run.smithi053.stdout:(107/159): gperftools-libs-2.9.1-2.el9.x86_64.r 399 kB/s | 309 kB 00:00 2024-05-27T10:49:36.803 INFO:teuthology.orchestra.run.smithi053.stdout:(108/159): libarrow-9.0.0-11.el9.x86_64.rpm 8.7 MB/s | 4.4 MB 00:00 2024-05-27T10:49:36.845 INFO:teuthology.orchestra.run.smithi053.stdout:(109/159): grpc-data-1.46.7-10.el9.noarch.rpm 33 kB/s | 19 kB 00:00 2024-05-27T10:49:36.887 INFO:teuthology.orchestra.run.smithi053.stdout:(110/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 101 kB/s | 26 kB 00:00 2024-05-27T10:49:36.929 INFO:teuthology.orchestra.run.smithi053.stdout:(111/159): liboath-2.6.7-2.el9.x86_64.rpm 389 kB/s | 49 kB 00:00 2024-05-27T10:49:36.971 INFO:teuthology.orchestra.run.smithi053.stdout:(112/159): libunwind-1.6.2-1.el9.x86_64.rpm 539 kB/s | 67 kB 00:00 2024-05-27T10:49:37.071 INFO:teuthology.orchestra.run.smithi053.stdout:(113/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-05-27T10:49:37.196 INFO:teuthology.orchestra.run.smithi053.stdout:(114/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 351 kB/s | 43 kB 00:00 2024-05-27T10:49:37.264 INFO:teuthology.orchestra.run.smithi053.stdout:(115/159): python3-asyncssh-2.13.2-5.el9.noarch 1.8 MB/s | 548 kB 00:00 2024-05-27T10:49:37.319 INFO:teuthology.orchestra.run.smithi053.stdout:(116/159): luarocks-3.9.2-5.el9.noarch.rpm 351 kB/s | 151 kB 00:00 2024-05-27T10:49:37.347 INFO:teuthology.orchestra.run.smithi053.stdout:(117/159): python3-cachetools-4.2.4-1.el9.noarc 215 kB/s | 32 kB 00:00 2024-05-27T10:49:37.373 INFO:teuthology.orchestra.run.smithi053.stdout:(118/159): python3-certifi-2021.10.8-2.el9.noar 138 kB/s | 15 kB 00:00 2024-05-27T10:49:37.465 INFO:teuthology.orchestra.run.smithi053.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-05-27T10:49:37.515 INFO:teuthology.orchestra.run.smithi053.stdout:(120/159): python3-cheroot-8.6.0-4.el9.noarch.r 879 kB/s | 172 kB 00:00 2024-05-27T10:49:37.549 INFO:teuthology.orchestra.run.smithi053.stdout:(121/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.7 MB/s | 303 kB 00:00 2024-05-27T10:49:37.582 INFO:teuthology.orchestra.run.smithi053.stdout:(122/159): python3-google-auth-2.29.0-1.el9.noa 1.7 MB/s | 206 kB 00:00 2024-05-27T10:49:37.691 INFO:teuthology.orchestra.run.smithi053.stdout:(123/159): python3-jaraco-8.2.1-3.el9.noarch.rp 99 kB/s | 11 kB 00:00 2024-05-27T10:49:37.716 INFO:teuthology.orchestra.run.smithi053.stdout:(124/159): python3-grpcio-tools-1.46.7-10.el9.x 869 kB/s | 144 kB 00:00 2024-05-27T10:49:37.816 INFO:teuthology.orchestra.run.smithi053.stdout:(125/159): python3-jaraco-classes-3.2.1-5.el9.n 142 kB/s | 18 kB 00:00 2024-05-27T10:49:37.841 INFO:teuthology.orchestra.run.smithi053.stdout:(126/159): python3-jaraco-collections-3.0.0-8.e 186 kB/s | 23 kB 00:00 2024-05-27T10:49:37.908 INFO:teuthology.orchestra.run.smithi053.stdout:(127/159): python3-grpcio-1.46.7-10.el9.x86_64. 5.2 MB/s | 2.0 MB 00:00 2024-05-27T10:49:37.934 INFO:teuthology.orchestra.run.smithi053.stdout:(128/159): python3-jaraco-functools-3.5.0-2.el9 167 kB/s | 19 kB 00:00 2024-05-27T10:49:37.959 INFO:teuthology.orchestra.run.smithi053.stdout:(129/159): python3-jaraco-text-3.2.0-6.el9.noar 169 kB/s | 20 kB 00:00 2024-05-27T10:49:38.043 INFO:teuthology.orchestra.run.smithi053.stdout:(130/159): python3-logutils-0.3.5-21.el9.noarch 429 kB/s | 46 kB 00:00 2024-05-27T10:49:38.093 INFO:teuthology.orchestra.run.smithi053.stdout:(131/159): python3-kubernetes-26.1.0-2.el9.noar 5.6 MB/s | 1.0 MB 00:00 2024-05-27T10:49:38.147 INFO:teuthology.orchestra.run.smithi053.stdout:(132/159): python3-more-itertools-8.12.0-2.el9. 421 kB/s | 79 kB 00:00 2024-05-27T10:49:38.177 INFO:teuthology.orchestra.run.smithi053.stdout:(133/159): python3-natsort-7.1.1-5.el9.noarch.r 434 kB/s | 58 kB 00:00 2024-05-27T10:49:38.210 INFO:teuthology.orchestra.run.smithi053.stdout:(134/159): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-05-27T10:49:38.252 INFO:teuthology.orchestra.run.smithi053.stdout:(135/159): python3-portend-3.1.0-2.el9.noarch.r 157 kB/s | 16 kB 00:00 2024-05-27T10:49:38.278 INFO:teuthology.orchestra.run.smithi053.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 901 kB/s | 90 kB 00:00 2024-05-27T10:49:38.311 INFO:teuthology.orchestra.run.smithi053.stdout:(137/159): python3-pyperclip-1.8.2-2.el9.noarch 282 kB/s | 28 kB 00:00 2024-05-27T10:49:38.362 INFO:teuthology.orchestra.run.smithi053.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 284 kB/s | 31 kB 00:00 2024-05-27T10:49:38.395 INFO:teuthology.orchestra.run.smithi053.stdout:(139/159): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-05-27T10:49:38.413 INFO:teuthology.orchestra.run.smithi053.stdout:(140/159): python3-rsa-4.9-2.el9.noarch.rpm 591 kB/s | 59 kB 00:00 2024-05-27T10:49:38.587 INFO:teuthology.orchestra.run.smithi053.stdout:(141/159): python3-tempora-5.0.0-2.el9.noarch.r 159 kB/s | 36 kB 00:00 2024-05-27T10:49:38.604 INFO:teuthology.orchestra.run.smithi053.stdout:(142/159): python3-typing-extensions-4.4.0-2.el 245 kB/s | 51 kB 00:00 2024-05-27T10:49:38.638 INFO:teuthology.orchestra.run.smithi053.stdout:(143/159): python3-webob-1.8.7-6.el9.noarch.rpm 1.0 MB/s | 230 kB 00:00 2024-05-27T10:49:38.722 INFO:teuthology.orchestra.run.smithi053.stdout:(144/159): python3-websocket-client-1.2.3-2.el9 673 kB/s | 90 kB 00:00 2024-05-27T10:49:38.747 INFO:teuthology.orchestra.run.smithi053.stdout:(145/159): python3-zc-lockfile-2.0-10.el9.noarc 184 kB/s | 20 kB 00:00 2024-05-27T10:49:38.781 INFO:teuthology.orchestra.run.smithi053.stdout:(146/159): python3-werkzeug-2.0.3-3.el9.1.noarc 2.4 MB/s | 427 kB 00:00 2024-05-27T10:49:38.915 INFO:teuthology.orchestra.run.smithi053.stdout:(147/159): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-05-27T10:49:38.948 INFO:teuthology.orchestra.run.smithi053.stdout:(148/159): re2-20211101-3.el9.x86_64.rpm 853 kB/s | 192 kB 00:00 2024-05-27T10:49:39.232 INFO:teuthology.orchestra.run.smithi053.stdout:(149/159): librbd1-19.0.0-3154.g81797d87.el9.x8 9.9 MB/s | 3.1 MB 00:00 2024-05-27T10:49:39.448 INFO:teuthology.orchestra.run.smithi053.stdout:(150/159): librados2-19.0.0-3154.g81797d87.el9. 5.1 MB/s | 3.4 MB 00:00 2024-05-27T10:49:39.611 INFO:teuthology.orchestra.run.smithi053.stdout:(151/159): NetworkManager-libnm-1.47.90-1.el9.x 4.8 MB/s | 1.8 MB 00:00 2024-05-27T10:49:39.632 INFO:teuthology.orchestra.run.smithi053.stdout:(152/159): NetworkManager-team-1.47.90-1.el9.x8 227 kB/s | 41 kB 00:00 2024-05-27T10:49:39.683 INFO:teuthology.orchestra.run.smithi053.stdout:(153/159): NetworkManager-tui-1.47.90-1.el9.x86 3.3 MB/s | 248 kB 00:00 2024-05-27T10:49:39.749 INFO:teuthology.orchestra.run.smithi053.stdout:(154/159): NetworkManager-1.47.90-1.el9.x86_64. 2.9 MB/s | 2.3 MB 00:00 2024-05-27T10:49:39.778 INFO:teuthology.orchestra.run.smithi053.stdout:(155/159): elfutils-debuginfod-client-0.191-4.e 259 kB/s | 37 kB 00:00 2024-05-27T10:49:39.975 INFO:teuthology.orchestra.run.smithi053.stdout:(156/159): elfutils-libelf-0.191-4.el9.x86_64.r 710 kB/s | 207 kB 00:00 2024-05-27T10:49:40.009 INFO:teuthology.orchestra.run.smithi053.stdout:(157/159): elfutils-libs-0.191-4.el9.x86_64.rpm 1.0 MB/s | 260 kB 00:00 2024-05-27T10:49:40.151 INFO:teuthology.orchestra.run.smithi053.stdout:(158/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-05-27T10:49:40.667 INFO:teuthology.orchestra.run.smithi053.stdout:(159/159): openssl-3.2.1-1.el9.x86_64.rpm 1.5 MB/s | 1.3 MB 00:00 2024-05-27T10:49:40.680 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-05-27T10:49:40.681 INFO:teuthology.orchestra.run.smithi053.stdout:Total 14 MB/s | 226 MB 00:16 2024-05-27T10:49:42.424 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-05-27T10:49:42.531 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-05-27T10:49:42.635 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-05-27T10:49:42.769 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-05-27T10:49:42.829 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-05-27T10:49:42.867 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-05-27T10:49:42.969 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-05-27T10:49:43.394 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-05-27T10:49:43.492 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librados2-2:19.0.0-3154.g81797d87.el9.x86_64 8/170 2024-05-27T10:49:43.694 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:19.0.0-3154.g81797d87.el9.x86_64 8/170 2024-05-27T10:49:43.726 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs2-2:19.0.0-3154.g81797d87.el9.x86_64 9/170 2024-05-27T10:49:43.859 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs2-2:19.0.0-3154.g81797d87.el9.x86_64 9/170 2024-05-27T10:49:43.892 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rados-2:19.0.0-3154.g81797d87.el9.x86_64 10/170 2024-05-27T10:49:43.910 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-05-27T10:49:43.979 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-05-27T10:49:44.168 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-05-27T10:49:44.168 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-05-27T10:49:44.359 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-05-27T10:49:44.424 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-05-27T10:49:44.448 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephsqlite-2:19.0.0-3154.g81797d87.el9.x86_64 14/170 2024-05-27T10:49:44.636 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3154.g81797d87.el9.x86_64 14/170 2024-05-27T10:49:44.666 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libradosstriper1-2:19.0.0-3154.g81797d87.el9.x86 15/170 2024-05-27T10:49:44.761 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3154.g81797d87.el9.x86 15/170 2024-05-27T10:49:44.792 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-27T10:49:44.855 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-27T10:49:45.161 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-27T10:49:45.447 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-27T10:49:45.665 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-27T10:49:45.753 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-27T10:49:45.955 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T10:49:46.062 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T10:49:46.396 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T10:49:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-05-27T10:49:46.736 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-05-27T10:49:46.784 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-05-27T10:49:46.833 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-05-27T10:49:46.926 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-05-27T10:49:46.978 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-05-27T10:49:47.047 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-05-27T10:49:47.091 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-05-27T10:49:47.102 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-05-27T10:49:47.103 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-05-27T10:49:47.131 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-05-27T10:49:47.250 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-05-27T10:49:47.323 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-05-27T10:49:47.358 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-05-27T10:49:47.440 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-05-27T10:49:47.556 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-05-27T10:49:47.595 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-common-2:19.0.0-3154.g81797d87.el9. 34/170 2024-05-27T10:49:47.647 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-argparse-2:19.0.0-3154.g81797d87.el 35/170 2024-05-27T10:49:47.685 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cephfs-2:19.0.0-3154.g81797d87.el9.x86_6 36/170 2024-05-27T10:49:47.812 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-05-27T10:49:47.872 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-05-27T10:49:47.970 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-05-27T10:49:48.163 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-05-27T10:49:48.234 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-05-27T10:49:48.925 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-05-27T10:49:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-05-27T10:49:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-05-27T10:49:49.126 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-05-27T10:49:49.183 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-05-27T10:49:49.236 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librados-devel-2:19.0.0-3154.g81797d87.el9.x86_6 47/170 2024-05-27T10:49:49.313 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-05-27T10:49:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-05-27T10:49:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-05-27T10:49:49.714 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-05-27T10:49:49.807 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-05-27T10:49:49.846 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-05-27T10:49:49.885 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-05-27T10:49:49.953 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-05-27T10:49:49.993 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-05-27T10:49:50.057 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-05-27T10:49:50.132 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-05-27T10:49:50.346 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-05-27T10:49:50.395 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-05-27T10:49:50.450 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-05-27T10:49:50.583 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-05-27T10:49:50.627 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-05-27T10:49:50.673 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-05-27T10:49:50.709 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-05-27T10:49:50.742 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-05-27T10:49:50.944 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-05-27T10:49:51.126 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-05-27T10:49:51.182 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-05-27T10:49:51.237 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-05-27T10:49:51.285 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-05-27T10:49:51.353 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-05-27T10:49:51.414 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-05-27T10:49:51.463 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-05-27T10:49:51.518 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-05-27T10:49:51.567 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-05-27T10:49:51.654 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-05-27T10:49:51.708 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-05-27T10:49:51.866 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-05-27T10:49:51.931 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-05-27T10:49:51.972 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-05-27T10:49:52.044 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-05-27T10:49:52.203 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-05-27T10:49:52.275 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-05-27T10:49:53.275 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-05-27T10:49:53.324 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-05-27T10:49:53.357 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-05-27T10:49:53.500 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-05-27T10:49:53.559 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-05-27T10:49:53.621 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-05-27T10:49:53.733 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-05-27T10:49:53.785 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-05-27T10:49:54.042 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-05-27T10:49:54.072 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-05-27T10:49:54.093 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-05-27T10:49:54.215 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-05-27T10:49:54.237 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-05-27T10:49:54.320 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-05-27T10:49:54.437 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-05-27T10:49:54.496 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-05-27T10:49:54.535 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-05-27T10:49:54.641 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-05-27T10:49:55.074 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-05-27T10:49:55.131 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-05-27T10:49:55.191 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librados2-2:19.0.0-3154.g81797d87.el9.x86_64 8/170 2024-05-27T10:49:55.284 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-05-27T10:49:55.375 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:19.0.0-3154.g81797d87.el9.x86_64 8/170 2024-05-27T10:49:55.409 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs2-2:19.0.0-3154.g81797d87.el9.x86_64 9/170 2024-05-27T10:49:55.542 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephfs2-2:19.0.0-3154.g81797d87.el9.x86_64 9/170 2024-05-27T10:49:55.584 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rados-2:19.0.0-3154.g81797d87.el9.x86_64 10/170 2024-05-27T10:49:55.663 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-05-27T10:49:56.049 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-05-27T10:49:56.115 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-05-27T10:49:56.139 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephsqlite-2:19.0.0-3154.g81797d87.el9.x86_64 14/170 2024-05-27T10:49:56.300 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3154.g81797d87.el9.x86_64 14/170 2024-05-27T10:49:56.332 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libradosstriper1-2:19.0.0-3154.g81797d87.el9.x86 15/170 2024-05-27T10:49:56.428 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3154.g81797d87.el9.x86 15/170 2024-05-27T10:49:56.458 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-27T10:49:56.528 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-27T10:49:56.826 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-27T10:49:56.989 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-05-27T10:49:57.086 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-05-27T10:49:57.122 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-05-27T10:49:57.156 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-05-27T10:49:57.199 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-27T10:49:57.466 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-27T10:49:57.544 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-05-27T10:49:57.562 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-27T10:49:57.582 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librbd1-2:19.0.0-3154.g81797d87.el9.x86_64 103/170 2024-05-27T10:49:57.705 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:19.0.0-3154.g81797d87.el9.x86_64 103/170 2024-05-27T10:49:57.738 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rbd-2:19.0.0-3154.g81797d87.el9.x86_64 104/170 2024-05-27T10:49:57.781 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T10:49:57.795 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-05-27T10:49:57.884 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T10:49:58.273 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T10:49:58.371 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-05-27T10:49:58.402 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librgw2-2:19.0.0-3154.g81797d87.el9.x86_64 107/170 2024-05-27T10:49:58.490 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-05-27T10:49:58.493 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librgw2-2:19.0.0-3154.g81797d87.el9.x86_64 107/170 2024-05-27T10:49:58.520 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rgw-2:19.0.0-3154.g81797d87.el9.x86_64 108/170 2024-05-27T10:49:58.612 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-05-27T10:49:58.667 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-05-27T10:49:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-05-27T10:49:58.824 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-05-27T10:49:58.870 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-05-27T10:49:58.935 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-05-27T10:49:58.994 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-05-27T10:49:59.033 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-05-27T10:49:59.158 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-05-27T10:49:59.230 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-05-27T10:49:59.275 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-05-27T10:49:59.332 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-05-27T10:49:59.447 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-05-27T10:49:59.488 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-common-2:19.0.0-3154.g81797d87.el9. 34/170 2024-05-27T10:49:59.538 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-argparse-2:19.0.0-3154.g81797d87.el 35/170 2024-05-27T10:49:59.570 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cephfs-2:19.0.0-3154.g81797d87.el9.x86_6 36/170 2024-05-27T10:49:59.692 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-05-27T10:49:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-05-27T10:49:59.960 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-05-27T10:50:00.157 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-05-27T10:50:00.226 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-05-27T10:50:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-05-27T10:50:01.087 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-05-27T10:50:01.125 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-05-27T10:50:01.165 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-05-27T10:50:01.231 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-05-27T10:50:01.287 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librados-devel-2:19.0.0-3154.g81797d87.el9.x86_6 47/170 2024-05-27T10:50:01.360 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-05-27T10:50:01.494 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 109/170 2024-05-27T10:50:01.541 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 109/170 2024-05-27T10:50:01.594 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-05-27T10:50:01.688 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-05-27T10:50:01.769 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-05-27T10:50:01.893 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-05-27T10:50:01.930 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-05-27T10:50:01.967 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-05-27T10:50:02.037 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-05-27T10:50:02.085 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-05-27T10:50:02.148 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-05-27T10:50:02.215 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-05-27T10:50:02.234 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 109/170 2024-05-27T10:50:02.286 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-base-2:19.0.0-3154.g81797d87.el9.x86_64 110/170 2024-05-27T10:50:02.428 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-05-27T10:50:02.488 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-base-2:19.0.0-3154.g81797d87.el9.x86_64 110/170 2024-05-27T10:50:02.488 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-27T10:50:02.488 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-27T10:50:02.488 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:50:02.495 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-05-27T10:50:02.520 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-selinux-2:19.0.0-3154.g81797d87.el9.x86_64 111/170 2024-05-27T10:50:02.550 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-05-27T10:50:02.684 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-05-27T10:50:02.727 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-05-27T10:50:02.772 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-05-27T10:50:02.809 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-05-27T10:50:02.844 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-05-27T10:50:03.063 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-05-27T10:50:03.245 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-05-27T10:50:03.320 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-05-27T10:50:03.366 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-05-27T10:50:03.426 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-05-27T10:50:03.493 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-05-27T10:50:03.550 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-05-27T10:50:03.598 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-05-27T10:50:03.644 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-05-27T10:50:03.695 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-05-27T10:50:03.772 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-05-27T10:50:03.816 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-05-27T10:50:03.967 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-05-27T10:50:04.029 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-05-27T10:50:04.072 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-05-27T10:50:04.170 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-05-27T10:50:04.336 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-05-27T10:50:04.404 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-05-27T10:50:05.432 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-05-27T10:50:05.485 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-05-27T10:50:05.519 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-05-27T10:50:05.650 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-05-27T10:50:05.712 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-05-27T10:50:05.766 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-05-27T10:50:05.898 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-05-27T10:50:05.938 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-05-27T10:50:06.171 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-05-27T10:50:06.209 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-05-27T10:50:06.321 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-05-27T10:50:07.205 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-05-27T10:50:07.363 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-05-27T10:50:09.099 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-05-27T10:50:09.199 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-05-27T10:50:09.237 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-05-27T10:50:09.271 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-05-27T10:50:09.691 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-05-27T10:50:09.737 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librbd1-2:19.0.0-3154.g81797d87.el9.x86_64 103/170 2024-05-27T10:50:09.862 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:19.0.0-3154.g81797d87.el9.x86_64 103/170 2024-05-27T10:50:09.895 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rbd-2:19.0.0-3154.g81797d87.el9.x86_64 104/170 2024-05-27T10:50:09.955 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-05-27T10:50:10.553 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-05-27T10:50:10.590 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librgw2-2:19.0.0-3154.g81797d87.el9.x86_64 107/170 2024-05-27T10:50:10.692 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librgw2-2:19.0.0-3154.g81797d87.el9.x86_64 107/170 2024-05-27T10:50:10.717 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rgw-2:19.0.0-3154.g81797d87.el9.x86_64 108/170 2024-05-27T10:50:13.605 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 109/170 2024-05-27T10:50:13.649 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 109/170 2024-05-27T10:50:14.323 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 109/170 2024-05-27T10:50:14.369 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-base-2:19.0.0-3154.g81797d87.el9.x86_64 110/170 2024-05-27T10:50:14.549 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-base-2:19.0.0-3154.g81797d87.el9.x86_64 110/170 2024-05-27T10:50:14.549 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-27T10:50:14.549 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-27T10:50:14.549 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:50:14.595 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-selinux-2:19.0.0-3154.g81797d87.el9.x86_64 111/170 2024-05-27T10:50:16.197 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3154.g81797d87.el9.x86_64 111/170 2024-05-27T10:50:16.197 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /sys 2024-05-27T10:50:16.198 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /proc 2024-05-27T10:50:16.198 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /mnt 2024-05-27T10:50:16.198 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /var/tmp 2024-05-27T10:50:16.198 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /home 2024-05-27T10:50:16.198 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /root 2024-05-27T10:50:16.198 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /tmp 2024-05-27T10:50:16.198 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:50:16.444 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-volume-2:19.0.0-3154.g81797d87.el9.noarch 112/170 2024-05-27T10:50:16.495 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-volume-2:19.0.0-3154.g81797d87.el9.noarch 112/170 2024-05-27T10:50:16.495 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T10:50:16.496 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-27T10:50:16.496 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:50:18.229 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-osd-2:19.0.0-3154.g81797d87.el9.x86_64 113/170 2024-05-27T10:50:18.313 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-osd-2:19.0.0-3154.g81797d87.el9.x86_64 113/170 2024-05-27T10:50:18.314 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T10:50:18.314 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-27T10:50:18.314 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-27T10:50:18.314 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-27T10:50:18.314 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:50:18.587 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mds-2:19.0.0-3154.g81797d87.el9.x86_64 114/170 2024-05-27T10:50:18.660 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mds-2:19.0.0-3154.g81797d87.el9.x86_64 114/170 2024-05-27T10:50:18.660 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T10:50:18.660 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-27T10:50:18.661 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-27T10:50:18.661 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-27T10:50:18.661 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:50:19.171 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mon-2:19.0.0-3154.g81797d87.el9.x86_64 115/170 2024-05-27T10:50:19.248 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mon-2:19.0.0-3154.g81797d87.el9.x86_64 115/170 2024-05-27T10:50:19.248 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T10:50:19.248 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-27T10:50:19.248 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-27T10:50:19.248 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-27T10:50:19.248 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:50:19.397 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-05-27T10:50:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-05-27T10:50:19.537 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-05-27T10:50:19.782 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-05-27T10:50:19.843 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-05-27T10:50:19.933 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-05-27T10:50:20.050 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-05-27T10:50:20.258 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-05-27T10:50:20.318 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-05-27T10:50:20.358 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-05-27T10:50:20.390 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-05-27T10:50:21.015 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:19.0.0-3154.g81797d87.el9.noarch 127/170 2024-05-27T10:50:21.069 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephadm-2:19.0.0-3154.g81797d87.el9.noarch 127/170 2024-05-27T10:50:21.129 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3154.g81797d87.e 128/170 2024-05-27T10:50:21.250 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3154.g81797d87. 129/170 2024-05-27T10:50:21.287 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3154.g81797d87.el9.noa 130/170 2024-05-27T10:50:22.675 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3154.g81797d87.el9.noa 130/170 2024-05-27T10:50:22.713 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3154.g81797d87.el9.n 131/170 2024-05-27T10:50:23.880 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3154.g81797d87.el9.n 131/170 2024-05-27T10:50:23.924 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3154.g817 132/170 2024-05-27T10:50:24.079 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3154.g817 132/170 2024-05-27T10:50:24.263 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3154.g81797d87.el 133/170 2024-05-27T10:50:24.290 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-2:19.0.0-3154.g81797d87.el9.x86_64 134/170 2024-05-27T10:50:24.365 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3154.g81797d87.el9.x86_64 134/170 2024-05-27T10:50:24.365 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T10:50:24.365 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-27T10:50:24.365 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-27T10:50:24.365 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-27T10:50:24.365 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:50:24.422 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-rook-2:19.0.0-3154.g81797d87.el9.noarch 135/170 2024-05-27T10:50:24.461 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3154.g81797d87.el9.noarch 135/170 2024-05-27T10:50:24.615 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-2:19.0.0-3154.g81797d87.el9.x86_64 136/170 2024-05-27T10:50:24.694 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 137/170 2024-05-27T10:50:25.802 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-05-27T10:50:25.853 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-radosgw-2:19.0.0-3154.g81797d87.el9.x86_64 139/170 2024-05-27T10:50:25.928 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3154.g81797d87.el9.x86_64 139/170 2024-05-27T10:50:25.928 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T10:50:25.928 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-27T10:50:25.928 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-27T10:50:25.928 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-27T10:50:25.928 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:50:25.975 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3154.g81797 140/170 2024-05-27T10:50:26.054 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3154.g81797 140/170 2024-05-27T10:50:26.054 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T10:50:26.055 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-27T10:50:26.055 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:50:26.134 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 141/170 2024-05-27T10:50:26.214 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 141/170 2024-05-27T10:50:26.214 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T10:50:26.214 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-27T10:50:26.214 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-27T10:50:26.215 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-27T10:50:26.215 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:50:26.601 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 142/170 2024-05-27T10:50:26.676 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 142/170 2024-05-27T10:50:26.676 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T10:50:26.676 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-27T10:50:26.676 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-27T10:50:26.677 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-27T10:50:26.677 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:50:27.862 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3154.g81797d87.el9.x86_64 111/170 2024-05-27T10:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /sys 2024-05-27T10:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /proc 2024-05-27T10:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /mnt 2024-05-27T10:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /var/tmp 2024-05-27T10:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /home 2024-05-27T10:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /root 2024-05-27T10:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /tmp 2024-05-27T10:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:50:28.095 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-volume-2:19.0.0-3154.g81797d87.el9.noarch 112/170 2024-05-27T10:50:28.147 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-volume-2:19.0.0-3154.g81797d87.el9.noarch 112/170 2024-05-27T10:50:28.148 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T10:50:28.148 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-27T10:50:28.148 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:50:29.839 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-osd-2:19.0.0-3154.g81797d87.el9.x86_64 113/170 2024-05-27T10:50:29.943 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-osd-2:19.0.0-3154.g81797d87.el9.x86_64 113/170 2024-05-27T10:50:29.943 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T10:50:29.943 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-27T10:50:29.944 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-27T10:50:29.944 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-27T10:50:29.944 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:50:30.253 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mds-2:19.0.0-3154.g81797d87.el9.x86_64 114/170 2024-05-27T10:50:30.329 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mds-2:19.0.0-3154.g81797d87.el9.x86_64 114/170 2024-05-27T10:50:30.329 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T10:50:30.329 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-27T10:50:30.329 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-27T10:50:30.329 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-27T10:50:30.329 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:50:30.865 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mon-2:19.0.0-3154.g81797d87.el9.x86_64 115/170 2024-05-27T10:50:30.940 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mon-2:19.0.0-3154.g81797d87.el9.x86_64 115/170 2024-05-27T10:50:30.940 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T10:50:30.940 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-27T10:50:30.940 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-27T10:50:30.941 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-27T10:50:30.941 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:50:31.109 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-05-27T10:50:31.174 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-05-27T10:50:31.262 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-05-27T10:50:31.526 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-05-27T10:50:31.596 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-05-27T10:50:31.685 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-05-27T10:50:31.803 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-05-27T10:50:31.976 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-05-27T10:50:31.999 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-test-2:19.0.0-3154.g81797d87.el9.x86_64 143/170 2024-05-27T10:50:32.050 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 144/170 2024-05-27T10:50:32.060 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-05-27T10:50:32.106 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-nbd-2:19.0.0-3154.g81797d87.el9.x86_64 145/170 2024-05-27T10:50:32.111 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-05-27T10:50:32.139 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-05-27T10:50:32.142 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-05-27T10:50:32.177 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-05-27T10:50:32.487 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-shell-2:19.0.0-3154.g81797d87.el9.x86_64 148/170 2024-05-27T10:50:32.545 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-05-27T10:50:32.602 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs-devel-2:19.0.0-3154.g81797d87.el9.x86_ 150/170 2024-05-27T10:50:32.642 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-05-27T10:50:32.689 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 152/170 2024-05-27T10:50:32.735 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 153/170 2024-05-27T10:50:32.781 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephadm-2:19.0.0-3154.g81797d87.el9.noarch 127/170 2024-05-27T10:50:32.825 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephadm-2:19.0.0-3154.g81797d87.el9.noarch 127/170 2024-05-27T10:50:32.885 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3154.g81797d87.e 128/170 2024-05-27T10:50:32.995 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3154.g81797d87. 129/170 2024-05-27T10:50:33.034 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3154.g81797d87.el9.noa 130/170 2024-05-27T10:50:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T10:50:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T10:50:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T10:50:34.402 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3154.g81797d87.el9.noa 130/170 2024-05-27T10:50:34.453 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3154.g81797d87.el9.n 131/170 2024-05-27T10:50:35.180 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-top-2:19.0.0-3154.g81797d87.el9.noarch 155/170 2024-05-27T10:50:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-05-27T10:50:35.345 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-05-27T10:50:35.487 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-05-27T10:50:35.523 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-05-27T10:50:35.564 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-27T10:50:35.600 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-05-27T10:50:35.629 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3154.g81797d87.el9.n 131/170 2024-05-27T10:50:35.641 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-05-27T10:50:35.641 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-27T10:50:35.669 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3154.g817 132/170 2024-05-27T10:50:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-27T10:50:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-05-27T10:50:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-27T10:50:35.827 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3154.g817 132/170 2024-05-27T10:50:35.932 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-27T10:50:35.970 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-05-27T10:50:36.005 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T10:50:36.005 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T10:50:36.018 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3154.g81797d87.el 133/170 2024-05-27T10:50:36.064 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-2:19.0.0-3154.g81797d87.el9.x86_64 134/170 2024-05-27T10:50:36.157 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3154.g81797d87.el9.x86_64 134/170 2024-05-27T10:50:36.157 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T10:50:36.157 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-27T10:50:36.157 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-27T10:50:36.157 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-27T10:50:36.157 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:50:36.222 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-rook-2:19.0.0-3154.g81797d87.el9.noarch 135/170 2024-05-27T10:50:36.263 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3154.g81797d87.el9.noarch 135/170 2024-05-27T10:50:36.371 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T10:50:36.371 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-27T10:50:36.403 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-2:19.0.0-3154.g81797d87.el9.x86_64 136/170 2024-05-27T10:50:36.472 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 137/170 2024-05-27T10:50:36.520 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-27T10:50:36.566 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-05-27T10:50:36.689 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-27T10:50:36.963 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-27T10:50:36.963 INFO:teuthology.orchestra.run.smithi047.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-27T10:50:36.963 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:50:37.531 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-05-27T10:50:37.566 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-radosgw-2:19.0.0-3154.g81797d87.el9.x86_64 139/170 2024-05-27T10:50:37.646 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3154.g81797d87.el9.x86_64 139/170 2024-05-27T10:50:37.646 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T10:50:37.646 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-27T10:50:37.646 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-27T10:50:37.646 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-27T10:50:37.646 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:50:37.692 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3154.g81797 140/170 2024-05-27T10:50:37.765 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3154.g81797 140/170 2024-05-27T10:50:37.766 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T10:50:37.766 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-27T10:50:37.766 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:50:37.842 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephfs-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 141/170 2024-05-27T10:50:37.932 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 141/170 2024-05-27T10:50:37.932 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T10:50:37.933 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-27T10:50:37.933 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-27T10:50:37.933 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-27T10:50:37.933 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:50:38.293 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 142/170 2024-05-27T10:50:38.375 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 142/170 2024-05-27T10:50:38.375 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T10:50:38.375 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-27T10:50:38.376 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-27T10:50:38.376 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-27T10:50:38.376 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:50:42.704 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-2:19.0.0-3154.g81797d87.el9.x86_64 1/170 2024-05-27T10:50:42.704 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-base-2:19.0.0-3154.g81797d87.el9.x86_64 2/170 2024-05-27T10:50:42.704 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 3/170 2024-05-27T10:50:42.704 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 4/170 2024-05-27T10:50:42.704 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3154.g81797 5/170 2024-05-27T10:50:42.705 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mds-2:19.0.0-3154.g81797d87.el9.x86_64 6/170 2024-05-27T10:50:42.705 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-2:19.0.0-3154.g81797d87.el9.x86_64 7/170 2024-05-27T10:50:42.705 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mon-2:19.0.0-3154.g81797d87.el9.x86_64 8/170 2024-05-27T10:50:42.705 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-osd-2:19.0.0-3154.g81797d87.el9.x86_64 9/170 2024-05-27T10:50:42.705 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-radosgw-2:19.0.0-3154.g81797d87.el9.x86_64 10/170 2024-05-27T10:50:42.705 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-selinux-2:19.0.0-3154.g81797d87.el9.x86_64 11/170 2024-05-27T10:50:42.705 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-test-2:19.0.0-3154.g81797d87.el9.x86_64 12/170 2024-05-27T10:50:42.705 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 13/170 2024-05-27T10:50:42.705 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-shell-2:19.0.0-3154.g81797d87.el9.x86_64 14/170 2024-05-27T10:50:42.706 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs-devel-2:19.0.0-3154.g81797d87.el9.x86_ 15/170 2024-05-27T10:50:42.706 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs2-2:19.0.0-3154.g81797d87.el9.x86_64 16/170 2024-05-27T10:50:42.706 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephsqlite-2:19.0.0-3154.g81797d87.el9.x86_64 17/170 2024-05-27T10:50:42.706 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados-devel-2:19.0.0-3154.g81797d87.el9.x86_6 18/170 2024-05-27T10:50:42.706 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libradosstriper1-2:19.0.0-3154.g81797d87.el9.x86 19/170 2024-05-27T10:50:42.706 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librgw2-2:19.0.0-3154.g81797d87.el9.x86_64 20/170 2024-05-27T10:50:42.706 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3154.g81797d87.el 21/170 2024-05-27T10:50:42.706 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-common-2:19.0.0-3154.g81797d87.el9. 22/170 2024-05-27T10:50:42.706 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cephfs-2:19.0.0-3154.g81797d87.el9.x86_6 23/170 2024-05-27T10:50:42.706 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rados-2:19.0.0-3154.g81797d87.el9.x86_64 24/170 2024-05-27T10:50:42.706 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rbd-2:19.0.0-3154.g81797d87.el9.x86_64 25/170 2024-05-27T10:50:42.707 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rgw-2:19.0.0-3154.g81797d87.el9.x86_64 26/170 2024-05-27T10:50:42.707 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 27/170 2024-05-27T10:50:42.707 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 28/170 2024-05-27T10:50:42.707 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-nbd-2:19.0.0-3154.g81797d87.el9.x86_64 29/170 2024-05-27T10:50:42.707 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3154.g81797d87. 30/170 2024-05-27T10:50:42.707 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3154.g81797d87.el9.noa 31/170 2024-05-27T10:50:42.707 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3154.g81797d87.el9.n 32/170 2024-05-27T10:50:42.707 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3154.g817 33/170 2024-05-27T10:50:42.707 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3154.g81797d87.el 34/170 2024-05-27T10:50:42.707 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3154.g81797d87.el9.noarch 35/170 2024-05-27T10:50:42.707 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3154.g81797d87.e 36/170 2024-05-27T10:50:42.708 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-volume-2:19.0.0-3154.g81797d87.el9.noarch 37/170 2024-05-27T10:50:42.708 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephadm-2:19.0.0-3154.g81797d87.el9.noarch 38/170 2024-05-27T10:50:42.708 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-top-2:19.0.0-3154.g81797d87.el9.noarch 39/170 2024-05-27T10:50:42.708 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-05-27T10:50:42.708 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-05-27T10:50:42.708 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-05-27T10:50:42.709 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-05-27T10:50:42.709 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-05-27T10:50:42.709 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-05-27T10:50:42.709 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-05-27T10:50:42.709 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-05-27T10:50:42.709 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-05-27T10:50:42.709 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-05-27T10:50:42.709 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-05-27T10:50:42.709 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-05-27T10:50:42.709 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-05-27T10:50:42.710 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-05-27T10:50:42.710 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-05-27T10:50:42.710 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-05-27T10:50:42.710 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-05-27T10:50:42.710 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-05-27T10:50:42.710 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-05-27T10:50:42.710 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-05-27T10:50:42.710 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-05-27T10:50:42.710 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-05-27T10:50:42.711 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-05-27T10:50:42.711 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-05-27T10:50:42.711 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-05-27T10:50:42.711 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-05-27T10:50:42.711 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-05-27T10:50:42.711 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-05-27T10:50:42.711 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-05-27T10:50:42.711 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-05-27T10:50:42.711 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-05-27T10:50:42.712 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-05-27T10:50:42.712 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-05-27T10:50:42.712 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-05-27T10:50:42.712 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-05-27T10:50:42.712 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-05-27T10:50:42.712 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-05-27T10:50:42.712 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-05-27T10:50:42.712 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-05-27T10:50:42.712 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-05-27T10:50:42.712 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-05-27T10:50:42.713 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-05-27T10:50:42.713 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-05-27T10:50:42.713 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-05-27T10:50:42.713 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-05-27T10:50:42.713 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-05-27T10:50:42.713 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-05-27T10:50:42.713 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-05-27T10:50:42.713 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-05-27T10:50:42.713 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-05-27T10:50:42.713 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-05-27T10:50:42.713 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-05-27T10:50:42.713 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-05-27T10:50:42.713 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-05-27T10:50:42.713 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-05-27T10:50:42.714 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-05-27T10:50:42.714 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-05-27T10:50:42.714 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-05-27T10:50:42.714 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-05-27T10:50:42.714 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-05-27T10:50:42.714 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-05-27T10:50:42.714 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-05-27T10:50:42.714 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-05-27T10:50:42.714 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-05-27T10:50:42.714 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-05-27T10:50:42.715 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-05-27T10:50:42.715 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-05-27T10:50:42.715 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-05-27T10:50:42.715 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-05-27T10:50:42.715 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-05-27T10:50:42.715 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-05-27T10:50:42.715 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-05-27T10:50:42.715 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-05-27T10:50:42.715 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-05-27T10:50:42.715 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-05-27T10:50:42.715 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-05-27T10:50:42.715 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-05-27T10:50:42.715 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-05-27T10:50:42.715 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-05-27T10:50:42.716 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-05-27T10:50:42.716 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-05-27T10:50:42.716 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-05-27T10:50:42.716 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-05-27T10:50:42.716 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-05-27T10:50:42.716 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-05-27T10:50:42.716 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-05-27T10:50:42.716 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-05-27T10:50:42.716 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-05-27T10:50:42.716 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-05-27T10:50:42.716 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-05-27T10:50:42.716 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-05-27T10:50:42.716 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-05-27T10:50:42.716 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-05-27T10:50:42.717 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-05-27T10:50:42.717 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-05-27T10:50:42.717 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-05-27T10:50:42.717 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-05-27T10:50:42.717 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-05-27T10:50:42.717 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-05-27T10:50:42.717 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-05-27T10:50:42.717 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-05-27T10:50:42.717 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-05-27T10:50:42.717 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-05-27T10:50:42.717 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-05-27T10:50:42.717 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-05-27T10:50:42.717 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-05-27T10:50:42.717 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-05-27T10:50:42.718 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-05-27T10:50:42.718 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-05-27T10:50:42.718 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:19.0.0-3154.g81797d87.el9.x86_64 149/170 2024-05-27T10:50:42.718 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-05-27T10:50:42.718 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:19.0.0-3154.g81797d87.el9.x86_64 151/170 2024-05-27T10:50:42.718 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-05-27T10:50:42.718 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/170 2024-05-27T10:50:42.718 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-05-27T10:50:42.718 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/170 2024-05-27T10:50:42.718 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-05-27T10:50:42.718 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/170 2024-05-27T10:50:42.718 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-05-27T10:50:42.718 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/170 2024-05-27T10:50:42.718 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-27T10:50:42.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-05-27T10:50:42.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-05-27T10:50:42.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-05-27T10:50:42.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-05-27T10:50:42.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-05-27T10:50:42.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-05-27T10:50:42.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-05-27T10:50:42.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-05-27T10:50:42.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-05-27T10:50:43.691 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-test-2:19.0.0-3154.g81797d87.el9.x86_64 143/170 2024-05-27T10:50:43.743 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 144/170 2024-05-27T10:50:43.799 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-nbd-2:19.0.0-3154.g81797d87.el9.x86_64 145/170 2024-05-27T10:50:43.830 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-05-27T10:50:43.865 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-05-27T10:50:44.166 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephfs-shell-2:19.0.0-3154.g81797d87.el9.x86_64 148/170 2024-05-27T10:50:44.220 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-05-27T10:50:44.252 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs-devel-2:19.0.0-3154.g81797d87.el9.x86_ 150/170 2024-05-27T10:50:44.318 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-05-27T10:50:44.349 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 152/170 2024-05-27T10:50:44.452 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 153/170 2024-05-27T10:50:44.929 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-05-27T10:50:44.929 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:50:44.929 INFO:teuthology.orchestra.run.smithi047.stdout:Upgraded: 2024-05-27T10:50:44.929 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-27T10:50:44.929 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-27T10:50:44.929 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-27T10:50:44.930 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-27T10:50:44.930 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-05-27T10:50:44.930 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-05-27T10:50:44.930 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-05-27T10:50:44.930 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.930 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.930 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-27T10:50:44.930 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-27T10:50:44.930 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-05-27T10:50:44.930 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-27T10:50:44.931 INFO:teuthology.orchestra.run.smithi047.stdout: automake-1.16.2-8.el9.noarch 2024-05-27T10:50:44.931 INFO:teuthology.orchestra.run.smithi047.stdout: bison-3.7.4-5.el9.x86_64 2024-05-27T10:50:44.931 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-27T10:50:44.931 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.931 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.931 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.931 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.931 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T10:50:44.931 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.931 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.931 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.932 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T10:50:44.932 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T10:50:44.932 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T10:50:44.932 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T10:50:44.932 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T10:50:44.932 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.932 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.932 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T10:50:44.932 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.932 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.933 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.933 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T10:50:44.933 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T10:50:44.933 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.933 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-shell-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.933 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T10:50:44.933 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-05-27T10:50:44.933 INFO:teuthology.orchestra.run.smithi047.stdout: flex-2.6.4-9.el9.x86_64 2024-05-27T10:50:44.933 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-27T10:50:44.933 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-27T10:50:44.933 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-27T10:50:44.934 INFO:teuthology.orchestra.run.smithi047.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-27T10:50:44.934 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-27T10:50:44.934 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-27T10:50:44.934 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-27T10:50:44.934 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-27T10:50:44.934 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-27T10:50:44.934 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.934 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.934 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.934 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-27T10:50:44.934 INFO:teuthology.orchestra.run.smithi047.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-27T10:50:44.935 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-27T10:50:44.935 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-27T10:50:44.935 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-27T10:50:44.935 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.935 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.935 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-27T10:50:44.935 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.935 INFO:teuthology.orchestra.run.smithi047.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-27T10:50:44.935 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-27T10:50:44.935 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-27T10:50:44.935 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-27T10:50:44.936 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-27T10:50:44.936 INFO:teuthology.orchestra.run.smithi047.stdout: lua-5.4.4-4.el9.x86_64 2024-05-27T10:50:44.936 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-27T10:50:44.936 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-27T10:50:44.936 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-27T10:50:44.936 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-27T10:50:44.936 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-27T10:50:44.936 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-27T10:50:44.936 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-13.14-1.el9.x86_64 2024-05-27T10:50:44.936 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-27T10:50:44.936 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-27T10:50:44.937 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-27T10:50:44.937 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-27T10:50:44.937 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-27T10:50:44.937 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-27T10:50:44.937 INFO:teuthology.orchestra.run.smithi047.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-27T10:50:44.937 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-27T10:50:44.937 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-27T10:50:44.937 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-27T10:50:44.937 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.937 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.937 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.937 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-27T10:50:44.938 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-27T10:50:44.938 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-27T10:50:44.938 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-27T10:50:44.938 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-27T10:50:44.938 INFO:teuthology.orchestra.run.smithi047.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-05-27T10:50:44.938 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-27T10:50:44.938 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-27T10:50:44.938 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-27T10:50:44.938 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-27T10:50:44.938 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-27T10:50:44.938 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-27T10:50:44.939 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-27T10:50:44.939 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-27T10:50:44.939 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-27T10:50:44.939 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-27T10:50:44.939 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-05-27T10:50:44.939 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-27T10:50:44.939 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-27T10:50:44.939 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-27T10:50:44.939 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-27T10:50:44.939 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-27T10:50:44.939 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-27T10:50:44.940 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-27T10:50:44.940 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-27T10:50:44.940 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-27T10:50:44.940 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-27T10:50:44.940 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-27T10:50:44.940 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-27T10:50:44.940 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-27T10:50:44.940 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply-3.11-14.el9.noarch 2024-05-27T10:50:44.940 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-27T10:50:44.940 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-27T10:50:44.940 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-27T10:50:44.940 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-27T10:50:44.941 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-27T10:50:44.941 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-27T10:50:44.941 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-27T10:50:44.941 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-27T10:50:44.941 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-27T10:50:44.941 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.941 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.941 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-27T10:50:44.941 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-27T10:50:44.941 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-27T10:50:44.941 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.941 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-27T10:50:44.942 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-27T10:50:44.942 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-27T10:50:44.942 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-27T10:50:44.942 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-27T10:50:44.942 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-27T10:50:44.942 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-27T10:50:44.942 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-27T10:50:44.942 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-27T10:50:44.942 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-27T10:50:44.942 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-27T10:50:44.942 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-27T10:50:44.943 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-27T10:50:44.943 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-27T10:50:44.943 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-27T10:50:44.943 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.943 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.943 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:44.943 INFO:teuthology.orchestra.run.smithi047.stdout: re2-1:20211101-3.el9.x86_64 2024-05-27T10:50:44.943 INFO:teuthology.orchestra.run.smithi047.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-27T10:50:44.943 INFO:teuthology.orchestra.run.smithi047.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-27T10:50:44.943 INFO:teuthology.orchestra.run.smithi047.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-27T10:50:44.943 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-27T10:50:44.943 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-27T10:50:44.944 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-27T10:50:44.944 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:50:44.944 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-05-27T10:50:45.361 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T10:50:45.416 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T10:50:45.480 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T10:50:45.595 DEBUG:teuthology.parallel:result is None 2024-05-27T10:50:46.922 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephfs-top-2:19.0.0-3154.g81797d87.el9.noarch 155/170 2024-05-27T10:50:47.030 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-05-27T10:50:47.089 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-05-27T10:50:47.228 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-05-27T10:50:47.265 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-05-27T10:50:47.290 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-27T10:50:47.325 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-05-27T10:50:47.365 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-05-27T10:50:47.365 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-27T10:50:47.483 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-27T10:50:47.528 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-05-27T10:50:47.529 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-27T10:50:47.673 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-27T10:50:47.737 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-05-27T10:50:47.772 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T10:50:47.772 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T10:50:48.096 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T10:50:48.096 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-27T10:50:48.230 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-27T10:50:48.273 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-05-27T10:50:48.399 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-27T10:50:48.658 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-27T10:50:48.658 INFO:teuthology.orchestra.run.smithi053.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-27T10:50:48.659 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:50:54.407 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-2:19.0.0-3154.g81797d87.el9.x86_64 1/170 2024-05-27T10:50:54.408 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-base-2:19.0.0-3154.g81797d87.el9.x86_64 2/170 2024-05-27T10:50:54.408 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 3/170 2024-05-27T10:50:54.408 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 4/170 2024-05-27T10:50:54.408 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3154.g81797 5/170 2024-05-27T10:50:54.408 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mds-2:19.0.0-3154.g81797d87.el9.x86_64 6/170 2024-05-27T10:50:54.408 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-2:19.0.0-3154.g81797d87.el9.x86_64 7/170 2024-05-27T10:50:54.408 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mon-2:19.0.0-3154.g81797d87.el9.x86_64 8/170 2024-05-27T10:50:54.408 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-osd-2:19.0.0-3154.g81797d87.el9.x86_64 9/170 2024-05-27T10:50:54.409 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-radosgw-2:19.0.0-3154.g81797d87.el9.x86_64 10/170 2024-05-27T10:50:54.409 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-selinux-2:19.0.0-3154.g81797d87.el9.x86_64 11/170 2024-05-27T10:50:54.409 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-test-2:19.0.0-3154.g81797d87.el9.x86_64 12/170 2024-05-27T10:50:54.409 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephfs-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 13/170 2024-05-27T10:50:54.409 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephfs-shell-2:19.0.0-3154.g81797d87.el9.x86_64 14/170 2024-05-27T10:50:54.409 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs-devel-2:19.0.0-3154.g81797d87.el9.x86_ 15/170 2024-05-27T10:50:54.409 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs2-2:19.0.0-3154.g81797d87.el9.x86_64 16/170 2024-05-27T10:50:54.409 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephsqlite-2:19.0.0-3154.g81797d87.el9.x86_64 17/170 2024-05-27T10:50:54.409 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados-devel-2:19.0.0-3154.g81797d87.el9.x86_6 18/170 2024-05-27T10:50:54.409 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libradosstriper1-2:19.0.0-3154.g81797d87.el9.x86 19/170 2024-05-27T10:50:54.409 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librgw2-2:19.0.0-3154.g81797d87.el9.x86_64 20/170 2024-05-27T10:50:54.409 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3154.g81797d87.el 21/170 2024-05-27T10:50:54.410 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-common-2:19.0.0-3154.g81797d87.el9. 22/170 2024-05-27T10:50:54.410 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cephfs-2:19.0.0-3154.g81797d87.el9.x86_6 23/170 2024-05-27T10:50:54.410 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rados-2:19.0.0-3154.g81797d87.el9.x86_64 24/170 2024-05-27T10:50:54.410 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rbd-2:19.0.0-3154.g81797d87.el9.x86_64 25/170 2024-05-27T10:50:54.410 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rgw-2:19.0.0-3154.g81797d87.el9.x86_64 26/170 2024-05-27T10:50:54.410 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 27/170 2024-05-27T10:50:54.424 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 28/170 2024-05-27T10:50:54.424 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-nbd-2:19.0.0-3154.g81797d87.el9.x86_64 29/170 2024-05-27T10:50:54.424 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3154.g81797d87. 30/170 2024-05-27T10:50:54.424 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3154.g81797d87.el9.noa 31/170 2024-05-27T10:50:54.424 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3154.g81797d87.el9.n 32/170 2024-05-27T10:50:54.424 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3154.g817 33/170 2024-05-27T10:50:54.424 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3154.g81797d87.el 34/170 2024-05-27T10:50:54.424 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3154.g81797d87.el9.noarch 35/170 2024-05-27T10:50:54.424 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3154.g81797d87.e 36/170 2024-05-27T10:50:54.424 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-volume-2:19.0.0-3154.g81797d87.el9.noarch 37/170 2024-05-27T10:50:54.424 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephadm-2:19.0.0-3154.g81797d87.el9.noarch 38/170 2024-05-27T10:50:54.425 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephfs-top-2:19.0.0-3154.g81797d87.el9.noarch 39/170 2024-05-27T10:50:54.425 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-05-27T10:50:54.425 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-05-27T10:50:54.425 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-05-27T10:50:54.425 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-05-27T10:50:54.425 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-05-27T10:50:54.425 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-05-27T10:50:54.425 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-05-27T10:50:54.425 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-05-27T10:50:54.425 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-05-27T10:50:54.425 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-05-27T10:50:54.425 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-05-27T10:50:54.426 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-05-27T10:50:54.426 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-05-27T10:50:54.426 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-05-27T10:50:54.426 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-05-27T10:50:54.426 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-05-27T10:50:54.426 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-05-27T10:50:54.426 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-05-27T10:50:54.426 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-05-27T10:50:54.426 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-05-27T10:50:54.426 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-05-27T10:50:54.426 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-05-27T10:50:54.426 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-05-27T10:50:54.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-05-27T10:50:54.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-05-27T10:50:54.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-05-27T10:50:54.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-05-27T10:50:54.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-05-27T10:50:54.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-05-27T10:50:54.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-05-27T10:50:54.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-05-27T10:50:54.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-05-27T10:50:54.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-05-27T10:50:54.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-05-27T10:50:54.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-05-27T10:50:54.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-05-27T10:50:54.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-05-27T10:50:54.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-05-27T10:50:54.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-05-27T10:50:54.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-05-27T10:50:54.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-05-27T10:50:54.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-05-27T10:50:54.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-05-27T10:50:54.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-05-27T10:50:54.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-05-27T10:50:54.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-05-27T10:50:54.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-05-27T10:50:54.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-05-27T10:50:54.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-05-27T10:50:54.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-05-27T10:50:54.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-05-27T10:50:54.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-05-27T10:50:54.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-05-27T10:50:54.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-05-27T10:50:54.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-05-27T10:50:54.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-05-27T10:50:54.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-05-27T10:50:54.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-05-27T10:50:54.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-05-27T10:50:54.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-05-27T10:50:54.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-05-27T10:50:54.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-05-27T10:50:54.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-05-27T10:50:54.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-05-27T10:50:54.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-05-27T10:50:54.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-05-27T10:50:54.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-05-27T10:50:54.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-05-27T10:50:54.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-05-27T10:50:54.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-05-27T10:50:54.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-05-27T10:50:54.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-05-27T10:50:54.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-05-27T10:50:54.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-05-27T10:50:54.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-05-27T10:50:54.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-05-27T10:50:54.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-05-27T10:50:54.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-05-27T10:50:54.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-05-27T10:50:54.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-05-27T10:50:54.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-05-27T10:50:54.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-05-27T10:50:54.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-05-27T10:50:54.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-05-27T10:50:54.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-05-27T10:50:54.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-05-27T10:50:54.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-05-27T10:50:54.432 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-05-27T10:50:54.432 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-05-27T10:50:54.432 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-05-27T10:50:54.432 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-05-27T10:50:54.432 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-05-27T10:50:54.432 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-05-27T10:50:54.432 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-05-27T10:50:54.432 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-05-27T10:50:54.432 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-05-27T10:50:54.432 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-05-27T10:50:54.432 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-05-27T10:50:54.432 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-05-27T10:50:54.432 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-05-27T10:50:54.433 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-05-27T10:50:54.433 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-05-27T10:50:54.433 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-05-27T10:50:54.433 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-05-27T10:50:54.433 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-05-27T10:50:54.433 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-05-27T10:50:54.433 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-05-27T10:50:54.433 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-05-27T10:50:54.433 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-05-27T10:50:54.433 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:19.0.0-3154.g81797d87.el9.x86_64 149/170 2024-05-27T10:50:54.434 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-05-27T10:50:54.434 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:19.0.0-3154.g81797d87.el9.x86_64 151/170 2024-05-27T10:50:54.434 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-05-27T10:50:54.434 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/170 2024-05-27T10:50:54.434 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-05-27T10:50:54.434 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/170 2024-05-27T10:50:54.434 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-05-27T10:50:54.434 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/170 2024-05-27T10:50:54.434 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-05-27T10:50:54.434 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/170 2024-05-27T10:50:54.434 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-27T10:50:54.434 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-05-27T10:50:54.434 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-05-27T10:50:54.435 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-05-27T10:50:54.435 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-05-27T10:50:54.435 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-05-27T10:50:54.435 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-05-27T10:50:54.435 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-05-27T10:50:54.435 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-05-27T10:50:54.435 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-05-27T10:50:56.757 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-05-27T10:50:56.758 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:50:56.758 INFO:teuthology.orchestra.run.smithi053.stdout:Upgraded: 2024-05-27T10:50:56.758 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-27T10:50:56.758 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-27T10:50:56.758 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-27T10:50:56.758 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-27T10:50:56.758 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-05-27T10:50:56.758 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-05-27T10:50:56.758 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-05-27T10:50:56.758 INFO:teuthology.orchestra.run.smithi053.stdout: librados2-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.759 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.759 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-27T10:50:56.759 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-27T10:50:56.759 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-05-27T10:50:56.759 INFO:teuthology.orchestra.run.smithi053.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-27T10:50:56.759 INFO:teuthology.orchestra.run.smithi053.stdout: automake-1.16.2-8.el9.noarch 2024-05-27T10:50:56.759 INFO:teuthology.orchestra.run.smithi053.stdout: bison-3.7.4-5.el9.x86_64 2024-05-27T10:50:56.759 INFO:teuthology.orchestra.run.smithi053.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-27T10:50:56.759 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.759 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.759 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.759 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.759 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T10:50:56.760 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.760 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.760 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.760 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T10:50:56.760 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T10:50:56.760 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T10:50:56.760 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T10:50:56.760 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T10:50:56.760 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.760 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.760 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T10:50:56.760 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.761 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.761 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.761 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T10:50:56.761 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T10:50:56.761 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.761 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-shell-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.761 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-top-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T10:50:56.761 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-05-27T10:50:56.761 INFO:teuthology.orchestra.run.smithi053.stdout: flex-2.6.4-9.el9.x86_64 2024-05-27T10:50:56.761 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-27T10:50:56.761 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-27T10:50:56.761 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-27T10:50:56.761 INFO:teuthology.orchestra.run.smithi053.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-27T10:50:56.762 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-27T10:50:56.762 INFO:teuthology.orchestra.run.smithi053.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-27T10:50:56.762 INFO:teuthology.orchestra.run.smithi053.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-27T10:50:56.762 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-27T10:50:56.762 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-27T10:50:56.762 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.762 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.762 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.762 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-27T10:50:56.762 INFO:teuthology.orchestra.run.smithi053.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-27T10:50:56.762 INFO:teuthology.orchestra.run.smithi053.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-27T10:50:56.762 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-27T10:50:56.762 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-27T10:50:56.763 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.763 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.763 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-27T10:50:56.763 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.763 INFO:teuthology.orchestra.run.smithi053.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-27T10:50:56.763 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-27T10:50:56.763 INFO:teuthology.orchestra.run.smithi053.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-27T10:50:56.763 INFO:teuthology.orchestra.run.smithi053.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-27T10:50:56.763 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-27T10:50:56.763 INFO:teuthology.orchestra.run.smithi053.stdout: lua-5.4.4-4.el9.x86_64 2024-05-27T10:50:56.763 INFO:teuthology.orchestra.run.smithi053.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-27T10:50:56.763 INFO:teuthology.orchestra.run.smithi053.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-27T10:50:56.763 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-27T10:50:56.764 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-27T10:50:56.764 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-27T10:50:56.764 INFO:teuthology.orchestra.run.smithi053.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-27T10:50:56.764 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-13.14-1.el9.x86_64 2024-05-27T10:50:56.764 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-27T10:50:56.764 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-27T10:50:56.764 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-27T10:50:56.764 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-27T10:50:56.764 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-27T10:50:56.764 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-27T10:50:56.764 INFO:teuthology.orchestra.run.smithi053.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-27T10:50:56.764 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-27T10:50:56.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-27T10:50:56.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-27T10:50:56.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-27T10:50:56.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-27T10:50:56.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-27T10:50:56.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-27T10:50:56.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-27T10:50:56.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-05-27T10:50:56.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-27T10:50:56.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-27T10:50:56.766 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-27T10:50:56.766 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-27T10:50:56.766 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-27T10:50:56.766 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-27T10:50:56.766 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-27T10:50:56.766 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-27T10:50:56.766 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-27T10:50:56.766 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-27T10:50:56.767 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-05-27T10:50:56.767 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-27T10:50:56.767 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-27T10:50:56.767 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-27T10:50:56.767 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-27T10:50:56.767 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-27T10:50:56.767 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-27T10:50:56.767 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-27T10:50:56.767 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-27T10:50:56.767 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-27T10:50:56.767 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-27T10:50:56.768 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-27T10:50:56.768 INFO:teuthology.orchestra.run.smithi053.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-27T10:50:56.768 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-27T10:50:56.768 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ply-3.11-14.el9.noarch 2024-05-27T10:50:56.768 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-27T10:50:56.768 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-27T10:50:56.768 INFO:teuthology.orchestra.run.smithi053.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-27T10:50:56.768 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-27T10:50:56.768 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-27T10:50:56.768 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-27T10:50:56.768 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-27T10:50:56.769 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-27T10:50:56.769 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-27T10:50:56.769 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.769 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.769 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-27T10:50:56.769 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-27T10:50:56.769 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-27T10:50:56.769 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.769 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-27T10:50:56.769 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-27T10:50:56.769 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-27T10:50:56.769 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-27T10:50:56.769 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-27T10:50:56.769 INFO:teuthology.orchestra.run.smithi053.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-27T10:50:56.770 INFO:teuthology.orchestra.run.smithi053.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-27T10:50:56.770 INFO:teuthology.orchestra.run.smithi053.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-27T10:50:56.770 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-27T10:50:56.770 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-27T10:50:56.770 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-27T10:50:56.770 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-27T10:50:56.770 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-27T10:50:56.770 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-27T10:50:56.770 INFO:teuthology.orchestra.run.smithi053.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-27T10:50:56.770 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.770 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.770 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T10:50:56.771 INFO:teuthology.orchestra.run.smithi053.stdout: re2-1:20211101-3.el9.x86_64 2024-05-27T10:50:56.771 INFO:teuthology.orchestra.run.smithi053.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-27T10:50:56.771 INFO:teuthology.orchestra.run.smithi053.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-27T10:50:56.771 INFO:teuthology.orchestra.run.smithi053.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-27T10:50:56.771 INFO:teuthology.orchestra.run.smithi053.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-27T10:50:56.771 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-27T10:50:56.771 INFO:teuthology.orchestra.run.smithi053.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-27T10:50:56.772 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:50:56.772 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-27T10:50:57.458 DEBUG:teuthology.parallel:result is None 2024-05-27T10:50:57.459 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=81797d879079e1a392b37a9c23a946594f658c50 2024-05-27T10:50:57.751 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-27T10:50:57.827 INFO:teuthology.orchestra.run.smithi047.stdout:19.0.0-3154.g81797d87.el9 2024-05-27T10:50:57.828 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3154.g81797d87.el9 2024-05-27T10:50:57.828 INFO:teuthology.task.install:The correct ceph version 19.0.0-3154.g81797d87 is installed. 2024-05-27T10:50:57.834 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=81797d879079e1a392b37a9c23a946594f658c50 2024-05-27T10:50:57.981 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-27T10:50:58.042 INFO:teuthology.orchestra.run.smithi053.stdout:19.0.0-3154.g81797d87.el9 2024-05-27T10:50:58.042 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3154.g81797d87.el9 2024-05-27T10:50:58.042 INFO:teuthology.task.install:The correct ceph version 19.0.0-3154.g81797d87 is installed. 2024-05-27T10:50:58.044 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-27T10:50:58.054 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:50:58.054 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-27T10:50:58.153 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:50:58.153 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-27T10:50:58.227 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-27T10:50:58.227 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:50:58.227 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-05-27T10:50:58.318 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-27T10:50:58.407 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:50:58.407 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/daemon-helper 2024-05-27T10:50:58.486 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-27T10:50:58.596 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-27T10:50:58.596 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:50:58.596 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-27T10:50:58.681 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-27T10:50:58.812 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:50:58.812 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-27T10:50:58.885 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-27T10:50:58.997 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-27T10:50:58.998 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:50:58.998 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-05-27T10:50:59.091 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-27T10:50:59.181 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:50:59.181 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/stdin-killer 2024-05-27T10:50:59.251 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-27T10:50:59.358 INFO:teuthology.run_tasks:Running task ceph... 2024-05-27T10:50:59.778 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-27T10:50:59.778 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /var/log/ceph 2024-05-27T10:50:59.786 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 777 /var/log/ceph 2024-05-27T10:50:59.875 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-27T10:50:59.875 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-27T10:50:59.883 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-27T10:50:59.965 INFO:tasks.ceph:Creating extra log directories... 2024-05-27T10:50:59.966 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-27T10:50:59.973 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-27T10:51:00.062 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-27T10:51:00.072 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-27T10:51:00.094 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-27T10:51:00.094 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:51:00.095 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-27T10:51:00.155 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-27T10:51:00.416 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-27T10:51:00.511 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:51:00.511 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-27T10:51:00.565 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-27T10:51:00.766 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-27T10:51:00.833 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-27T10:51:00.833 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-27T10:51:00.833 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-05-27_10:29:57-fs:volumes-rishabh-clone-stats-testing-default-smithi/7727872', 'branch': 'rishabh-clone-stats', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}}', 'email': None, 'first_in_suite': False, 'job_id': '7727872', 'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-05-27_10:29:57-fs:volumes-rishabh-clone-stats-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-clone-stats'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '81797d879079e1a392b37a9c23a946594f658c50'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '81797d879079e1a392b37a9c23a946594f658c50'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'mgr-vol-clone-stats', 'sha1': '6c790e41985923230aa0b50494ebab22e6b4e3f9'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4362, 'sha1': '81797d879079e1a392b37a9c23a946594f658c50', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'mgr-vol-clone-stats', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_6c790e41985923230aa0b50494ebab22e6b4e3f9/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '6c790e41985923230aa0b50494ebab22e6b4e3f9', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi047.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH5wLwSQ4H5Ebaj/0V9LKrZPsoMCwCFj2+UnTzcUHnWRsbCgEXVkDOJalCwigYmXvopVAGKFet5+XE8dTFdw3zQ=', 'smithi053.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHjO/euyQqI3if50vI1pDcEp5pAQrjvZrSix6pZEcNGKqWqcnJeNK4v8jssThi9S49ZiIPrgTeEqvT87dpcvXyo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '81797d879079e1a392b37a9c23a946594f658c50'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '81797d879079e1a392b37a9c23a946594f658c50', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestCloneProgressReporter']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e7ae7580c417d6ab27fda98fecadca5d9f85d63e', 'timestamp': '2024-05-27_10:29:57', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841'} 2024-05-27T10:51:00.834 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-27T10:51:00.842 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-27T10:51:00.895 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/run/ceph 2024-05-27T10:51:00.900 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/run/ceph 2024-05-27T10:51:00.986 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:51:00.986 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-05-27T10:51:01.041 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-27T10:51:01.041 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-05-27T10:51:01.094 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-27T10:51:01.094 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T10:51:01.094 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-05-27T10:51:01.094 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T10:51:01.094 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T10:51:01.094 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-27 10:50:37.401904686 +0000 2024-05-27T10:51:01.094 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-27 10:47:40.978489522 +0000 2024-05-27T10:51:01.097 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-27 10:47:40.978489522 +0000 2024-05-27T10:51:01.097 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-05-27 10:47:40.978489522 +0000 2024-05-27T10:51:01.098 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-27T10:51:01.181 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-27T10:51:01.181 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-27T10:51:01.181 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000264292 s, 1.9 MB/s 2024-05-27T10:51:01.185 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-27T10:51:01.247 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-05-27T10:51:01.306 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-27T10:51:01.306 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T10:51:01.306 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-05-27T10:51:01.306 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T10:51:01.306 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T10:51:01.306 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-27 10:50:37.402904665 +0000 2024-05-27T10:51:01.306 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-27 10:47:41.562476847 +0000 2024-05-27T10:51:01.306 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-27 10:47:41.562476847 +0000 2024-05-27T10:51:01.306 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-05-27 10:47:41.562476847 +0000 2024-05-27T10:51:01.307 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-27T10:51:01.390 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-27T10:51:01.390 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-27T10:51:01.390 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000252914 s, 2.0 MB/s 2024-05-27T10:51:01.394 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-27T10:51:01.456 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-05-27T10:51:01.509 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-27T10:51:01.509 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T10:51:01.509 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-05-27T10:51:01.509 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T10:51:01.510 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T10:51:01.510 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-27 10:50:37.403904643 +0000 2024-05-27T10:51:01.510 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-27 10:47:42.170463652 +0000 2024-05-27T10:51:01.510 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-27 10:47:42.170463652 +0000 2024-05-27T10:51:01.510 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-05-27 10:47:42.170463652 +0000 2024-05-27T10:51:01.510 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-27T10:51:01.591 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-27T10:51:01.592 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-27T10:51:01.592 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.00025348 s, 2.0 MB/s 2024-05-27T10:51:01.595 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-27T10:51:01.656 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-05-27T10:51:01.706 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-27T10:51:01.706 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T10:51:01.706 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-05-27T10:51:01.706 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T10:51:01.707 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T10:51:01.709 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-27 10:50:37.404904621 +0000 2024-05-27T10:51:01.710 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-27 10:47:42.742451237 +0000 2024-05-27T10:51:01.710 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-27 10:47:42.742451237 +0000 2024-05-27T10:51:01.710 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-05-27 10:47:42.742451237 +0000 2024-05-27T10:51:01.710 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-27T10:51:01.792 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-27T10:51:01.792 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-27T10:51:01.792 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000259911 s, 2.0 MB/s 2024-05-27T10:51:01.796 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-27T10:51:01.854 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-27T10:51:01.854 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:51:01.854 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/scratch_devs of=/dev/stdout 2024-05-27T10:51:01.903 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-27T10:51:01.903 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_1 2024-05-27T10:51:01.985 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-27T10:51:01.985 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T10:51:01.985 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-05-27T10:51:01.985 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T10:51:01.985 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T10:51:01.985 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-05-27 10:50:49.118286058 +0000 2024-05-27T10:51:01.985 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-05-27 10:47:43.043317180 +0000 2024-05-27T10:51:01.985 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-05-27 10:47:43.043317180 +0000 2024-05-27T10:51:01.986 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-05-27 10:47:43.043317180 +0000 2024-05-27T10:51:01.986 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-27T10:51:02.085 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-05-27T10:51:02.086 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-05-27T10:51:02.086 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000317985 s, 1.6 MB/s 2024-05-27T10:51:02.089 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-27T10:51:02.130 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_2 2024-05-27T10:51:02.217 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-27T10:51:02.217 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T10:51:02.218 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-05-27T10:51:02.218 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T10:51:02.218 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T10:51:02.219 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-05-27 10:50:49.119286039 +0000 2024-05-27T10:51:02.219 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-05-27 10:47:43.647305463 +0000 2024-05-27T10:51:02.219 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-05-27 10:47:43.647305463 +0000 2024-05-27T10:51:02.219 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-05-27 10:47:43.647305463 +0000 2024-05-27T10:51:02.219 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-27T10:51:02.285 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-05-27T10:51:02.285 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-05-27T10:51:02.285 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000242193 s, 2.1 MB/s 2024-05-27T10:51:02.288 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-27T10:51:02.329 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_3 2024-05-27T10:51:02.409 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-27T10:51:02.409 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T10:51:02.409 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-05-27T10:51:02.409 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T10:51:02.410 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T10:51:02.410 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-05-27 10:50:49.120286020 +0000 2024-05-27T10:51:02.410 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-05-27 10:47:44.262293534 +0000 2024-05-27T10:51:02.410 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-05-27 10:47:44.262293534 +0000 2024-05-27T10:51:02.410 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-05-27 10:47:44.262293534 +0000 2024-05-27T10:51:02.410 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-27T10:51:02.509 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-05-27T10:51:02.510 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-05-27T10:51:02.510 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000205556 s, 2.5 MB/s 2024-05-27T10:51:02.512 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-27T10:51:02.556 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_4 2024-05-27T10:51:02.657 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-27T10:51:02.657 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T10:51:02.657 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-05-27T10:51:02.657 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T10:51:02.657 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T10:51:02.657 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-05-27 10:50:49.120286020 +0000 2024-05-27T10:51:02.658 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-05-27 10:47:44.871281720 +0000 2024-05-27T10:51:02.658 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-05-27 10:47:44.871281720 +0000 2024-05-27T10:51:02.658 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-05-27 10:47:44.871281720 +0000 2024-05-27T10:51:02.658 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-27T10:51:02.741 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-05-27T10:51:02.741 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-05-27T10:51:02.741 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000275298 s, 1.9 MB/s 2024-05-27T10:51:02.745 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-27T10:51:02.804 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-27T10:51:02.805 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-27T10:51:02.805 INFO:tasks.ceph:Generating config... 2024-05-27T10:51:02.830 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-27T10:51:02.830 INFO:tasks.ceph:[client] debug client = 20 2024-05-27T10:51:02.830 INFO:tasks.ceph:[client] debug ms = 1 2024-05-27T10:51:02.830 INFO:tasks.ceph:[client] pid file = 2024-05-27T10:51:02.831 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-27T10:51:02.831 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-27T10:51:02.831 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-27T10:51:02.831 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-27T10:51:02.831 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-27T10:51:02.831 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-27T10:51:02.831 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-27T10:51:02.831 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-27T10:51:02.831 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-27T10:51:02.831 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-27T10:51:02.831 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-27T10:51:02.832 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-27T10:51:02.832 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-27T10:51:02.832 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-05-27T10:51:02.832 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-27T10:51:02.832 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-27T10:51:02.832 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-27T10:51:02.832 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-27T10:51:02.832 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-27T10:51:02.832 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-27T10:51:02.832 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-27T10:51:02.832 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-27T10:51:02.833 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-27T10:51:02.833 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-27T10:51:02.833 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-27T10:51:02.833 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-27T10:51:02.833 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-27T10:51:02.833 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-27T10:51:02.833 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-27T10:51:02.833 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-27T10:51:02.833 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-27T10:51:02.833 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-27T10:51:02.833 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-27T10:51:02.834 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-27T10:51:02.834 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-27T10:51:02.834 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-27T10:51:02.834 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-27T10:51:02.834 INFO:tasks.ceph:Setting up mon.a... 2024-05-27T10:51:02.834 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-27T10:51:02.985 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/ceph.keyring 2024-05-27T10:51:02.994 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-27T10:51:03.127 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-27T10:51:03.214 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.47'), ('mon.b', '172.21.15.53'), ('mon.c', '[v2:172.21.15.53:3301,v1:172.21.15.53:6790]')] 2024-05-27T10:51:03.214 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.47,172.21.15.53,[v2:172.21.15.53:3301,v1:172.21.15.53:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-27T10:51:03.215 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:51:03.215 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-27T10:51:03.276 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.47 --add b 172.21.15.53 --addv c '[v2:172.21.15.53:3301,v1:172.21.15.53:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-27T10:51:03.434 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-27T10:51:03.434 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: generated fsid 7b0baa11-ae73-495b-918f-c8db2aa0510f 2024-05-27T10:51:03.434 INFO:teuthology.orchestra.run.smithi047.stdout:setting min_mon_release = quincy 2024-05-27T10:51:03.434 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 0 2024-05-27T10:51:03.435 INFO:teuthology.orchestra.run.smithi047.stdout:fsid 7b0baa11-ae73-495b-918f-c8db2aa0510f 2024-05-27T10:51:03.435 INFO:teuthology.orchestra.run.smithi047.stdout:last_changed 2024-05-27T10:51:03.437239+0000 2024-05-27T10:51:03.435 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-05-27T10:51:03.437239+0000 2024-05-27T10:51:03.435 INFO:teuthology.orchestra.run.smithi047.stdout:min_mon_release 17 (quincy) 2024-05-27T10:51:03.435 INFO:teuthology.orchestra.run.smithi047.stdout:election_strategy: 1 2024-05-27T10:51:03.435 INFO:teuthology.orchestra.run.smithi047.stdout:0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-05-27T10:51:03.435 INFO:teuthology.orchestra.run.smithi047.stdout:1: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.b 2024-05-27T10:51:03.435 INFO:teuthology.orchestra.run.smithi047.stdout:2: [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] mon.c 2024-05-27T10:51:03.435 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-27T10:51:03.438 DEBUG:teuthology.orchestra.run.smithi047:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-27T10:51:03.488 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7b0baa11-ae73-495b-918f-c8db2aa0510f... 2024-05-27T10:51:03.489 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-27T10:51:03.494 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-27T10:51:03.632 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-05-27T10:51:03.632 INFO:teuthology.orchestra.run.smithi047.stdout: chdir = "" 2024-05-27T10:51:03.633 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-27T10:51:03.633 INFO:teuthology.orchestra.run.smithi047.stdout: auth supported = cephx 2024-05-27T10:51:03.633 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.633 INFO:teuthology.orchestra.run.smithi047.stdout: filestore xattr use omap = true 2024-05-27T10:51:03.633 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.633 INFO:teuthology.orchestra.run.smithi047.stdout: mon clock drift allowed = 1.000 2024-05-27T10:51:03.633 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.633 INFO:teuthology.orchestra.run.smithi047.stdout: osd crush chooseleaf type = 0 2024-05-27T10:51:03.633 INFO:teuthology.orchestra.run.smithi047.stdout: auth debug = true 2024-05-27T10:51:03.633 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.633 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on old message = true 2024-05-27T10:51:03.634 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on bug = true 2024-05-27T10:51:03.634 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.634 INFO:teuthology.orchestra.run.smithi047.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-27T10:51:03.634 INFO:teuthology.orchestra.run.smithi047.stdout: mon pg warn max object skew = 0 2024-05-27T10:51:03.634 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.634 INFO:teuthology.orchestra.run.smithi047.stdout: # disable pg_autoscaler by default for new pools 2024-05-27T10:51:03.634 INFO:teuthology.orchestra.run.smithi047.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-27T10:51:03.634 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.634 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default size = 2 2024-05-27T10:51:03.634 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.634 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow primary affinity = true 2024-05-27T10:51:03.634 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow pg remap = true 2024-05-27T10:51:03.635 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on legacy crush tunables = false 2024-05-27T10:51:03.635 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on crush straw calc version zero = false 2024-05-27T10:51:03.635 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on no sortbitwise = false 2024-05-27T10:51:03.635 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on osd down out interval zero = false 2024-05-27T10:51:03.635 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on too few osds = false 2024-05-27T10:51:03.635 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-27T10:51:03.635 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-27T10:51:03.635 INFO:teuthology.orchestra.run.smithi047.stdout: mon_allow_pool_size_one = true 2024-05-27T10:51:03.635 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.635 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-27T10:51:03.635 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.635 INFO:teuthology.orchestra.run.smithi047.stdout: osd default data pool replay window = 5 2024-05-27T10:51:03.635 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.635 INFO:teuthology.orchestra.run.smithi047.stdout: mon allow pool delete = true 2024-05-27T10:51:03.636 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.636 INFO:teuthology.orchestra.run.smithi047.stdout: mon cluster log file level = debug 2024-05-27T10:51:03.636 INFO:teuthology.orchestra.run.smithi047.stdout: debug asserts on shutdown = true 2024-05-27T10:51:03.636 INFO:teuthology.orchestra.run.smithi047.stdout: mon health detail to clog = false 2024-05-27T10:51:03.636 INFO:teuthology.orchestra.run.smithi047.stdout: mon host = "172.21.15.47,172.21.15.53,[v2:172.21.15.53:3301,v1:172.21.15.53:6790]" 2024-05-27T10:51:03.636 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = 7b0baa11-ae73-495b-918f-c8db2aa0510f 2024-05-27T10:51:03.636 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.636 INFO:teuthology.orchestra.run.smithi047.stdout:[osd] 2024-05-27T10:51:03.636 INFO:teuthology.orchestra.run.smithi047.stdout: osd journal size = 100 2024-05-27T10:51:03.636 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.636 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub load threshold = 5.0 2024-05-27T10:51:03.636 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub max interval = 600 2024-05-27T10:51:03.637 INFO:teuthology.orchestra.run.smithi047.stdout: osd mclock profile = high_recovery_ops 2024-05-27T10:51:03.637 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.637 INFO:teuthology.orchestra.run.smithi047.stdout: osd recover clone overlap = true 2024-05-27T10:51:03.637 INFO:teuthology.orchestra.run.smithi047.stdout: osd recovery max chunk = 1048576 2024-05-27T10:51:03.637 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.637 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug shutdown = true 2024-05-27T10:51:03.637 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug op order = true 2024-05-27T10:51:03.637 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug verify stray on activate = true 2024-05-27T10:51:03.637 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug trim objects = true 2024-05-27T10:51:03.637 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.637 INFO:teuthology.orchestra.run.smithi047.stdout: osd open classes on start = true 2024-05-27T10:51:03.637 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug pg log writeout = true 2024-05-27T10:51:03.638 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.638 INFO:teuthology.orchestra.run.smithi047.stdout: osd deep scrub update digest min age = 30 2024-05-27T10:51:03.638 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.638 INFO:teuthology.orchestra.run.smithi047.stdout: osd map max advance = 10 2024-05-27T10:51:03.638 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.638 INFO:teuthology.orchestra.run.smithi047.stdout: journal zero on create = true 2024-05-27T10:51:03.638 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.638 INFO:teuthology.orchestra.run.smithi047.stdout: filestore ondisk finisher threads = 3 2024-05-27T10:51:03.638 INFO:teuthology.orchestra.run.smithi047.stdout: filestore apply finisher threads = 3 2024-05-27T10:51:03.638 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.639 INFO:teuthology.orchestra.run.smithi047.stdout: bdev debug aio = true 2024-05-27T10:51:03.639 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug misdirected ops = true 2024-05-27T10:51:03.639 INFO:teuthology.orchestra.run.smithi047.stdout: bdev async discard = True 2024-05-27T10:51:03.639 INFO:teuthology.orchestra.run.smithi047.stdout: bdev enable discard = True 2024-05-27T10:51:03.639 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore allocator = bitmap 2024-05-27T10:51:03.639 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore block size = 96636764160 2024-05-27T10:51:03.639 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore fsck on mount = True 2024-05-27T10:51:03.639 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluefs = 1/20 2024-05-27T10:51:03.639 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluestore = 1/20 2024-05-27T10:51:03.639 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-27T10:51:03.640 INFO:teuthology.orchestra.run.smithi047.stdout: debug osd = 20 2024-05-27T10:51:03.640 INFO:teuthology.orchestra.run.smithi047.stdout: debug rocksdb = 4/10 2024-05-27T10:51:03.640 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd backfillfull_ratio = 0.85 2024-05-27T10:51:03.640 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd full ratio = 0.9 2024-05-27T10:51:03.640 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd nearfull ratio = 0.8 2024-05-27T10:51:03.640 INFO:teuthology.orchestra.run.smithi047.stdout: osd failsafe full ratio = 0.95 2024-05-27T10:51:03.640 INFO:teuthology.orchestra.run.smithi047.stdout: osd objectstore = bluestore 2024-05-27T10:51:03.640 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-05-27T10:51:03.640 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.640 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr] 2024-05-27T10:51:03.641 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-27T10:51:03.641 INFO:teuthology.orchestra.run.smithi047.stdout: debug mgr = 20 2024-05-27T10:51:03.641 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-05-27T10:51:03.641 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-05-27T10:51:03.641 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-05-27T10:51:03.641 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-05-27T10:51:03.641 INFO:teuthology.orchestra.run.smithi047.stdout: mgr/telemetry/nag = false 2024-05-27T10:51:03.641 INFO:teuthology.orchestra.run.smithi047.stdout: debug client = 20 2024-05-27T10:51:03.641 INFO:teuthology.orchestra.run.smithi047.stdout: debug finisher = 20 2024-05-27T10:51:03.641 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.641 INFO:teuthology.orchestra.run.smithi047.stdout:[mon] 2024-05-27T10:51:03.642 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-27T10:51:03.642 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-05-27T10:51:03.642 INFO:teuthology.orchestra.run.smithi047.stdout: debug paxos = 20 2024-05-27T10:51:03.642 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-05-27T10:51:03.642 INFO:teuthology.orchestra.run.smithi047.stdout: mon data avail warn = 5 2024-05-27T10:51:03.642 INFO:teuthology.orchestra.run.smithi047.stdout: mon mgr mkfs grace = 240 2024-05-27T10:51:03.642 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-05-27T10:51:03.642 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd reporter subtree level = osd 2024-05-27T10:51:03.642 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd prime pg temp = true 2024-05-27T10:51:03.642 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-05-27T10:51:03.643 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.643 INFO:teuthology.orchestra.run.smithi047.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-27T10:51:03.643 INFO:teuthology.orchestra.run.smithi047.stdout: auth mon ticket ttl = 660 # 11m 2024-05-27T10:51:03.643 INFO:teuthology.orchestra.run.smithi047.stdout: auth service ticket ttl = 240 # 4m 2024-05-27T10:51:03.643 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.643 INFO:teuthology.orchestra.run.smithi047.stdout: # don't complain about insecure global_id in the test suite 2024-05-27T10:51:03.643 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-27T10:51:03.643 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-27T10:51:03.643 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.643 INFO:teuthology.orchestra.run.smithi047.stdout: # 1m isn't quite enough 2024-05-27T10:51:03.643 INFO:teuthology.orchestra.run.smithi047.stdout: mon_down_mkfs_grace = 2m 2024-05-27T10:51:03.644 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.644 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_filestore_osds = false 2024-05-27T10:51:03.644 INFO:teuthology.orchestra.run.smithi047.stdout: mon down mkfs grace = 300 2024-05-27T10:51:03.644 INFO:teuthology.orchestra.run.smithi047.stdout: mon op complaint time = 120 2024-05-27T10:51:03.644 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:03.644 INFO:teuthology.orchestra.run.smithi047.stdout:[client] 2024-05-27T10:51:03.644 INFO:teuthology.orchestra.run.smithi047.stdout: rgw cache enabled = true 2024-05-27T10:51:03.644 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable ops log = true 2024-05-27T10:51:03.644 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable usage log = true 2024-05-27T10:51:03.644 INFO:teuthology.orchestra.run.smithi047.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-27T10:51:03.644 INFO:teuthology.orchestra.run.smithi047.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-27T10:51:03.645 INFO:teuthology.orchestra.run.smithi047.stdout: client mount timeout = 600 2024-05-27T10:51:03.645 INFO:teuthology.orchestra.run.smithi047.stdout: debug client = 20 2024-05-27T10:51:03.645 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-27T10:51:03.645 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = "" 2024-05-27T10:51:03.645 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-05-27T10:51:03.645 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-05-27T10:51:03.645 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.a] 2024-05-27T10:51:03.645 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.b] 2024-05-27T10:51:03.645 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.c] 2024-05-27T10:51:03.645 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-05-27T10:51:03.645 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c] 2024-05-27T10:51:03.646 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b] 2024-05-27T10:51:03.646 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d] 2024-05-27T10:51:03.646 INFO:teuthology.orchestra.run.smithi047.stdout:[mds] 2024-05-27T10:51:03.646 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds = 20 2024-05-27T10:51:03.646 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds balancer = 20 2024-05-27T10:51:03.646 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-27T10:51:03.646 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug frag = True 2024-05-27T10:51:03.646 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug scatterstat = True 2024-05-27T10:51:03.646 INFO:teuthology.orchestra.run.smithi047.stdout: mds op complaint time = 180 2024-05-27T10:51:03.646 INFO:teuthology.orchestra.run.smithi047.stdout: mds verify scatter = True 2024-05-27T10:51:03.647 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-05-27T10:51:03.647 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-05-27T10:51:03.647 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-05-27T10:51:03.647 INFO:teuthology.orchestra.run.smithi053.stdout:[global] 2024-05-27T10:51:03.647 INFO:teuthology.orchestra.run.smithi053.stdout: chdir = "" 2024-05-27T10:51:03.647 INFO:teuthology.orchestra.run.smithi053.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-27T10:51:03.647 INFO:teuthology.orchestra.run.smithi053.stdout: auth supported = cephx 2024-05-27T10:51:03.648 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.648 INFO:teuthology.orchestra.run.smithi053.stdout: filestore xattr use omap = true 2024-05-27T10:51:03.648 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.648 INFO:teuthology.orchestra.run.smithi053.stdout: mon clock drift allowed = 1.000 2024-05-27T10:51:03.648 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.648 INFO:teuthology.orchestra.run.smithi053.stdout: osd crush chooseleaf type = 0 2024-05-27T10:51:03.648 INFO:teuthology.orchestra.run.smithi053.stdout: auth debug = true 2024-05-27T10:51:03.648 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.648 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on old message = true 2024-05-27T10:51:03.648 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on bug = true 2024-05-27T10:51:03.648 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.648 INFO:teuthology.orchestra.run.smithi053.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-27T10:51:03.649 INFO:teuthology.orchestra.run.smithi053.stdout: mon pg warn max object skew = 0 2024-05-27T10:51:03.649 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.649 INFO:teuthology.orchestra.run.smithi053.stdout: # disable pg_autoscaler by default for new pools 2024-05-27T10:51:03.649 INFO:teuthology.orchestra.run.smithi053.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-27T10:51:03.649 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.649 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default size = 2 2024-05-27T10:51:03.649 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.649 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow primary affinity = true 2024-05-27T10:51:03.649 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow pg remap = true 2024-05-27T10:51:03.649 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on legacy crush tunables = false 2024-05-27T10:51:03.650 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on crush straw calc version zero = false 2024-05-27T10:51:03.650 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on no sortbitwise = false 2024-05-27T10:51:03.650 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on osd down out interval zero = false 2024-05-27T10:51:03.650 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on too few osds = false 2024-05-27T10:51:03.650 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-27T10:51:03.650 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-27T10:51:03.650 INFO:teuthology.orchestra.run.smithi053.stdout: mon_allow_pool_size_one = true 2024-05-27T10:51:03.650 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.650 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-27T10:51:03.650 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.651 INFO:teuthology.orchestra.run.smithi053.stdout: osd default data pool replay window = 5 2024-05-27T10:51:03.651 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.651 INFO:teuthology.orchestra.run.smithi053.stdout: mon allow pool delete = true 2024-05-27T10:51:03.651 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.651 INFO:teuthology.orchestra.run.smithi053.stdout: mon cluster log file level = debug 2024-05-27T10:51:03.651 INFO:teuthology.orchestra.run.smithi053.stdout: debug asserts on shutdown = true 2024-05-27T10:51:03.651 INFO:teuthology.orchestra.run.smithi053.stdout: mon health detail to clog = false 2024-05-27T10:51:03.651 INFO:teuthology.orchestra.run.smithi053.stdout: mon host = "172.21.15.47,172.21.15.53,[v2:172.21.15.53:3301,v1:172.21.15.53:6790]" 2024-05-27T10:51:03.651 INFO:teuthology.orchestra.run.smithi053.stdout: fsid = 7b0baa11-ae73-495b-918f-c8db2aa0510f 2024-05-27T10:51:03.651 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.652 INFO:teuthology.orchestra.run.smithi053.stdout:[osd] 2024-05-27T10:51:03.652 INFO:teuthology.orchestra.run.smithi053.stdout: osd journal size = 100 2024-05-27T10:51:03.652 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.652 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub load threshold = 5.0 2024-05-27T10:51:03.652 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub max interval = 600 2024-05-27T10:51:03.652 INFO:teuthology.orchestra.run.smithi053.stdout: osd mclock profile = high_recovery_ops 2024-05-27T10:51:03.652 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.652 INFO:teuthology.orchestra.run.smithi053.stdout: osd recover clone overlap = true 2024-05-27T10:51:03.652 INFO:teuthology.orchestra.run.smithi053.stdout: osd recovery max chunk = 1048576 2024-05-27T10:51:03.652 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.653 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug shutdown = true 2024-05-27T10:51:03.653 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug op order = true 2024-05-27T10:51:03.653 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug verify stray on activate = true 2024-05-27T10:51:03.653 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug trim objects = true 2024-05-27T10:51:03.653 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.653 INFO:teuthology.orchestra.run.smithi053.stdout: osd open classes on start = true 2024-05-27T10:51:03.653 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug pg log writeout = true 2024-05-27T10:51:03.653 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.653 INFO:teuthology.orchestra.run.smithi053.stdout: osd deep scrub update digest min age = 30 2024-05-27T10:51:03.653 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.653 INFO:teuthology.orchestra.run.smithi053.stdout: osd map max advance = 10 2024-05-27T10:51:03.654 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.654 INFO:teuthology.orchestra.run.smithi053.stdout: journal zero on create = true 2024-05-27T10:51:03.654 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.654 INFO:teuthology.orchestra.run.smithi053.stdout: filestore ondisk finisher threads = 3 2024-05-27T10:51:03.654 INFO:teuthology.orchestra.run.smithi053.stdout: filestore apply finisher threads = 3 2024-05-27T10:51:03.654 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.654 INFO:teuthology.orchestra.run.smithi053.stdout: bdev debug aio = true 2024-05-27T10:51:03.654 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug misdirected ops = true 2024-05-27T10:51:03.654 INFO:teuthology.orchestra.run.smithi053.stdout: bdev async discard = True 2024-05-27T10:51:03.654 INFO:teuthology.orchestra.run.smithi053.stdout: bdev enable discard = True 2024-05-27T10:51:03.655 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore allocator = bitmap 2024-05-27T10:51:03.655 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore block size = 96636764160 2024-05-27T10:51:03.655 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore fsck on mount = True 2024-05-27T10:51:03.655 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluefs = 1/20 2024-05-27T10:51:03.655 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluestore = 1/20 2024-05-27T10:51:03.655 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-05-27T10:51:03.655 INFO:teuthology.orchestra.run.smithi053.stdout: debug osd = 20 2024-05-27T10:51:03.655 INFO:teuthology.orchestra.run.smithi053.stdout: debug rocksdb = 4/10 2024-05-27T10:51:03.655 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd backfillfull_ratio = 0.85 2024-05-27T10:51:03.655 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd full ratio = 0.9 2024-05-27T10:51:03.656 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd nearfull ratio = 0.8 2024-05-27T10:51:03.656 INFO:teuthology.orchestra.run.smithi053.stdout: osd failsafe full ratio = 0.95 2024-05-27T10:51:03.656 INFO:teuthology.orchestra.run.smithi053.stdout: osd objectstore = bluestore 2024-05-27T10:51:03.656 INFO:teuthology.orchestra.run.smithi053.stdout: osd op complaint time = 180 2024-05-27T10:51:03.656 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.656 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr] 2024-05-27T10:51:03.656 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-05-27T10:51:03.656 INFO:teuthology.orchestra.run.smithi053.stdout: debug mgr = 20 2024-05-27T10:51:03.656 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2024-05-27T10:51:03.656 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2024-05-27T10:51:03.656 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2024-05-27T10:51:03.657 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2024-05-27T10:51:03.657 INFO:teuthology.orchestra.run.smithi053.stdout: mgr/telemetry/nag = false 2024-05-27T10:51:03.657 INFO:teuthology.orchestra.run.smithi053.stdout: debug client = 20 2024-05-27T10:51:03.657 INFO:teuthology.orchestra.run.smithi053.stdout: debug finisher = 20 2024-05-27T10:51:03.657 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.657 INFO:teuthology.orchestra.run.smithi053.stdout:[mon] 2024-05-27T10:51:03.657 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-05-27T10:51:03.657 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2024-05-27T10:51:03.657 INFO:teuthology.orchestra.run.smithi053.stdout: debug paxos = 20 2024-05-27T10:51:03.657 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2024-05-27T10:51:03.657 INFO:teuthology.orchestra.run.smithi053.stdout: mon data avail warn = 5 2024-05-27T10:51:03.657 INFO:teuthology.orchestra.run.smithi053.stdout: mon mgr mkfs grace = 240 2024-05-27T10:51:03.657 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2024-05-27T10:51:03.658 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd reporter subtree level = osd 2024-05-27T10:51:03.658 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd prime pg temp = true 2024-05-27T10:51:03.658 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2024-05-27T10:51:03.658 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.658 INFO:teuthology.orchestra.run.smithi053.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-27T10:51:03.658 INFO:teuthology.orchestra.run.smithi053.stdout: auth mon ticket ttl = 660 # 11m 2024-05-27T10:51:03.658 INFO:teuthology.orchestra.run.smithi053.stdout: auth service ticket ttl = 240 # 4m 2024-05-27T10:51:03.658 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.658 INFO:teuthology.orchestra.run.smithi053.stdout: # don't complain about insecure global_id in the test suite 2024-05-27T10:51:03.658 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-27T10:51:03.658 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-27T10:51:03.658 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.658 INFO:teuthology.orchestra.run.smithi053.stdout: # 1m isn't quite enough 2024-05-27T10:51:03.659 INFO:teuthology.orchestra.run.smithi053.stdout: mon_down_mkfs_grace = 2m 2024-05-27T10:51:03.659 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.659 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_filestore_osds = false 2024-05-27T10:51:03.659 INFO:teuthology.orchestra.run.smithi053.stdout: mon down mkfs grace = 300 2024-05-27T10:51:03.659 INFO:teuthology.orchestra.run.smithi053.stdout: mon op complaint time = 120 2024-05-27T10:51:03.659 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-27T10:51:03.659 INFO:teuthology.orchestra.run.smithi053.stdout:[client] 2024-05-27T10:51:03.659 INFO:teuthology.orchestra.run.smithi053.stdout: rgw cache enabled = true 2024-05-27T10:51:03.659 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable ops log = true 2024-05-27T10:51:03.659 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable usage log = true 2024-05-27T10:51:03.659 INFO:teuthology.orchestra.run.smithi053.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-27T10:51:03.659 INFO:teuthology.orchestra.run.smithi053.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-27T10:51:03.659 INFO:teuthology.orchestra.run.smithi053.stdout: client mount timeout = 600 2024-05-27T10:51:03.659 INFO:teuthology.orchestra.run.smithi053.stdout: debug client = 20 2024-05-27T10:51:03.660 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-05-27T10:51:03.660 INFO:teuthology.orchestra.run.smithi053.stdout: pid file = "" 2024-05-27T10:51:03.660 INFO:teuthology.orchestra.run.smithi053.stdout: rados mon op timeout = 900 2024-05-27T10:51:03.660 INFO:teuthology.orchestra.run.smithi053.stdout: rados osd op timeout = 900 2024-05-27T10:51:03.660 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.a] 2024-05-27T10:51:03.660 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.b] 2024-05-27T10:51:03.660 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.c] 2024-05-27T10:51:03.660 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.a] 2024-05-27T10:51:03.660 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.c] 2024-05-27T10:51:03.660 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.b] 2024-05-27T10:51:03.660 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.d] 2024-05-27T10:51:03.660 INFO:teuthology.orchestra.run.smithi053.stdout:[mds] 2024-05-27T10:51:03.661 INFO:teuthology.orchestra.run.smithi053.stdout: debug mds = 20 2024-05-27T10:51:03.661 INFO:teuthology.orchestra.run.smithi053.stdout: debug mds balancer = 20 2024-05-27T10:51:03.661 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-05-27T10:51:03.661 INFO:teuthology.orchestra.run.smithi053.stdout: mds debug frag = True 2024-05-27T10:51:03.661 INFO:teuthology.orchestra.run.smithi053.stdout: mds debug scatterstat = True 2024-05-27T10:51:03.661 INFO:teuthology.orchestra.run.smithi053.stdout: mds op complaint time = 180 2024-05-27T10:51:03.661 INFO:teuthology.orchestra.run.smithi053.stdout: mds verify scatter = True 2024-05-27T10:51:03.661 INFO:teuthology.orchestra.run.smithi053.stdout: osd op complaint time = 180 2024-05-27T10:51:03.661 INFO:teuthology.orchestra.run.smithi053.stdout: rados mon op timeout = 900 2024-05-27T10:51:03.661 INFO:teuthology.orchestra.run.smithi053.stdout: rados osd op timeout = 900 2024-05-27T10:51:03.677 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-27T10:51:03.677 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-27T10:51:03.816 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-27T10:51:03.816 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:51:03.816 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-27T10:51:03.871 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:51:03.871 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-27T10:51:03.922 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi047.front.sepia.ceph.com 2024-05-27T10:51:03.923 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:51:03.923 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-27T10:51:03.923 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-27T10:51:04.047 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:51:04.048 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-27T10:51:04.148 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi053.front.sepia.ceph.com 2024-05-27T10:51:04.148 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:51:04.149 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-27T10:51:04.149 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-27T10:51:04.292 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:51:04.292 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-27T10:51:04.390 INFO:tasks.ceph:Setting up mon nodes... 2024-05-27T10:51:04.391 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-27T10:51:04.391 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-27T10:51:04.565 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-27T10:51:04.576 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-27T10:51:04.751 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-27T10:51:04.762 INFO:tasks.ceph:Setting up mds nodes... 2024-05-27T10:51:04.762 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-27T10:51:04.930 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-27T10:51:04.940 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-27T10:51:05.038 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-27T10:51:05.198 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-27T10:51:05.207 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-27T10:51:05.296 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-27T10:51:05.460 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-27T10:51:05.470 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-27T10:51:05.549 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-27T10:51:05.703 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-27T10:51:05.713 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-27T10:51:05.804 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-27T10:51:05.805 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-27T10:51:05.933 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-27T10:51:05.974 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-27T10:51:06.096 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-27T10:51:06.143 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-27T10:51:06.264 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-27T10:51:06.321 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-27T10:51:06.444 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-27T10:51:06.485 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-27T10:51:06.486 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-27T10:51:06.486 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-27T10:51:06.580 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-27T10:51:06.580 INFO:tasks.ceph:role: osd.0 2024-05-27T10:51:06.580 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-27T10:51:06.580 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-27T10:51:06.665 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T10:51:06.665 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T10:51:06.665 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T10:51:06.665 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-27T10:51:06.665 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T10:51:06.665 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-05-27T10:51:06.665 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T10:51:06.666 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-27T10:51:06.666 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T10:51:06.666 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T10:51:06.699 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-05-27T10:51:06.704 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-05-27T10:51:06.704 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-27T10:51:06.811 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-27T10:51:06.891 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-27T10:51:06.964 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-27T10:51:06.965 INFO:tasks.ceph:role: osd.1 2024-05-27T10:51:06.965 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-27T10:51:06.965 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-27T10:51:07.040 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T10:51:07.040 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T10:51:07.040 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T10:51:07.041 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-27T10:51:07.041 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T10:51:07.041 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-05-27T10:51:07.041 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T10:51:07.041 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-27T10:51:07.041 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T10:51:07.041 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T10:51:07.074 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-05-27T10:51:07.079 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-05-27T10:51:07.079 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-27T10:51:07.169 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-27T10:51:07.240 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-27T10:51:07.309 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-27T10:51:07.309 INFO:tasks.ceph:role: osd.2 2024-05-27T10:51:07.309 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-27T10:51:07.309 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-27T10:51:07.384 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T10:51:07.384 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T10:51:07.384 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T10:51:07.384 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-27T10:51:07.384 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T10:51:07.384 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-05-27T10:51:07.384 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T10:51:07.385 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-27T10:51:07.385 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T10:51:07.385 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T10:51:07.418 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-05-27T10:51:07.424 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-05-27T10:51:07.424 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-27T10:51:07.510 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-27T10:51:07.586 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-27T10:51:07.647 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-27T10:51:07.647 INFO:tasks.ceph:role: osd.3 2024-05-27T10:51:07.647 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-27T10:51:07.647 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-27T10:51:07.709 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T10:51:07.709 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T10:51:07.709 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T10:51:07.709 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-27T10:51:07.709 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T10:51:07.709 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-05-27T10:51:07.709 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T10:51:07.709 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-27T10:51:07.709 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T10:51:07.709 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T10:51:07.745 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-05-27T10:51:07.749 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-05-27T10:51:07.749 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-27T10:51:07.834 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-27T10:51:07.899 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T10:51:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:08.059+0000 7f7653fb6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-27T10:51:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:08.059+0000 7f7653fb6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-27T10:51:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:08.059+0000 7f7653fb6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-27T10:51:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:08.059+0000 7f7653fb6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-27T10:51:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:08.059+0000 7f7653fb6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-27T10:51:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:08.063+0000 7f7653fb6640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-27T10:51:11.286 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-27T10:51:11.379 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T10:51:11.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:11.519+0000 7f85d53c4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-27T10:51:11.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:11.519+0000 7f85d53c4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-27T10:51:11.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:11.519+0000 7f85d53c4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-27T10:51:11.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:11.519+0000 7f85d53c4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-27T10:51:11.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:11.519+0000 7f85d53c4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-27T10:51:11.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:11.522+0000 7f85d53c4640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-27T10:51:14.771 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-27T10:51:14.862 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T10:51:14.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:15.000+0000 7f79535a3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-27T10:51:14.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:15.001+0000 7f79535a3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-27T10:51:14.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:15.001+0000 7f79535a3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-27T10:51:14.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:15.001+0000 7f79535a3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-27T10:51:14.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:15.001+0000 7f79535a3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-27T10:51:15.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:15.003+0000 7f79535a3640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-27T10:51:17.972 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-27T10:51:18.062 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T10:51:18.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:18.205+0000 7ff5bce18640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-27T10:51:18.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:18.205+0000 7ff5bce18640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-27T10:51:18.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:18.205+0000 7ff5bce18640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-27T10:51:18.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:18.205+0000 7ff5bce18640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-27T10:51:18.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:18.205+0000 7ff5bce18640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-27T10:51:18.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:18.208+0000 7ff5bce18640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-27T10:51:21.178 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-27T10:51:21.262 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-27T10:51:21.357 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-27T10:51:21.358 INFO:tasks.ceph:role: osd.4 2024-05-27T10:51:21.358 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com 2024-05-27T10:51:21.358 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-27T10:51:21.442 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T10:51:21.442 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T10:51:21.442 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T10:51:21.443 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-27T10:51:21.443 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T10:51:21.443 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-05-27T10:51:21.443 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T10:51:21.443 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-27T10:51:21.443 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T10:51:21.443 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T10:51:21.476 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-05-27T10:51:21.481 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-05-27T10:51:21.481 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-27T10:51:21.588 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-27T10:51:21.670 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-27T10:51:21.745 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-27T10:51:21.745 INFO:tasks.ceph:role: osd.5 2024-05-27T10:51:21.745 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi053.front.sepia.ceph.com 2024-05-27T10:51:21.745 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-27T10:51:21.817 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T10:51:21.817 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T10:51:21.817 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T10:51:21.817 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-27T10:51:21.818 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T10:51:21.818 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-05-27T10:51:21.818 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T10:51:21.818 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-27T10:51:21.818 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T10:51:21.818 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T10:51:21.851 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-05-27T10:51:21.857 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-05-27T10:51:21.857 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-27T10:51:21.953 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-27T10:51:22.028 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-27T10:51:22.106 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-27T10:51:22.106 INFO:tasks.ceph:role: osd.6 2024-05-27T10:51:22.106 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi053.front.sepia.ceph.com 2024-05-27T10:51:22.106 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-27T10:51:22.176 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T10:51:22.177 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T10:51:22.177 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T10:51:22.177 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-27T10:51:22.177 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T10:51:22.177 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-05-27T10:51:22.177 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T10:51:22.177 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-27T10:51:22.177 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T10:51:22.177 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T10:51:22.210 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-05-27T10:51:22.215 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-05-27T10:51:22.215 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-27T10:51:22.309 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-27T10:51:22.382 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-27T10:51:22.445 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-27T10:51:22.446 INFO:tasks.ceph:role: osd.7 2024-05-27T10:51:22.446 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi053.front.sepia.ceph.com 2024-05-27T10:51:22.446 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-27T10:51:22.513 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T10:51:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T10:51:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T10:51:22.514 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-27T10:51:22.514 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T10:51:22.514 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-05-27T10:51:22.514 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T10:51:22.514 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-27T10:51:22.514 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T10:51:22.515 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T10:51:22.546 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-05-27T10:51:22.552 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-05-27T10:51:22.553 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-27T10:51:22.650 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-27T10:51:22.719 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T10:51:22.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:22.866+0000 7fce7e5c4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-27T10:51:22.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:22.866+0000 7fce7e5c4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-27T10:51:22.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:22.867+0000 7fce7e5c4640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-27T10:51:22.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:22.867+0000 7fce7e5c4640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-27T10:51:22.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:22.867+0000 7fce7e5c4640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-27T10:51:22.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:22.870+0000 7fce7e5c4640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-27T10:51:26.098 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-27T10:51:26.191 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T10:51:26.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:26.328+0000 7f67878b1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-27T10:51:26.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:26.329+0000 7f67878b1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-27T10:51:26.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:26.329+0000 7f67878b1640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-27T10:51:26.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:26.329+0000 7f67878b1640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-27T10:51:26.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:26.329+0000 7f67878b1640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-27T10:51:26.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:26.331+0000 7f67878b1640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-27T10:51:29.278 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-27T10:51:29.369 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T10:51:29.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:29.506+0000 7f11df9b6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-27T10:51:29.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:29.506+0000 7f11df9b6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-27T10:51:29.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:29.507+0000 7f11df9b6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-27T10:51:29.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:29.507+0000 7f11df9b6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-27T10:51:29.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:29.507+0000 7f11df9b6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-27T10:51:29.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:29.509+0000 7f11df9b6640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-27T10:51:30.836 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T10:51:30.844 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T10:51:32.747 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-27T10:51:32.825 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T10:51:32.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:32.958+0000 7f5855e27640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-27T10:51:32.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:32.958+0000 7f5855e27640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-27T10:51:32.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:32.958+0000 7f5855e27640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-27T10:51:32.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:32.958+0000 7f5855e27640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-27T10:51:32.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:32.959+0000 7f5855e27640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-27T10:51:32.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:32.961+0000 7f5855e27640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-27T10:51:36.199 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-27T10:51:36.293 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-27T10:51:36.294 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:51:36.294 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-27T10:51:36.388 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:51:36.388 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-27T10:51:36.480 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:51:36.480 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-27T10:51:36.572 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:51:36.572 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-27T10:51:36.661 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:51:36.661 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-27T10:51:36.752 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:51:36.752 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-27T10:51:36.846 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:51:36.846 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-27T10:51:36.936 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:51:36.936 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-27T10:51:37.026 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:51:37.026 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-27T10:51:37.114 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:51:37.114 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-27T10:51:37.201 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:51:37.201 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-27T10:51:37.289 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:51:37.289 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-27T10:51:37.380 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:51:37.380 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-27T10:51:37.470 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:51:37.471 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-27T10:51:37.561 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:51:37.561 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-27T10:51:37.620 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:51:37.621 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-27T10:51:37.676 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:51:37.676 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-27T10:51:37.734 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:51:37.735 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-27T10:51:37.789 INFO:tasks.ceph:Adding keys to all mons... 2024-05-27T10:51:37.789 DEBUG:teuthology.orchestra.run.smithi047:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-27T10:51:37.797 DEBUG:teuthology.orchestra.run.smithi053:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-27T10:51:37.880 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.y] 2024-05-27T10:51:37.880 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCYZVRmlXnjIRAACcK2hOezvwAF4s/oVTHfkw== 2024-05-27T10:51:37.880 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-05-27T10:51:37.881 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCYZVRmRmmoNxAAnqRGqe8Rxaxo7Q8DOZyL/A== 2024-05-27T10:51:37.881 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c] 2024-05-27T10:51:37.881 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCZZVRm9TAJDBAAgWfHXoTcy2zciuIRtzHCFw== 2024-05-27T10:51:37.881 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.0] 2024-05-27T10:51:37.881 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCcZVRm4NuYAxAAbmP/dIm3zajYYoiQq4xBFw== 2024-05-27T10:51:37.881 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.1] 2024-05-27T10:51:37.881 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCfZVRmazX2HhAAzn/4yh5abte+C8ebrcfUbQ== 2024-05-27T10:51:37.881 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.2] 2024-05-27T10:51:37.881 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCjZVRmZm4MABAA4xyGBD69eJpzDODw73/W9Q== 2024-05-27T10:51:37.881 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.3] 2024-05-27T10:51:37.881 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCmZVRmjBo/DBAAOtRkD5ZbdSpN/2wRsVI/Pw== 2024-05-27T10:51:37.881 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.x] 2024-05-27T10:51:37.881 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCYZVRmS2j2LBAAn0nAIQG7Zv98B+uk2pzspA== 2024-05-27T10:51:37.882 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b] 2024-05-27T10:51:37.882 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCZZVRmppWrGxAAanXJemXM5rsgpO6D8JUFFQ== 2024-05-27T10:51:37.882 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d] 2024-05-27T10:51:37.882 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCZZVRmJfsgKhAAqp0oyT4bCZbqcYNq9zqZBA== 2024-05-27T10:51:37.882 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.4] 2024-05-27T10:51:37.882 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCqZVRmeF+1MxAA7tJ52QAExiUyvZaa2tqMGw== 2024-05-27T10:51:37.882 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.5] 2024-05-27T10:51:37.882 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCuZVRm1nOrExAAqRI1SHaPcpG+7HZoHHJzmA== 2024-05-27T10:51:37.882 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.6] 2024-05-27T10:51:37.882 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCxZVRmHOBBHhAAaRyVvwmjCkPhF5LIy3fY5A== 2024-05-27T10:51:37.882 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.7] 2024-05-27T10:51:37.882 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQC0ZVRmpEwvORAAPcWxyiWm3RwP4QsMw8Xf8w== 2024-05-27T10:51:37.882 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-05-27T10:51:37.883 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCZZVRmP5XbNxAAeV5NQPfMMD+N/fXyt5+LnA== 2024-05-27T10:51:37.883 INFO:teuthology.orchestra.run.smithi047.stdout:[client.2] 2024-05-27T10:51:37.883 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCaZVRmra/3BRAAJx7p//5bMn44mA+yPASYGA== 2024-05-27T10:51:37.883 INFO:teuthology.orchestra.run.smithi047.stdout:[client.1] 2024-05-27T10:51:37.883 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCaZVRma+T3DxAAlBm/6sMK0QgrD2s03+yeCA== 2024-05-27T10:51:37.883 INFO:teuthology.orchestra.run.smithi047.stdout:[client.3] 2024-05-27T10:51:37.883 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCaZVRmyM2rGhAA9qvq+Nhb8oWUyfefyzowjQ== 2024-05-27T10:51:37.883 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.y] 2024-05-27T10:51:37.884 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCYZVRmlXnjIRAACcK2hOezvwAF4s/oVTHfkw== 2024-05-27T10:51:37.884 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.a] 2024-05-27T10:51:37.884 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCYZVRmRmmoNxAAnqRGqe8Rxaxo7Q8DOZyL/A== 2024-05-27T10:51:37.884 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.c] 2024-05-27T10:51:37.884 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCZZVRm9TAJDBAAgWfHXoTcy2zciuIRtzHCFw== 2024-05-27T10:51:37.884 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.0] 2024-05-27T10:51:37.884 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCcZVRm4NuYAxAAbmP/dIm3zajYYoiQq4xBFw== 2024-05-27T10:51:37.884 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.1] 2024-05-27T10:51:37.884 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCfZVRmazX2HhAAzn/4yh5abte+C8ebrcfUbQ== 2024-05-27T10:51:37.884 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.2] 2024-05-27T10:51:37.884 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCjZVRmZm4MABAA4xyGBD69eJpzDODw73/W9Q== 2024-05-27T10:51:37.885 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.3] 2024-05-27T10:51:37.885 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCmZVRmjBo/DBAAOtRkD5ZbdSpN/2wRsVI/Pw== 2024-05-27T10:51:37.885 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.x] 2024-05-27T10:51:37.885 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCYZVRmS2j2LBAAn0nAIQG7Zv98B+uk2pzspA== 2024-05-27T10:51:37.885 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.b] 2024-05-27T10:51:37.885 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCZZVRmppWrGxAAanXJemXM5rsgpO6D8JUFFQ== 2024-05-27T10:51:37.885 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.d] 2024-05-27T10:51:37.885 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCZZVRmJfsgKhAAqp0oyT4bCZbqcYNq9zqZBA== 2024-05-27T10:51:37.885 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.4] 2024-05-27T10:51:37.885 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCqZVRmeF+1MxAA7tJ52QAExiUyvZaa2tqMGw== 2024-05-27T10:51:37.885 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.5] 2024-05-27T10:51:37.885 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCuZVRm1nOrExAAqRI1SHaPcpG+7HZoHHJzmA== 2024-05-27T10:51:37.885 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.6] 2024-05-27T10:51:37.885 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCxZVRmHOBBHhAAaRyVvwmjCkPhF5LIy3fY5A== 2024-05-27T10:51:37.886 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.7] 2024-05-27T10:51:37.886 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQC0ZVRmpEwvORAAPcWxyiWm3RwP4QsMw8Xf8w== 2024-05-27T10:51:37.886 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2024-05-27T10:51:37.886 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCZZVRmP5XbNxAAeV5NQPfMMD+N/fXyt5+LnA== 2024-05-27T10:51:37.886 INFO:teuthology.orchestra.run.smithi053.stdout:[client.2] 2024-05-27T10:51:37.886 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCaZVRmra/3BRAAJx7p//5bMn44mA+yPASYGA== 2024-05-27T10:51:37.886 INFO:teuthology.orchestra.run.smithi053.stdout:[client.1] 2024-05-27T10:51:37.886 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCaZVRma+T3DxAAlBm/6sMK0QgrD2s03+yeCA== 2024-05-27T10:51:37.886 INFO:teuthology.orchestra.run.smithi053.stdout:[client.3] 2024-05-27T10:51:37.886 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCaZVRmyM2rGhAA9qvq+Nhb8oWUyfefyzowjQ== 2024-05-27T10:51:37.888 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-27T10:51:37.935 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-27T10:51:38.075 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T10:51:38.082 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T10:51:38.229 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T10:51:38.234 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T10:51:38.380 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T10:51:38.387 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T10:51:38.524 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T10:51:38.529 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T10:51:38.670 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T10:51:38.677 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T10:51:38.813 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T10:51:38.819 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T10:51:38.958 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-27T10:51:38.966 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-27T10:51:39.105 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T10:51:39.111 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T10:51:39.257 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T10:51:39.262 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T10:51:39.401 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T10:51:39.406 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T10:51:39.544 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T10:51:39.552 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T10:51:39.693 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T10:51:39.698 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T10:51:39.842 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T10:51:39.848 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T10:51:39.989 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T10:51:39.994 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T10:51:40.134 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T10:51:40.138 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T10:51:40.282 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T10:51:40.287 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T10:51:40.427 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T10:51:40.434 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T10:51:40.577 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-27T10:51:40.577 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-27T10:51:40.670 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-27T10:51:40.826 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-27T10:51:40.911 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-27T10:51:41.007 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-27T10:51:41.162 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-27T10:51:41.235 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-27T10:51:41.323 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-27T10:51:41.479 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-27T10:51:41.566 DEBUG:teuthology.orchestra.run.smithi047:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-27T10:51:41.574 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-27T10:51:41.631 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-27T10:51:41.632 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-27T10:51:41.632 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-27T10:51:41.639 INFO:tasks.ceph.mon.a:Started 2024-05-27T10:51:41.639 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-27T10:51:41.639 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-27T10:51:41.646 INFO:tasks.ceph.mon.b:Started 2024-05-27T10:51:41.646 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-27T10:51:41.646 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-27T10:51:41.653 INFO:tasks.ceph.mon.c:Started 2024-05-27T10:51:41.653 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-27T10:51:41.654 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-27T10:51:41.654 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-27T10:51:41.660 INFO:tasks.ceph.mgr.y:Started 2024-05-27T10:51:41.661 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-27T10:51:41.661 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-27T10:51:41.665 INFO:tasks.ceph.mgr.x:Started 2024-05-27T10:51:41.665 INFO:tasks.ceph:Setting crush tunables to default 2024-05-27T10:51:41.665 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd crush tunables default 2024-05-27T10:51:41.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.845+0000 7f01e4000640 1 Processor -- start 2024-05-27T10:51:41.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.845+0000 7f01e4000640 1 -- start start 2024-05-27T10:51:41.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.846+0000 7f01e4000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f01dc15ea00 0x7f01dc0d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:41.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.846+0000 7f01e4000640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f01dc162c90 0x7f01dc06cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:41.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.846+0000 7f01e4000640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01dc0cf4c0 con 0x7f01dc0d2f90 2024-05-27T10:51:41.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.846+0000 7f01e4000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f01dc0cf760 con 0x7f01dc15ea00 2024-05-27T10:51:41.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.846+0000 7f01e4000640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f01dc0cfa40 con 0x7f01dc162c90 2024-05-27T10:51:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.847+0000 7f01e2000640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f01dc162c90 0x7f01dc06cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.847+0000 7f01e2000640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f01dc162c90 0x7f01dc06cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:48662/0 (socket says 172.21.15.47:48662) 2024-05-27T10:51:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.847+0000 7f01e2000640 1 -- 172.21.15.47:0/2836783043 learned_addr learned my addr 172.21.15.47:0/2836783043 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:51:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.847+0000 7f01e2000640 1 -- 172.21.15.47:0/2836783043 >> v2:172.21.15.53:3300/0 conn(0x7f01dc162c90 msgr2=0x7f01dc06cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-27T10:51:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.847+0000 7f01e2000640 1 -- 172.21.15.47:0/2836783043 >> v2:172.21.15.53:3300/0 conn(0x7f01dc162c90 msgr2=0x7f01dc06cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-27T10:51:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.847+0000 7f01e2000640 1 --2- 172.21.15.47:0/2836783043 >> v2:172.21.15.53:3300/0 conn(0x7f01dc162c90 0x7f01dc06cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-27T10:51:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.847+0000 7f01e2000640 1 --2- 172.21.15.47:0/2836783043 >> v2:172.21.15.53:3300/0 conn(0x7f01dc162c90 0x7f01dc06cab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-27T10:51:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.847+0000 7f01e1600640 1 --2- 172.21.15.47:0/2836783043 >> v2:172.21.15.47:3300/0 conn(0x7f01dc15ea00 0x7f01dc0d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.848+0000 7f01e1600640 1 -- 172.21.15.47:0/2836783043 >> v2:172.21.15.47:3300/0 conn(0x7f01dc15ea00 msgr2=0x7f01dc0d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-27T10:51:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.848+0000 7f01e1600640 1 -- 172.21.15.47:0/2836783043 >> v2:172.21.15.47:3300/0 conn(0x7f01dc15ea00 msgr2=0x7f01dc0d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-27T10:51:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.848+0000 7f01e1600640 1 --2- 172.21.15.47:0/2836783043 >> v2:172.21.15.47:3300/0 conn(0x7f01dc15ea00 0x7f01dc0d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-27T10:51:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.848+0000 7f01e1600640 1 --2- 172.21.15.47:0/2836783043 >> v2:172.21.15.47:3300/0 conn(0x7f01dc15ea00 0x7f01dc0d0520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-27T10:51:41.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.853+0000 7f01dbe00640 1 -- 172.21.15.47:0/2836783043 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2806070171 0 0) 0x7f01dc0cf4c0 con 0x7f01dc0d2f90 2024-05-27T10:51:41.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.853+0000 7f01dbe00640 1 -- 172.21.15.47:0/2836783043 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01c4003520 con 0x7f01dc0d2f90 2024-05-27T10:51:41.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.853+0000 7f01dbe00640 1 -- 172.21.15.47:0/2836783043 <== mon.1 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1461541913 0 0) 0x7f01c4003520 con 0x7f01dc0d2f90 2024-05-27T10:51:41.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.853+0000 7f01dbe00640 1 -- 172.21.15.47:0/2836783043 >> v2:172.21.15.53:3300/0 conn(0x7f01dc162c90 msgr2=0x7f01dc06cab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-27T10:51:41.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.853+0000 7f01dbe00640 1 --2- 172.21.15.47:0/2836783043 >> v2:172.21.15.53:3300/0 conn(0x7f01dc162c90 0x7f01dc06cab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:41.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.853+0000 7f01dbe00640 1 -- 172.21.15.47:0/2836783043 >> v2:172.21.15.47:3300/0 conn(0x7f01dc15ea00 msgr2=0x7f01dc0d0520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-27T10:51:41.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.853+0000 7f01dbe00640 1 --2- 172.21.15.47:0/2836783043 >> v2:172.21.15.47:3300/0 conn(0x7f01dc15ea00 0x7f01dc0d0520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:41.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.853+0000 7f01dbe00640 1 -- 172.21.15.47:0/2836783043 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01dc0cfd20 con 0x7f01dc0d2f90 2024-05-27T10:51:41.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.853+0000 7f01dbe00640 1 -- 172.21.15.47:0/2836783043 <== mon.1 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f01c8001690 con 0x7f01dc0d2f90 2024-05-27T10:51:41.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.853+0000 7f01dbe00640 1 -- 172.21.15.47:0/2836783043 >> v1:172.21.15.53:6789/0 conn(0x7f01dc0d2f90 legacy=0x7f01dc162580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:41.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.853+0000 7f01dbe00640 1 --2- 172.21.15.47:0/2836783043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01c4003a00 0x7f01c4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:41.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.853+0000 7f01dbe00640 1 --2- 172.21.15.47:0/2836783043 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f01c4004800 0x7f01c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:41.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.853+0000 7f01dbe00640 1 --2- 172.21.15.47:0/2836783043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01c40051c0 0x7f01c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:41.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.853+0000 7f01dbe00640 1 -- 172.21.15.47:0/2836783043 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc0cf760 con 0x7f01c40051c0 2024-05-27T10:51:41.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.853+0000 7f01dbe00640 1 -- 172.21.15.47:0/2836783043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc0cfa40 con 0x7f01c4003a00 2024-05-27T10:51:41.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.853+0000 7f01dbe00640 1 -- 172.21.15.47:0/2836783043 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f01c400c110 con 0x7f01c4004800 2024-05-27T10:51:41.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.854+0000 7f01e1600640 1 --2- 172.21.15.47:0/2836783043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01c4003a00 0x7f01c4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:41.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.854+0000 7f01e2000640 1 --2- 172.21.15.47:0/2836783043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01c40051c0 0x7f01c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:41.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.854+0000 7f01e0c00640 1 --2- 172.21.15.47:0/2836783043 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f01c4004800 0x7f01c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:41.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.854+0000 7f01e1600640 1 -- 172.21.15.47:0/2836783043 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f01c4004800 msgr2=0x7f01c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:41.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.854+0000 7f01e1600640 1 --2- 172.21.15.47:0/2836783043 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f01c4004800 0x7f01c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:41.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.854+0000 7f01e1600640 1 -- 172.21.15.47:0/2836783043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01c40051c0 msgr2=0x7f01c400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:41.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.854+0000 7f01e1600640 1 --2- 172.21.15.47:0/2836783043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01c40051c0 0x7f01c400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:41.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.854+0000 7f01e1600640 1 -- 172.21.15.47:0/2836783043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c4003520 con 0x7f01c4003a00 2024-05-27T10:51:41.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.854+0000 7f01e2000640 1 -- 172.21.15.47:0/2836783043 reap_dead start 2024-05-27T10:51:41.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.856+0000 7f01e1600640 1 --2- 172.21.15.47:0/2836783043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01c4003a00 0x7f01c4003e20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f01d000ba10 tx=0x7f01c4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a27831e6f84a559e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:41.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.856+0000 7f01dbe00640 1 -- 172.21.15.47:0/2836783043 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d0030070 con 0x7f01c4003a00 2024-05-27T10:51:41.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.856+0000 7f01dbe00640 1 -- 172.21.15.47:0/2836783043 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d002ad90 con 0x7f01c4003a00 2024-05-27T10:51:41.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.856+0000 7f01dbe00640 1 -- 172.21.15.47:0/2836783043 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d000b5e0 con 0x7f01c4003a00 2024-05-27T10:51:41.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.857+0000 7f01e4000640 1 -- 172.21.15.47:0/2836783043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01c4003a00 msgr2=0x7f01c4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:41.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.857+0000 7f01e4000640 1 --2- 172.21.15.47:0/2836783043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01c4003a00 0x7f01c4003e20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f01d000ba10 tx=0x7f01c4005830 comp rx=0 tx=0).stop 2024-05-27T10:51:41.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.857+0000 7f01e4000640 1 -- 172.21.15.47:0/2836783043 shutdown_connections 2024-05-27T10:51:41.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.857+0000 7f01e4000640 1 --2- 172.21.15.47:0/2836783043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01c4003a00 0x7f01c4003e20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:41.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.857+0000 7f01e4000640 1 -- 172.21.15.47:0/2836783043 >> 172.21.15.47:0/2836783043 conn(0x7f01dc08bfd0 msgr2=0x7f01dc0d4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:41.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.858+0000 7f01e4000640 1 -- 172.21.15.47:0/2836783043 shutdown_connections 2024-05-27T10:51:41.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.858+0000 7f01e4000640 1 -- 172.21.15.47:0/2836783043 wait complete. 2024-05-27T10:51:41.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.860+0000 7f01e4000640 1 Processor -- start 2024-05-27T10:51:41.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.860+0000 7f01e4000640 1 -- start start 2024-05-27T10:51:41.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.861+0000 7f01e4000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f01c4003a00 0x7f01dc1536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:41.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.861+0000 7f01e4000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01dc0c9a60 0x7f01dc0ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:41.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.861+0000 7f01e4000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01dc0b41c0 0x7f01dc0b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:41.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.861+0000 7f01e4000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc163200 con 0x7f01dc0c9a60 2024-05-27T10:51:41.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.861+0000 7f01e4000640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc15ede0 con 0x7f01dc0b41c0 2024-05-27T10:51:41.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.861+0000 7f01e4000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f01dc163380 con 0x7f01c4003a00 2024-05-27T10:51:41.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.861+0000 7f01e2000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01dc0b41c0 0x7f01dc0b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:41.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.862+0000 7f01e0c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01dc0c9a60 0x7f01dc0ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:41.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.862+0000 7f01e2000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01dc0b41c0 0x7f01dc0b4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:48706/0 (socket says 172.21.15.47:48706) 2024-05-27T10:51:41.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.862+0000 7f01e2000640 1 -- 172.21.15.47:0/3585846431 learned_addr learned my addr 172.21.15.47:0/3585846431 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:51:41.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.862+0000 7f01e1600640 1 --2- 172.21.15.47:0/3585846431 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f01c4003a00 0x7f01dc1536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:41.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.862+0000 7f01e2000640 1 -- 172.21.15.47:0/3585846431 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f01c4003a00 msgr2=0x7f01dc1536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:41.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.862+0000 7f01e2000640 1 --2- 172.21.15.47:0/3585846431 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f01c4003a00 0x7f01dc1536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:41.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.862+0000 7f01e2000640 1 -- 172.21.15.47:0/3585846431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01dc0c9a60 msgr2=0x7f01dc0ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:41.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.862+0000 7f01e2000640 1 --2- 172.21.15.47:0/3585846431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01dc0c9a60 0x7f01dc0ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:41.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.862+0000 7f01e2000640 1 -- 172.21.15.47:0/3585846431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01dc0c9f90 con 0x7f01dc0b41c0 2024-05-27T10:51:41.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.862+0000 7f01e2000640 1 --2- 172.21.15.47:0/3585846431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01dc0b41c0 0x7f01dc0b4640 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f01dc08c540 tx=0x7f01d4007f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:41.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.863+0000 7f01d9600640 1 -- 172.21.15.47:0/3585846431 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d401c070 con 0x7f01dc0b41c0 2024-05-27T10:51:41.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.863+0000 7f01d9600640 1 -- 172.21.15.47:0/3585846431 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d400a520 con 0x7f01dc0b41c0 2024-05-27T10:51:41.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.863+0000 7f01d9600640 1 -- 172.21.15.47:0/3585846431 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d4003bd0 con 0x7f01dc0b41c0 2024-05-27T10:51:41.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.863+0000 7f01e4000640 1 -- 172.21.15.47:0/3585846431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01dc0ca270 con 0x7f01dc0b41c0 2024-05-27T10:51:41.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.863+0000 7f01e4000640 1 -- 172.21.15.47:0/3585846431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01dc0ca830 con 0x7f01dc0b41c0 2024-05-27T10:51:41.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.863+0000 7f01d9600640 1 -- 172.21.15.47:0/3585846431 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f01d401f070 con 0x7f01dc0b41c0 2024-05-27T10:51:41.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.864+0000 7f01d9600640 1 -- 172.21.15.47:0/3585846431 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f01d4009d20 con 0x7f01dc0b41c0 2024-05-27T10:51:41.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.864+0000 7f01e4000640 1 -- 172.21.15.47:0/3585846431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01dc068eb0 con 0x7f01dc0b41c0 2024-05-27T10:51:41.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.868+0000 7f01d9600640 1 -- 172.21.15.47:0/3585846431 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f01dc068eb0 con 0x7f01dc0b41c0 2024-05-27T10:51:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.941+0000 7f01e4000640 1 -- 172.21.15.47:0/3585846431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f01dc06e520 con 0x7f01dc0b41c0 2024-05-27T10:51:41.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.949+0000 7f01d9600640 1 -- 172.21.15.47:0/3585846431 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f01d4026080 con 0x7f01dc0b41c0 2024-05-27T10:51:41.947 INFO:teuthology.orchestra.run.smithi047.stderr:adjusted tunables profile to default 2024-05-27T10:51:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.951+0000 7f01e4000640 1 -- 172.21.15.47:0/3585846431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01dc0b41c0 msgr2=0x7f01dc0b4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.951+0000 7f01e4000640 1 --2- 172.21.15.47:0/3585846431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01dc0b41c0 0x7f01dc0b4640 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f01dc08c540 tx=0x7f01d4007f40 comp rx=0 tx=0).stop 2024-05-27T10:51:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.951+0000 7f01e4000640 1 -- 172.21.15.47:0/3585846431 shutdown_connections 2024-05-27T10:51:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.951+0000 7f01e4000640 1 --2- 172.21.15.47:0/3585846431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01dc0b41c0 0x7f01dc0b4640 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.951+0000 7f01e4000640 1 --2- 172.21.15.47:0/3585846431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01dc0c9a60 0x7f01dc0ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.951+0000 7f01e4000640 1 --2- 172.21.15.47:0/3585846431 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f01c4003a00 0x7f01dc1536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.951+0000 7f01e4000640 1 -- 172.21.15.47:0/3585846431 >> 172.21.15.47:0/3585846431 conn(0x7f01dc08bfd0 msgr2=0x7f01dc15ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.951+0000 7f01e4000640 1 -- 172.21.15.47:0/3585846431 shutdown_connections 2024-05-27T10:51:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:41.951+0000 7f01e4000640 1 -- 172.21.15.47:0/3585846431 wait complete. 2024-05-27T10:51:41.966 INFO:tasks.ceph:check_enable_crimson: False 2024-05-27T10:51:41.967 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-27T10:51:41.967 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:51:41.967 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-27T10:51:41.998 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:42.000+0000 7f2ec2e8c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-27T10:51:42.034 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:51:42.034 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-27T10:51:42.147 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:51:42.147 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-27T10:51:42.181 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:42.183+0000 7f42f35dc040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-27T10:51:42.201 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:42.203+0000 7f2ec2e8c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-27T10:51:42.217 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:51:42.217 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-27T10:51:42.270 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:42.272+0000 7f2ec2e8c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-27T10:51:42.342 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:51:42.342 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-27T10:51:42.396 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:42.398+0000 7f42f35dc040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-27T10:51:42.430 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:51:42.430 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-27T10:51:42.467 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:42.469+0000 7f42f35dc040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-27T10:51:42.506 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:51:42.507 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-27T10:51:42.570 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:42.572+0000 7f2ec2e8c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-27T10:51:42.626 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:42.628+0000 7f2ec2e8c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-27T10:51:42.634 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:51:42.634 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-27T10:51:42.713 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new 6198acec-d103-4b5c-ad8e-e9dfa3b40242 0 2024-05-27T10:51:42.821 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:42.823+0000 7f42f35dc040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-27T10:51:42.885 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:42.887+0000 7f42f35dc040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-27T10:51:42.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.903+0000 7f5d00200640 1 Processor -- start 2024-05-27T10:51:42.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.903+0000 7f5d00200640 1 -- start start 2024-05-27T10:51:42.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.905+0000 7f5d00200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5cf815c8c0 0x7f5cf80cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:42.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.905+0000 7f5d00200640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5cf806c050 0x7f5cf80b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:42.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.905+0000 7f5d00200640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cf815cca0 con 0x7f5cf80cdf90 2024-05-27T10:51:42.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.905+0000 7f5d00200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f5cf80b0a80 con 0x7f5cf815c8c0 2024-05-27T10:51:42.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.905+0000 7f5d00200640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f5cf80ce540 con 0x7f5cf806c050 2024-05-27T10:51:42.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.905+0000 7f5cfe200640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5cf806c050 0x7f5cf80b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:42.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.905+0000 7f5cfce00640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5cf80cdf90 0x7f5cf806b940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34840/0 (socket says 172.21.15.53:34840) 2024-05-27T10:51:42.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.905+0000 7f5cfce00640 1 -- 172.21.15.53:0/2085063627 learned_addr learned my addr 172.21.15.53:0/2085063627 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-27T10:51:42.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.905+0000 7f5cfd800640 1 --2- 172.21.15.53:0/2085063627 >> v2:172.21.15.47:3300/0 conn(0x7f5cf815c8c0 0x7f5cf80cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:42.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.906+0000 7f5cfe200640 1 -- 172.21.15.53:0/2085063627 >> v2:172.21.15.47:3300/0 conn(0x7f5cf815c8c0 msgr2=0x7f5cf80cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:42.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.906+0000 7f5cfe200640 1 --2- 172.21.15.53:0/2085063627 >> v2:172.21.15.47:3300/0 conn(0x7f5cf815c8c0 0x7f5cf80cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:42.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.906+0000 7f5cfe200640 1 -- 172.21.15.53:0/2085063627 >> v1:172.21.15.53:6789/0 conn(0x7f5cf80cdf90 legacy=0x7f5cf806b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:42.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.906+0000 7f5cfe200640 1 -- 172.21.15.53:0/2085063627 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf80ce820 con 0x7f5cf806c050 2024-05-27T10:51:42.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.906+0000 7f5cf7e00640 1 -- 172.21.15.53:0/2085063627 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 809836371 0 0) 0x7f5cf815cca0 con 0x7f5cf80cdf90 2024-05-27T10:51:42.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.908+0000 7f5cfe200640 1 --2- 172.21.15.53:0/2085063627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cf806c050 0x7f5cf80b11f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80d12e0 tx=0x7f5cf002a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5436baaad958d369 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:42.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.908+0000 7f5cf7e00640 1 -- 172.21.15.53:0/2085063627 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0007740 con 0x7f5cf806c050 2024-05-27T10:51:42.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.908+0000 7f5cf7e00640 1 -- 172.21.15.53:0/2085063627 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf00078e0 con 0x7f5cf806c050 2024-05-27T10:51:42.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.908+0000 7f5cf7e00640 1 -- 172.21.15.53:0/2085063627 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0007cb0 con 0x7f5cf806c050 2024-05-27T10:51:42.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.909+0000 7f5d00200640 1 -- 172.21.15.53:0/2085063627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cf806c050 msgr2=0x7f5cf80b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:42.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.909+0000 7f5d00200640 1 --2- 172.21.15.53:0/2085063627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cf806c050 0x7f5cf80b11f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80d12e0 tx=0x7f5cf002a560 comp rx=0 tx=0).stop 2024-05-27T10:51:42.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.909+0000 7f5d00200640 1 -- 172.21.15.53:0/2085063627 shutdown_connections 2024-05-27T10:51:42.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.909+0000 7f5d00200640 1 --2- 172.21.15.53:0/2085063627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cf806c050 0x7f5cf80b11f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:42.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.909+0000 7f5d00200640 1 --2- 172.21.15.53:0/2085063627 >> v2:172.21.15.47:3300/0 conn(0x7f5cf815c8c0 0x7f5cf80cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:42.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.909+0000 7f5d00200640 1 -- 172.21.15.53:0/2085063627 >> 172.21.15.53:0/2085063627 conn(0x7f5cf80b2f70 msgr2=0x7f5cf80b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:42.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.909+0000 7f5d00200640 1 -- 172.21.15.53:0/2085063627 shutdown_connections 2024-05-27T10:51:42.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.909+0000 7f5d00200640 1 -- 172.21.15.53:0/2085063627 wait complete. 2024-05-27T10:51:42.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.911+0000 7f5d00200640 1 Processor -- start 2024-05-27T10:51:42.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.911+0000 7f5d00200640 1 -- start start 2024-05-27T10:51:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.912+0000 7f5d00200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cf806c050 0x7f5cf80cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.912+0000 7f5d00200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cf80cdf90 0x7f5cf80d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.912+0000 7f5d00200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5cf815c8c0 0x7f5cf8151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.912+0000 7f5d00200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf80b3d20 con 0x7f5cf80cdf90 2024-05-27T10:51:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.912+0000 7f5d00200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf80b0cd0 con 0x7f5cf806c050 2024-05-27T10:51:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.912+0000 7f5d00200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf80b1730 con 0x7f5cf815c8c0 2024-05-27T10:51:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.912+0000 7f5cfd800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cf806c050 0x7f5cf80cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.912+0000 7f5cfd800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cf806c050 0x7f5cf80cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44744/0 (socket says 172.21.15.53:44744) 2024-05-27T10:51:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.912+0000 7f5cfe200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5cf815c8c0 0x7f5cf8151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.912+0000 7f5cfd800640 1 -- 172.21.15.53:0/2930930875 learned_addr learned my addr 172.21.15.53:0/2930930875 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-27T10:51:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.913+0000 7f5cfce00640 1 --2- 172.21.15.53:0/2930930875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cf80cdf90 0x7f5cf80d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.913+0000 7f5cfd800640 1 -- 172.21.15.53:0/2930930875 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5cf815c8c0 msgr2=0x7f5cf8151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.913+0000 7f5cfd800640 1 --2- 172.21.15.53:0/2930930875 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5cf815c8c0 0x7f5cf8151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.913+0000 7f5cfd800640 1 -- 172.21.15.53:0/2930930875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cf80cdf90 msgr2=0x7f5cf80d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.913+0000 7f5cfd800640 1 --2- 172.21.15.53:0/2930930875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cf80cdf90 0x7f5cf80d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.913+0000 7f5cfd800640 1 -- 172.21.15.53:0/2930930875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf80b5ae0 con 0x7f5cf806c050 2024-05-27T10:51:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.913+0000 7f5cfd800640 1 --2- 172.21.15.53:0/2930930875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cf806c050 0x7f5cf80cefb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00e870 tx=0x7f5cec00ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.914+0000 7f5cf5600640 1 -- 172.21.15.53:0/2930930875 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec017070 con 0x7f5cf806c050 2024-05-27T10:51:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.914+0000 7f5cf5600640 1 -- 172.21.15.53:0/2930930875 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cec00c940 con 0x7f5cf806c050 2024-05-27T10:51:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.914+0000 7f5cf5600640 1 -- 172.21.15.53:0/2930930875 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec00cd30 con 0x7f5cf806c050 2024-05-27T10:51:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.914+0000 7f5d00200640 1 -- 172.21.15.53:0/2930930875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf80cf640 con 0x7f5cf806c050 2024-05-27T10:51:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.914+0000 7f5d00200640 1 -- 172.21.15.53:0/2930930875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf80cfc00 con 0x7f5cf806c050 2024-05-27T10:51:42.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.914+0000 7f5cf5600640 1 -- 172.21.15.53:0/2930930875 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5cec01a070 con 0x7f5cf806c050 2024-05-27T10:51:42.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.914+0000 7f5cf5600640 1 -- 172.21.15.53:0/2930930875 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f5cec01c820 con 0x7f5cf806c050 2024-05-27T10:51:42.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.915+0000 7f5d00200640 1 -- 172.21.15.53:0/2930930875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf809f5d0 con 0x7f5cf806c050 2024-05-27T10:51:42.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:42.918+0000 7f5cf5600640 1 -- 172.21.15.53:0/2930930875 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5cec013470 con 0x7f5cf806c050 2024-05-27T10:51:42.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.000+0000 7f5d00200640 1 -- 172.21.15.53:0/2930930875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6198acec-d103-4b5c-ad8e-e9dfa3b40242", "id": 0} v 0) -- 0x7f5cf804fdc0 con 0x7f5cf806c050 2024-05-27T10:51:43.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.006+0000 7f5cf5600640 1 -- 172.21.15.53:0/2930930875 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6198acec-d103-4b5c-ad8e-e9dfa3b40242", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f5cec01ca20 con 0x7f5cf806c050 2024-05-27T10:51:43.004 INFO:teuthology.orchestra.run.smithi053.stdout:0 2024-05-27T10:51:43.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.007+0000 7f5d00200640 1 -- 172.21.15.53:0/2930930875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cf806c050 msgr2=0x7f5cf80cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:43.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.007+0000 7f5d00200640 1 --2- 172.21.15.53:0/2930930875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cf806c050 0x7f5cf80cefb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00e870 tx=0x7f5cec00ec70 comp rx=0 tx=0).stop 2024-05-27T10:51:43.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.007+0000 7f5d00200640 1 -- 172.21.15.53:0/2930930875 shutdown_connections 2024-05-27T10:51:43.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.007+0000 7f5d00200640 1 --2- 172.21.15.53:0/2930930875 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5cf815c8c0 0x7f5cf8151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.008+0000 7f5d00200640 1 --2- 172.21.15.53:0/2930930875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cf80cdf90 0x7f5cf80d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.008+0000 7f5d00200640 1 --2- 172.21.15.53:0/2930930875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cf806c050 0x7f5cf80cefb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.008+0000 7f5d00200640 1 -- 172.21.15.53:0/2930930875 >> 172.21.15.53:0/2930930875 conn(0x7f5cf80b2f70 msgr2=0x7f5cf8070090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:43.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.008+0000 7f5d00200640 1 -- 172.21.15.53:0/2930930875 shutdown_connections 2024-05-27T10:51:43.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.008+0000 7f5d00200640 1 -- 172.21.15.53:0/2930930875 wait complete. 2024-05-27T10:51:43.032 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new e893fcd8-a0c8-4504-8737-98bf1bcd77ee 1 2024-05-27T10:51:43.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.232+0000 7fda9fe00640 1 Processor -- start 2024-05-27T10:51:43.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.232+0000 7fda9fe00640 1 -- start start 2024-05-27T10:51:43.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.234+0000 7fda9fe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdaa015e800 0x7fdaa00cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:43.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.234+0000 7fda9fe00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaa00d2f40 0x7fdaa00d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:43.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.234+0000 7fda9fe00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa00cf9b0 con 0x7fdaa00cf350 2024-05-27T10:51:43.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.234+0000 7fda9fe00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fdaa00d05c0 con 0x7fdaa015e800 2024-05-27T10:51:43.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.234+0000 7fda9fe00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa00cfc90 con 0x7fdaa00d2f40 2024-05-27T10:51:43.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.234+0000 7fda9f400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaa00d2f40 0x7fdaa00d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:43.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.234+0000 7fda9f400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaa00d2f40 0x7fdaa00d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:37396/0 (socket says 172.21.15.53:37396) 2024-05-27T10:51:43.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.234+0000 7fda9f400640 1 -- 172.21.15.53:0/4240323490 learned_addr learned my addr 172.21.15.53:0/4240323490 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-27T10:51:43.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.234+0000 7fda9ea00640 1 --2- 172.21.15.53:0/4240323490 >> v2:172.21.15.47:3300/0 conn(0x7fdaa015e800 0x7fdaa00cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:43.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.235+0000 7fda9f400640 1 -- 172.21.15.53:0/4240323490 >> v2:172.21.15.47:3300/0 conn(0x7fdaa015e800 msgr2=0x7fdaa00cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:43.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.235+0000 7fda9f400640 1 --2- 172.21.15.53:0/4240323490 >> v2:172.21.15.47:3300/0 conn(0x7fdaa015e800 0x7fdaa00cee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.235+0000 7fda9f400640 1 -- 172.21.15.53:0/4240323490 >> v1:172.21.15.47:6789/0 conn(0x7fdaa00cf350 legacy=0x7fdaa00d2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:43.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.235+0000 7fda9f400640 1 -- 172.21.15.53:0/4240323490 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa00cff70 con 0x7fdaa00d2f40 2024-05-27T10:51:43.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.236+0000 7fda9f400640 1 --2- 172.21.15.53:0/4240323490 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaa00d2f40 0x7fdaa00d0a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fda98009e50 tx=0x7fda9802a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e264a3abf0dbcc6e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:43.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.236+0000 7fda9e000640 1 -- 172.21.15.53:0/4240323490 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98036070 con 0x7fdaa00d2f40 2024-05-27T10:51:43.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.237+0000 7fda9e000640 1 -- 172.21.15.53:0/4240323490 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda98031600 con 0x7fdaa00d2f40 2024-05-27T10:51:43.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.237+0000 7fda9e000640 1 -- 172.21.15.53:0/4240323490 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda980319d0 con 0x7fdaa00d2f40 2024-05-27T10:51:43.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.237+0000 7fda9fe00640 1 -- 172.21.15.53:0/4240323490 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaa00d2f40 msgr2=0x7fdaa00d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:43.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.237+0000 7fda9fe00640 1 --2- 172.21.15.53:0/4240323490 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaa00d2f40 0x7fdaa00d0a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fda98009e50 tx=0x7fda9802a6c0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.237+0000 7fda9fe00640 1 -- 172.21.15.53:0/4240323490 shutdown_connections 2024-05-27T10:51:43.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.237+0000 7fda9fe00640 1 --2- 172.21.15.53:0/4240323490 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaa00d2f40 0x7fdaa00d0a50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.237+0000 7fda9fe00640 1 --2- 172.21.15.53:0/4240323490 >> v2:172.21.15.47:3300/0 conn(0x7fdaa015e800 0x7fdaa00cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.237+0000 7fda9fe00640 1 -- 172.21.15.53:0/4240323490 >> 172.21.15.53:0/4240323490 conn(0x7fdaa009d890 msgr2=0x7fdaa008bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:43.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.237+0000 7fda9fe00640 1 -- 172.21.15.53:0/4240323490 shutdown_connections 2024-05-27T10:51:43.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.237+0000 7fda9fe00640 1 -- 172.21.15.53:0/4240323490 wait complete. 2024-05-27T10:51:43.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.240+0000 7fda9fe00640 1 Processor -- start 2024-05-27T10:51:43.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.240+0000 7fda9fe00640 1 -- start start 2024-05-27T10:51:43.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.241+0000 7fda9fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaa00cf350 0x7fdaa0158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:43.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.241+0000 7fda9fe00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaa00d2f40 0x7fdaa00b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:43.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.241+0000 7fda9fe00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaa015e800 0x7fdaa00b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:43.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.241+0000 7fda9fe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa00d0f90 con 0x7fdaa00cf350 2024-05-27T10:51:43.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.241+0000 7fda9fe00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa00b5810 con 0x7fdaa00d2f40 2024-05-27T10:51:43.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.241+0000 7fda9fe00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa00d1110 con 0x7fdaa015e800 2024-05-27T10:51:43.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.241+0000 7fda9f400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaa015e800 0x7fdaa00b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:43.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.241+0000 7fda97e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaa00d2f40 0x7fdaa00b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:43.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.241+0000 7fda97e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaa00d2f40 0x7fdaa00b2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44754/0 (socket says 172.21.15.53:44754) 2024-05-27T10:51:43.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.241+0000 7fda9f400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaa015e800 0x7fdaa00b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:37408/0 (socket says 172.21.15.53:37408) 2024-05-27T10:51:43.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.241+0000 7fda97e00640 1 -- 172.21.15.53:0/3400283736 learned_addr learned my addr 172.21.15.53:0/3400283736 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-27T10:51:43.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.241+0000 7fda9ea00640 1 --2- 172.21.15.53:0/3400283736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaa00cf350 0x7fdaa0158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:43.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.242+0000 7fda97e00640 1 -- 172.21.15.53:0/3400283736 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaa015e800 msgr2=0x7fdaa00b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:43.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.242+0000 7fda97e00640 1 --2- 172.21.15.53:0/3400283736 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaa015e800 0x7fdaa00b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.242+0000 7fda97e00640 1 -- 172.21.15.53:0/3400283736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaa00cf350 msgr2=0x7fdaa0158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:43.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.242+0000 7fda97e00640 1 --2- 172.21.15.53:0/3400283736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaa00cf350 0x7fdaa0158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.242+0000 7fda97e00640 1 -- 172.21.15.53:0/3400283736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa00b1230 con 0x7fdaa00d2f40 2024-05-27T10:51:43.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.242+0000 7fda9f400640 1 --2- 172.21.15.53:0/3400283736 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaa015e800 0x7fdaa00b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T10:51:43.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.242+0000 7fda97e00640 1 --2- 172.21.15.53:0/3400283736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaa00d2f40 0x7fdaa00b2390 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fda8800c430 tx=0x7fda8800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:43.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.242+0000 7fda96a00640 1 -- 172.21.15.53:0/3400283736 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda88011790 con 0x7fdaa00d2f40 2024-05-27T10:51:43.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.242+0000 7fda96a00640 1 -- 172.21.15.53:0/3400283736 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda88017070 con 0x7fdaa00d2f40 2024-05-27T10:51:43.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.242+0000 7fda96a00640 1 -- 172.21.15.53:0/3400283736 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda88011b70 con 0x7fdaa00d2f40 2024-05-27T10:51:43.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.242+0000 7fda9fe00640 1 -- 172.21.15.53:0/3400283736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa00b1510 con 0x7fdaa00d2f40 2024-05-27T10:51:43.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.243+0000 7fda9fe00640 1 -- 172.21.15.53:0/3400283736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa00b1ad0 con 0x7fdaa00d2f40 2024-05-27T10:51:43.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.243+0000 7fda96a00640 1 -- 172.21.15.53:0/3400283736 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fda88011d10 con 0x7fdaa00d2f40 2024-05-27T10:51:43.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.243+0000 7fda96a00640 1 -- 172.21.15.53:0/3400283736 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fda880127b0 con 0x7fdaa00d2f40 2024-05-27T10:51:43.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.244+0000 7fda9fe00640 1 -- 172.21.15.53:0/3400283736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaa004fce0 con 0x7fdaa00d2f40 2024-05-27T10:51:43.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.246+0000 7fda96a00640 1 -- 172.21.15.53:0/3400283736 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fda880129b0 con 0x7fdaa00d2f40 2024-05-27T10:51:43.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.325+0000 7fda9fe00640 1 -- 172.21.15.53:0/3400283736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e893fcd8-a0c8-4504-8737-98bf1bcd77ee", "id": 1} v 0) -- 0x7fdaa006cde0 con 0x7fdaa00d2f40 2024-05-27T10:51:43.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.333+0000 7fda96a00640 1 -- 172.21.15.53:0/3400283736 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e893fcd8-a0c8-4504-8737-98bf1bcd77ee", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fda88012b90 con 0x7fdaa00d2f40 2024-05-27T10:51:43.331 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-05-27T10:51:43.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.334+0000 7fda9fe00640 1 -- 172.21.15.53:0/3400283736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaa00d2f40 msgr2=0x7fdaa00b2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:43.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.334+0000 7fda9fe00640 1 --2- 172.21.15.53:0/3400283736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaa00d2f40 0x7fdaa00b2390 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fda8800c430 tx=0x7fda8800c8f0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.334+0000 7fda9fe00640 1 -- 172.21.15.53:0/3400283736 shutdown_connections 2024-05-27T10:51:43.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.334+0000 7fda9fe00640 1 --2- 172.21.15.53:0/3400283736 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaa015e800 0x7fdaa00b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.334+0000 7fda9fe00640 1 --2- 172.21.15.53:0/3400283736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaa00d2f40 0x7fdaa00b2390 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.334+0000 7fda9fe00640 1 --2- 172.21.15.53:0/3400283736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaa00cf350 0x7fdaa0158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.334+0000 7fda9fe00640 1 -- 172.21.15.53:0/3400283736 >> 172.21.15.53:0/3400283736 conn(0x7fdaa009d890 msgr2=0x7fdaa00d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:43.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.334+0000 7fda9fe00640 1 -- 172.21.15.53:0/3400283736 shutdown_connections 2024-05-27T10:51:43.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.334+0000 7fda9fe00640 1 -- 172.21.15.53:0/3400283736 wait complete. 2024-05-27T10:51:43.348 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new 66f5ebff-f4e8-4f73-b483-d328f0aba6f5 2 2024-05-27T10:51:43.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.519+0000 7fc090600640 1 Processor -- start 2024-05-27T10:51:43.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.520+0000 7fc090600640 1 -- start start 2024-05-27T10:51:43.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.521+0000 7fc090600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc0880afd70 0x7fc0880b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:43.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.521+0000 7fc090600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc088072440 0x7fc0880b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:43.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.521+0000 7fc090600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc08806de00 con 0x7fc0881473d0 2024-05-27T10:51:43.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.521+0000 7fc090600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc08806e0e0 con 0x7fc088072440 2024-05-27T10:51:43.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.521+0000 7fc090600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc08806e3c0 con 0x7fc0880afd70 2024-05-27T10:51:43.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.521+0000 7fc08d200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc0880afd70 0x7fc0880b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:43.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.522+0000 7fc08d200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc0880afd70 0x7fc0880b4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:37424/0 (socket says 172.21.15.53:37424) 2024-05-27T10:51:43.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.522+0000 7fc08d200640 1 -- 172.21.15.53:0/3668491535 learned_addr learned my addr 172.21.15.53:0/3668491535 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-27T10:51:43.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.522+0000 7fc08e600640 1 --2- 172.21.15.53:0/3668491535 >> v2:172.21.15.47:3300/0 conn(0x7fc088072440 0x7fc0880b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:43.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.522+0000 7fc08d200640 1 -- 172.21.15.53:0/3668491535 >> v2:172.21.15.47:3300/0 conn(0x7fc088072440 msgr2=0x7fc0880b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:43.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.522+0000 7fc08d200640 1 --2- 172.21.15.53:0/3668491535 >> v2:172.21.15.47:3300/0 conn(0x7fc088072440 0x7fc0880b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.522+0000 7fc08d200640 1 -- 172.21.15.53:0/3668491535 >> v1:172.21.15.47:6789/0 conn(0x7fc0881473d0 legacy=0x7fc088071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:43.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.522+0000 7fc08d200640 1 -- 172.21.15.53:0/3668491535 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08806e6a0 con 0x7fc0880afd70 2024-05-27T10:51:43.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.522+0000 7fc08e600640 1 --2- 172.21.15.53:0/3668491535 >> v2:172.21.15.47:3300/0 conn(0x7fc088072440 0x7fc0880b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:51:43.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.523+0000 7fc08d200640 1 --2- 172.21.15.53:0/3668491535 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc0880afd70 0x7fc0880b4e10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc074009870 tx=0x7fc07402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aef1b708428ac0f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:43.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.524+0000 7fc087e00640 1 -- 172.21.15.53:0/3668491535 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074037070 con 0x7fc0880afd70 2024-05-27T10:51:43.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.524+0000 7fc087e00640 1 -- 172.21.15.53:0/3668491535 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc074032440 con 0x7fc0880afd70 2024-05-27T10:51:43.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.524+0000 7fc087e00640 1 -- 172.21.15.53:0/3668491535 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074032810 con 0x7fc0880afd70 2024-05-27T10:51:43.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.524+0000 7fc090600640 1 -- 172.21.15.53:0/3668491535 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc0880afd70 msgr2=0x7fc0880b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:43.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.524+0000 7fc090600640 1 --2- 172.21.15.53:0/3668491535 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc0880afd70 0x7fc0880b4e10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc074009870 tx=0x7fc07402a180 comp rx=0 tx=0).stop 2024-05-27T10:51:43.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.525+0000 7fc090600640 1 -- 172.21.15.53:0/3668491535 shutdown_connections 2024-05-27T10:51:43.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.525+0000 7fc090600640 1 --2- 172.21.15.53:0/3668491535 >> v2:172.21.15.47:3300/0 conn(0x7fc088072440 0x7fc0880b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.525+0000 7fc090600640 1 --2- 172.21.15.53:0/3668491535 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc0880afd70 0x7fc0880b4e10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.525+0000 7fc090600640 1 -- 172.21.15.53:0/3668491535 >> 172.21.15.53:0/3668491535 conn(0x7fc0880b21e0 msgr2=0x7fc0880b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:43.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.525+0000 7fc090600640 1 -- 172.21.15.53:0/3668491535 shutdown_connections 2024-05-27T10:51:43.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.525+0000 7fc090600640 1 -- 172.21.15.53:0/3668491535 wait complete. 2024-05-27T10:51:43.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.527+0000 7fc090600640 1 Processor -- start 2024-05-27T10:51:43.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.528+0000 7fc090600640 1 -- start start 2024-05-27T10:51:43.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.529+0000 7fc090600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc088072440 0x7fc08815d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:43.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.529+0000 7fc090600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0880afd70 0x7fc08815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:43.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.529+0000 7fc090600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0881473d0 0x7fc08815c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:43.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.529+0000 7fc090600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc088168510 con 0x7fc0881473d0 2024-05-27T10:51:43.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.529+0000 7fc090600640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc088168390 con 0x7fc0880afd70 2024-05-27T10:51:43.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.529+0000 7fc090600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc088168690 con 0x7fc088072440 2024-05-27T10:51:43.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.529+0000 7fc08dc00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc088072440 0x7fc08815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:43.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.529+0000 7fc08d200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0880afd70 0x7fc08815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:43.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.529+0000 7fc08dc00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc088072440 0x7fc08815d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:37438/0 (socket says 172.21.15.53:37438) 2024-05-27T10:51:43.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.529+0000 7fc08dc00640 1 -- 172.21.15.53:0/3956754591 learned_addr learned my addr 172.21.15.53:0/3956754591 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-27T10:51:43.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.530+0000 7fc08e600640 1 --2- 172.21.15.53:0/3956754591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0881473d0 0x7fc08815c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:43.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.530+0000 7fc08d200640 1 -- 172.21.15.53:0/3956754591 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc088072440 msgr2=0x7fc08815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:43.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.530+0000 7fc08d200640 1 --2- 172.21.15.53:0/3956754591 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc088072440 0x7fc08815d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.530+0000 7fc08d200640 1 -- 172.21.15.53:0/3956754591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0881473d0 msgr2=0x7fc08815c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:43.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.530+0000 7fc08d200640 1 --2- 172.21.15.53:0/3956754591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0881473d0 0x7fc08815c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.530+0000 7fc08d200640 1 -- 172.21.15.53:0/3956754591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc088160a10 con 0x7fc0880afd70 2024-05-27T10:51:43.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.530+0000 7fc08dc00640 1 --2- 172.21.15.53:0/3956754591 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc088072440 0x7fc08815d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T10:51:43.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.530+0000 7fc08d200640 1 --2- 172.21.15.53:0/3956754591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0880afd70 0x7fc08815ddb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc074031000 tx=0x7fc0740046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:43.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.530+0000 7fc085600640 1 -- 172.21.15.53:0/3956754591 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074041070 con 0x7fc0880afd70 2024-05-27T10:51:43.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.531+0000 7fc085600640 1 -- 172.21.15.53:0/3956754591 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc07403c930 con 0x7fc0880afd70 2024-05-27T10:51:43.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.531+0000 7fc085600640 1 -- 172.21.15.53:0/3956754591 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074037040 con 0x7fc0880afd70 2024-05-27T10:51:43.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.531+0000 7fc090600640 1 -- 172.21.15.53:0/3956754591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc08815d100 con 0x7fc0880afd70 2024-05-27T10:51:43.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.531+0000 7fc090600640 1 -- 172.21.15.53:0/3956754591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc08815ef60 con 0x7fc0880afd70 2024-05-27T10:51:43.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.531+0000 7fc085600640 1 -- 172.21.15.53:0/3956754591 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc074044070 con 0x7fc0880afd70 2024-05-27T10:51:43.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.531+0000 7fc085600640 1 -- 172.21.15.53:0/3956754591 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fc074032440 con 0x7fc0880afd70 2024-05-27T10:51:43.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.532+0000 7fc090600640 1 -- 172.21.15.53:0/3956754591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc08815d620 con 0x7fc0880afd70 2024-05-27T10:51:43.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.535+0000 7fc085600640 1 -- 172.21.15.53:0/3956754591 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc08815d620 con 0x7fc0880afd70 2024-05-27T10:51:43.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.615+0000 7fc090600640 1 -- 172.21.15.53:0/3956754591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "66f5ebff-f4e8-4f73-b483-d328f0aba6f5", "id": 2} v 0) -- 0x7fc088073800 con 0x7fc0880afd70 2024-05-27T10:51:43.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.621+0000 7fc085600640 1 -- 172.21.15.53:0/3956754591 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "66f5ebff-f4e8-4f73-b483-d328f0aba6f5", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fc07403cd20 con 0x7fc0880afd70 2024-05-27T10:51:43.619 INFO:teuthology.orchestra.run.smithi053.stdout:2 2024-05-27T10:51:43.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.622+0000 7fc090600640 1 -- 172.21.15.53:0/3956754591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0880afd70 msgr2=0x7fc08815ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:43.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.622+0000 7fc090600640 1 --2- 172.21.15.53:0/3956754591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0880afd70 0x7fc08815ddb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc074031000 tx=0x7fc0740046c0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.623+0000 7fc090600640 1 -- 172.21.15.53:0/3956754591 shutdown_connections 2024-05-27T10:51:43.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.623+0000 7fc090600640 1 --2- 172.21.15.53:0/3956754591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0881473d0 0x7fc08815c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.623+0000 7fc090600640 1 --2- 172.21.15.53:0/3956754591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0880afd70 0x7fc08815ddb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.623+0000 7fc090600640 1 --2- 172.21.15.53:0/3956754591 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc088072440 0x7fc08815d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.623+0000 7fc090600640 1 -- 172.21.15.53:0/3956754591 >> 172.21.15.53:0/3956754591 conn(0x7fc0880b21e0 msgr2=0x7fc0880b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:43.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.623+0000 7fc090600640 1 -- 172.21.15.53:0/3956754591 shutdown_connections 2024-05-27T10:51:43.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.623+0000 7fc090600640 1 -- 172.21.15.53:0/3956754591 wait complete. 2024-05-27T10:51:43.628 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:43.629+0000 7f2ec2e8c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-27T10:51:43.637 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new e659251d-46ba-4790-b235-e3e9c6b324aa 3 2024-05-27T10:51:43.735 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:43.737+0000 7f2ec2e8c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-27T10:51:43.788 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:43.790+0000 7f2ec2e8c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-27T10:51:43.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.831+0000 7f8558c00640 1 Processor -- start 2024-05-27T10:51:43.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.831+0000 7f8558c00640 1 -- start start 2024-05-27T10:51:43.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.833+0000 7f8558c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f855406f020 0x7f855406f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:43.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.833+0000 7f8558c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8554070860 0x7f85540cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:43.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.833+0000 7f8558c00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85540d0e20 con 0x7f85540d0510 2024-05-27T10:51:43.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.833+0000 7f8558c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f85540b0860 con 0x7f8554070860 2024-05-27T10:51:43.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.833+0000 7f8558c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8554162440 con 0x7f855406f020 2024-05-27T10:51:43.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.833+0000 7f8553400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f855406f020 0x7f855406f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:43.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.833+0000 7f8552a00640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f85540d0510 0x7f8554070150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34852/0 (socket says 172.21.15.53:34852) 2024-05-27T10:51:43.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.833+0000 7f8552a00640 1 -- 172.21.15.53:0/604794758 learned_addr learned my addr 172.21.15.53:0/604794758 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-27T10:51:43.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.833+0000 7f8553e00640 1 --2- 172.21.15.53:0/604794758 >> v2:172.21.15.47:3300/0 conn(0x7f8554070860 0x7f85540cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:43.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.834+0000 7f8553400640 1 -- 172.21.15.53:0/604794758 >> v2:172.21.15.47:3300/0 conn(0x7f8554070860 msgr2=0x7f85540cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:43.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.834+0000 7f8553400640 1 --2- 172.21.15.53:0/604794758 >> v2:172.21.15.47:3300/0 conn(0x7f8554070860 0x7f85540cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.834+0000 7f8553400640 1 -- 172.21.15.53:0/604794758 >> v1:172.21.15.53:6789/0 conn(0x7f85540d0510 legacy=0x7f8554070150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:43.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.834+0000 7f8553400640 1 -- 172.21.15.53:0/604794758 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8554162720 con 0x7f855406f020 2024-05-27T10:51:43.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.834+0000 7f8552000640 1 -- 172.21.15.53:0/604794758 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3436358865 0 0) 0x7f85540d0e20 con 0x7f85540d0510 2024-05-27T10:51:43.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.835+0000 7f8553400640 1 --2- 172.21.15.53:0/604794758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f855406f020 0x7f855406f400 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f85440097a0 tx=0x7f854402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36305ad66876c063 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:43.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.835+0000 7f8552000640 1 -- 172.21.15.53:0/604794758 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8544037070 con 0x7f855406f020 2024-05-27T10:51:43.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.835+0000 7f8552000640 1 -- 172.21.15.53:0/604794758 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8544032440 con 0x7f855406f020 2024-05-27T10:51:43.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.835+0000 7f8552000640 1 -- 172.21.15.53:0/604794758 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8544032810 con 0x7f855406f020 2024-05-27T10:51:43.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.836+0000 7f8558c00640 1 -- 172.21.15.53:0/604794758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f855406f020 msgr2=0x7f855406f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:43.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.836+0000 7f8558c00640 1 --2- 172.21.15.53:0/604794758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f855406f020 0x7f855406f400 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f85440097a0 tx=0x7f854402a210 comp rx=0 tx=0).stop 2024-05-27T10:51:43.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.836+0000 7f8558c00640 1 -- 172.21.15.53:0/604794758 shutdown_connections 2024-05-27T10:51:43.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.836+0000 7f8558c00640 1 --2- 172.21.15.53:0/604794758 >> v2:172.21.15.47:3300/0 conn(0x7f8554070860 0x7f85540cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.836+0000 7f8558c00640 1 --2- 172.21.15.53:0/604794758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f855406f020 0x7f855406f400 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.836+0000 7f8558c00640 1 -- 172.21.15.53:0/604794758 >> 172.21.15.53:0/604794758 conn(0x7f85540b2d60 msgr2=0x7f85540b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:43.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.836+0000 7f8558c00640 1 -- 172.21.15.53:0/604794758 shutdown_connections 2024-05-27T10:51:43.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.836+0000 7f8558c00640 1 -- 172.21.15.53:0/604794758 wait complete. 2024-05-27T10:51:43.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.838+0000 7f8558c00640 1 Processor -- start 2024-05-27T10:51:43.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.838+0000 7f8558c00640 1 -- start start 2024-05-27T10:51:43.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.839+0000 7f8558c00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f855406f020 0x7f85540b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:43.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.839+0000 7f8558c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8554070860 0x7f855415faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:43.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.839+0000 7f8558c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f85540d0510 0x7f855415d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:43.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.839+0000 7f8558c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f855406f940 con 0x7f8554070860 2024-05-27T10:51:43.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.839+0000 7f8558c00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8554162ce0 con 0x7f855406f020 2024-05-27T10:51:43.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.839+0000 7f8558c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8554163200 con 0x7f85540d0510 2024-05-27T10:51:43.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.839+0000 7f8553e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f85540d0510 0x7f855415d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:43.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.839+0000 7f8553400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f855406f020 0x7f85540b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:43.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.839+0000 7f8553e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f85540d0510 0x7f855415d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:37452/0 (socket says 172.21.15.53:37452) 2024-05-27T10:51:43.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.839+0000 7f8553e00640 1 -- 172.21.15.53:0/2630349275 learned_addr learned my addr 172.21.15.53:0/2630349275 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-27T10:51:43.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.839+0000 7f8552a00640 1 --2- 172.21.15.53:0/2630349275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8554070860 0x7f855415faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:43.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.839+0000 7f8553e00640 1 -- 172.21.15.53:0/2630349275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f855406f020 msgr2=0x7f85540b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:43.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.840+0000 7f8553e00640 1 --2- 172.21.15.53:0/2630349275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f855406f020 0x7f85540b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.840+0000 7f8553e00640 1 -- 172.21.15.53:0/2630349275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8554070860 msgr2=0x7f855415faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:43.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.840+0000 7f8553e00640 1 --2- 172.21.15.53:0/2630349275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8554070860 0x7f855415faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.840+0000 7f8553e00640 1 -- 172.21.15.53:0/2630349275 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855415dce0 con 0x7f85540d0510 2024-05-27T10:51:43.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.840+0000 7f8553e00640 1 --2- 172.21.15.53:0/2630349275 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f85540d0510 0x7f855415d7a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f854c007de0 tx=0x7f854c00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:43.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.840+0000 7f854b400640 1 -- 172.21.15.53:0/2630349275 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c014620 con 0x7f85540d0510 2024-05-27T10:51:43.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.840+0000 7f854b400640 1 -- 172.21.15.53:0/2630349275 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854c019070 con 0x7f85540d0510 2024-05-27T10:51:43.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.840+0000 7f854b400640 1 -- 172.21.15.53:0/2630349275 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c014a20 con 0x7f85540d0510 2024-05-27T10:51:43.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.840+0000 7f8558c00640 1 -- 172.21.15.53:0/2630349275 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85540b4450 con 0x7f85540d0510 2024-05-27T10:51:43.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.840+0000 7f8558c00640 1 -- 172.21.15.53:0/2630349275 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f85540b4a10 con 0x7f85540d0510 2024-05-27T10:51:43.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.841+0000 7f854b400640 1 -- 172.21.15.53:0/2630349275 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f854c014bc0 con 0x7f85540d0510 2024-05-27T10:51:43.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.841+0000 7f854b400640 1 -- 172.21.15.53:0/2630349275 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f854c01e8f0 con 0x7f85540d0510 2024-05-27T10:51:43.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.841+0000 7f8558c00640 1 -- 172.21.15.53:0/2630349275 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f855404fce0 con 0x7f85540d0510 2024-05-27T10:51:43.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.844+0000 7f854b400640 1 -- 172.21.15.53:0/2630349275 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f855415dce0 con 0x7f85540d0510 2024-05-27T10:51:43.854 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:43.856+0000 7f42f35dc040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-27T10:51:43.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.927+0000 7f8558c00640 1 -- 172.21.15.53:0/2630349275 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e659251d-46ba-4790-b235-e3e9c6b324aa", "id": 3} v 0) -- 0x7f8554162220 con 0x7f85540d0510 2024-05-27T10:51:43.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.935+0000 7f854b400640 1 -- 172.21.15.53:0/2630349275 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e659251d-46ba-4790-b235-e3e9c6b324aa", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f854c01e460 con 0x7f85540d0510 2024-05-27T10:51:43.933 INFO:teuthology.orchestra.run.smithi053.stdout:3 2024-05-27T10:51:43.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.936+0000 7f8558c00640 1 -- 172.21.15.53:0/2630349275 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f85540d0510 msgr2=0x7f855415d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:43.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.936+0000 7f8558c00640 1 --2- 172.21.15.53:0/2630349275 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f85540d0510 0x7f855415d7a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f854c007de0 tx=0x7f854c00e4b0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.937+0000 7f8558c00640 1 -- 172.21.15.53:0/2630349275 shutdown_connections 2024-05-27T10:51:43.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.937+0000 7f8558c00640 1 --2- 172.21.15.53:0/2630349275 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f85540d0510 0x7f855415d7a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.937+0000 7f8558c00640 1 --2- 172.21.15.53:0/2630349275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8554070860 0x7f855415faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.937+0000 7f8558c00640 1 --2- 172.21.15.53:0/2630349275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f855406f020 0x7f85540b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:43.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.937+0000 7f8558c00640 1 -- 172.21.15.53:0/2630349275 >> 172.21.15.53:0/2630349275 conn(0x7f85540b2d60 msgr2=0x7f855406fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:43.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.937+0000 7f8558c00640 1 -- 172.21.15.53:0/2630349275 shutdown_connections 2024-05-27T10:51:43.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:43.937+0000 7f8558c00640 1 -- 172.21.15.53:0/2630349275 wait complete. 2024-05-27T10:51:43.952 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new 6d4a2c12-adba-4422-8996-d7562dbbd49d 4 2024-05-27T10:51:43.976 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:43.978+0000 7f42f35dc040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-27T10:51:43.989 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:43.990+0000 7f2ec2e8c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-27T10:51:44.034 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:44.036+0000 7f42f35dc040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-27T10:51:44.055 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:44.057+0000 7f2ec2e8c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-27T10:51:44.119 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:44.121+0000 7f2ec2e8c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-27T10:51:44.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.152+0000 7fe65f200640 1 Processor -- start 2024-05-27T10:51:44.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.153+0000 7fe65f200640 1 -- start start 2024-05-27T10:51:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.154+0000 7fe65f200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe65815e800 0x7fe6580cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.154+0000 7fe65f200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6580cf350 0x7fe6580d2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.154+0000 7fe65f200640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe6580d2d70 0x7fe6580b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.154+0000 7fe65f200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe6580d31e0 con 0x7fe65815e800 2024-05-27T10:51:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.154+0000 7fe65f200640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe6580d05c0 con 0x7fe6580d2d70 2024-05-27T10:51:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.154+0000 7fe65f200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe6580cf9b0 con 0x7fe6580cf350 2024-05-27T10:51:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.155+0000 7fe65d400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6580cf350 0x7fe6580d2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.155+0000 7fe65e800640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe6580d2d70 0x7fe6580b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.155+0000 7fe65d400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6580cf350 0x7fe6580d2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:37454/0 (socket says 172.21.15.53:37454) 2024-05-27T10:51:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.155+0000 7fe65d400640 1 -- 172.21.15.53:0/680891759 learned_addr learned my addr 172.21.15.53:0/680891759 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-27T10:51:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.155+0000 7fe65e800640 1 --2- 172.21.15.53:0/680891759 >> v2:172.21.15.53:3300/0 conn(0x7fe6580d2d70 0x7fe6580b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44786/0 (socket says 172.21.15.53:44786) 2024-05-27T10:51:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.155+0000 7fe65de00640 1 --2- 172.21.15.53:0/680891759 >> v2:172.21.15.47:3300/0 conn(0x7fe65815e800 0x7fe6580cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.155+0000 7fe65e800640 1 -- 172.21.15.53:0/680891759 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6580cf350 msgr2=0x7fe6580d2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.155+0000 7fe65e800640 1 --2- 172.21.15.53:0/680891759 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6580cf350 0x7fe6580d2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.155+0000 7fe65e800640 1 -- 172.21.15.53:0/680891759 >> v2:172.21.15.47:3300/0 conn(0x7fe65815e800 msgr2=0x7fe6580cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.155+0000 7fe65e800640 1 --2- 172.21.15.53:0/680891759 >> v2:172.21.15.47:3300/0 conn(0x7fe65815e800 0x7fe6580cee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.155+0000 7fe65e800640 1 -- 172.21.15.53:0/680891759 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6580cfc90 con 0x7fe6580d2d70 2024-05-27T10:51:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.155+0000 7fe65d400640 1 --2- 172.21.15.53:0/680891759 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6580cf350 0x7fe6580d2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T10:51:44.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.156+0000 7fe65e800640 1 --2- 172.21.15.53:0/680891759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6580d2d70 0x7fe6580b45e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe6580d3ee0 tx=0x7fe65402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fca833799afa2491 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:44.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.157+0000 7fe65ca00640 1 -- 172.21.15.53:0/680891759 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654031600 con 0x7fe6580d2d70 2024-05-27T10:51:44.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.157+0000 7fe65ca00640 1 -- 172.21.15.53:0/680891759 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6540317a0 con 0x7fe6580d2d70 2024-05-27T10:51:44.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.157+0000 7fe65ca00640 1 -- 172.21.15.53:0/680891759 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654031b70 con 0x7fe6580d2d70 2024-05-27T10:51:44.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.157+0000 7fe65f200640 1 -- 172.21.15.53:0/680891759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6580d2d70 msgr2=0x7fe6580b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:44.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.157+0000 7fe65f200640 1 --2- 172.21.15.53:0/680891759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6580d2d70 0x7fe6580b45e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe6580d3ee0 tx=0x7fe65402a5d0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.157+0000 7fe65f200640 1 -- 172.21.15.53:0/680891759 shutdown_connections 2024-05-27T10:51:44.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.157+0000 7fe65f200640 1 --2- 172.21.15.53:0/680891759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6580d2d70 0x7fe6580b45e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.157+0000 7fe65f200640 1 --2- 172.21.15.53:0/680891759 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6580cf350 0x7fe6580d2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.157+0000 7fe65f200640 1 --2- 172.21.15.53:0/680891759 >> v2:172.21.15.47:3300/0 conn(0x7fe65815e800 0x7fe6580cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.157+0000 7fe65f200640 1 -- 172.21.15.53:0/680891759 >> 172.21.15.53:0/680891759 conn(0x7fe65809d890 msgr2=0x7fe65808bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:44.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.157+0000 7fe65f200640 1 -- 172.21.15.53:0/680891759 shutdown_connections 2024-05-27T10:51:44.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.158+0000 7fe65f200640 1 -- 172.21.15.53:0/680891759 wait complete. 2024-05-27T10:51:44.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.159+0000 7fe65f200640 1 Processor -- start 2024-05-27T10:51:44.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.160+0000 7fe65f200640 1 -- start start 2024-05-27T10:51:44.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.161+0000 7fe65f200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6580cf350 0x7fe658160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:44.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.161+0000 7fe65f200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6580d2d70 0x7fe6580b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:44.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.161+0000 7fe65f200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe65815e800 0x7fe6580cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:44.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.161+0000 7fe65f200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe6580b5810 con 0x7fe65815e800 2024-05-27T10:51:44.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.161+0000 7fe65f200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe6580d0250 con 0x7fe6580d2d70 2024-05-27T10:51:44.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.161+0000 7fe65f200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe6580b4b20 con 0x7fe6580cf350 2024-05-27T10:51:44.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.161+0000 7fe65de00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6580cf350 0x7fe658160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:44.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.161+0000 7fe65de00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6580cf350 0x7fe658160730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:37468/0 (socket says 172.21.15.53:37468) 2024-05-27T10:51:44.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.161+0000 7fe65de00640 1 -- 172.21.15.53:0/918966827 learned_addr learned my addr 172.21.15.53:0/918966827 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-27T10:51:44.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.161+0000 7fe65d400640 1 --2- 172.21.15.53:0/918966827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6580d2d70 0x7fe6580b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:44.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.161+0000 7fe65e800640 1 --2- 172.21.15.53:0/918966827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe65815e800 0x7fe6580cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:44.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.161+0000 7fe65de00640 1 -- 172.21.15.53:0/918966827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6580d2d70 msgr2=0x7fe6580b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:44.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.161+0000 7fe65de00640 1 --2- 172.21.15.53:0/918966827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6580d2d70 0x7fe6580b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.161+0000 7fe65de00640 1 -- 172.21.15.53:0/918966827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe65815e800 msgr2=0x7fe6580cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:44.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.161+0000 7fe65de00640 1 --2- 172.21.15.53:0/918966827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe65815e800 0x7fe6580cddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.161+0000 7fe65de00640 1 -- 172.21.15.53:0/918966827 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6580b1420 con 0x7fe6580cf350 2024-05-27T10:51:44.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.161+0000 7fe65d400640 1 --2- 172.21.15.53:0/918966827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6580d2d70 0x7fe6580b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:51:44.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.162+0000 7fe65de00640 1 --2- 172.21.15.53:0/918966827 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6580cf350 0x7fe658160730 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00d620 tx=0x7fe64c00dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:44.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.162+0000 7fe652000640 1 -- 172.21.15.53:0/918966827 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64c00b620 con 0x7fe6580cf350 2024-05-27T10:51:44.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.162+0000 7fe652000640 1 -- 172.21.15.53:0/918966827 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe64c019070 con 0x7fe6580cf350 2024-05-27T10:51:44.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.162+0000 7fe652000640 1 -- 172.21.15.53:0/918966827 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64c00ba00 con 0x7fe6580cf350 2024-05-27T10:51:44.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.162+0000 7fe65f200640 1 -- 172.21.15.53:0/918966827 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6580b1700 con 0x7fe6580cf350 2024-05-27T10:51:44.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.162+0000 7fe65f200640 1 -- 172.21.15.53:0/918966827 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6580cba70 con 0x7fe6580cf350 2024-05-27T10:51:44.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.163+0000 7fe652000640 1 -- 172.21.15.53:0/918966827 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe64c00bba0 con 0x7fe6580cf350 2024-05-27T10:51:44.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.163+0000 7fe652000640 1 -- 172.21.15.53:0/918966827 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fe64c01e970 con 0x7fe6580cf350 2024-05-27T10:51:44.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.163+0000 7fe65f200640 1 -- 172.21.15.53:0/918966827 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6580b48e0 con 0x7fe6580cf350 2024-05-27T10:51:44.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.166+0000 7fe652000640 1 -- 172.21.15.53:0/918966827 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fe6580b48e0 con 0x7fe6580cf350 2024-05-27T10:51:44.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.245+0000 7fe65f200640 1 -- 172.21.15.53:0/918966827 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6d4a2c12-adba-4422-8996-d7562dbbd49d", "id": 4} v 0) -- 0x7fe65804fce0 con 0x7fe6580cf350 2024-05-27T10:51:44.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.253+0000 7fe652000640 1 -- 172.21.15.53:0/918966827 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6d4a2c12-adba-4422-8996-d7562dbbd49d", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fe64c01e460 con 0x7fe6580cf350 2024-05-27T10:51:44.251 INFO:teuthology.orchestra.run.smithi053.stdout:4 2024-05-27T10:51:44.251 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:44.254+0000 7f42f35dc040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-27T10:51:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.254+0000 7fe65f200640 1 -- 172.21.15.53:0/918966827 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6580cf350 msgr2=0x7fe658160730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.254+0000 7fe65f200640 1 --2- 172.21.15.53:0/918966827 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6580cf350 0x7fe658160730 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00d620 tx=0x7fe64c00dae0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.254+0000 7fe65f200640 1 -- 172.21.15.53:0/918966827 shutdown_connections 2024-05-27T10:51:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.254+0000 7fe65f200640 1 --2- 172.21.15.53:0/918966827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe65815e800 0x7fe6580cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.254+0000 7fe65f200640 1 --2- 172.21.15.53:0/918966827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6580d2d70 0x7fe6580b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.254+0000 7fe65f200640 1 --2- 172.21.15.53:0/918966827 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6580cf350 0x7fe658160730 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.254+0000 7fe65f200640 1 -- 172.21.15.53:0/918966827 >> 172.21.15.53:0/918966827 conn(0x7fe65809d890 msgr2=0x7fe6580d1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:44.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.255+0000 7fe65f200640 1 -- 172.21.15.53:0/918966827 shutdown_connections 2024-05-27T10:51:44.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.255+0000 7fe65f200640 1 -- 172.21.15.53:0/918966827 wait complete. 2024-05-27T10:51:44.253 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:44.254+0000 7f2ec2e8c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-27T10:51:44.269 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new c8687cb8-e78e-4001-a07e-20cffdf5bd66 5 2024-05-27T10:51:44.317 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:44.316+0000 7f42f35dc040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-27T10:51:44.379 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:44.381+0000 7f42f35dc040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-27T10:51:44.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.502+0000 7fcce1000640 1 Processor -- start 2024-05-27T10:51:44.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.502+0000 7fcce1000640 1 -- start start 2024-05-27T10:51:44.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.504+0000 7fcce1000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fccdc144810 0x7fccdc06c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:44.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.504+0000 7fcce1000640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fccdc06ce90 0x7fccdc0b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:44.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.504+0000 7fcce1000640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccdc0cede0 con 0x7fccdc1442a0 2024-05-27T10:51:44.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.504+0000 7fcce1000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fccdc0cf0b0 con 0x7fccdc144810 2024-05-27T10:51:44.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.505+0000 7fcce1000640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fccdc0cf390 con 0x7fccdc06ce90 2024-05-27T10:51:44.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.505+0000 7fccd9e00640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fccdc1442a0 0x7fccdc0ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34860/0 (socket says 172.21.15.53:34860) 2024-05-27T10:51:44.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.505+0000 7fccd9e00640 1 -- 172.21.15.53:0/2972747298 learned_addr learned my addr 172.21.15.53:0/2972747298 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-27T10:51:44.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.505+0000 7fccda800640 1 --2- 172.21.15.53:0/2972747298 >> v2:172.21.15.53:3300/0 conn(0x7fccdc06ce90 0x7fccdc0b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:44.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.505+0000 7fccd3e00640 1 --2- 172.21.15.53:0/2972747298 >> v2:172.21.15.47:3300/0 conn(0x7fccdc144810 0x7fccdc06c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:44.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.505+0000 7fccd9400640 1 -- 172.21.15.53:0/2972747298 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 146771461 0 0) 0x7fccdc0cede0 con 0x7fccdc1442a0 2024-05-27T10:51:44.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.505+0000 7fccd9400640 1 -- 172.21.15.53:0/2972747298 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccc0003520 con 0x7fccdc1442a0 2024-05-27T10:51:44.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.505+0000 7fccda800640 1 -- 172.21.15.53:0/2972747298 >> v2:172.21.15.47:3300/0 conn(0x7fccdc144810 msgr2=0x7fccdc06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:44.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.505+0000 7fccda800640 1 --2- 172.21.15.53:0/2972747298 >> v2:172.21.15.47:3300/0 conn(0x7fccdc144810 0x7fccdc06c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.505+0000 7fccda800640 1 -- 172.21.15.53:0/2972747298 >> v1:172.21.15.53:6789/0 conn(0x7fccdc1442a0 legacy=0x7fccdc0ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:44.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.505+0000 7fccda800640 1 -- 172.21.15.53:0/2972747298 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccdc0cf670 con 0x7fccdc06ce90 2024-05-27T10:51:44.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.506+0000 7fccda800640 1 --2- 172.21.15.53:0/2972747298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccdc06ce90 0x7fccdc0b4480 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0b2870 tx=0x7fccd402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e36f9299d664dda server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:44.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.507+0000 7fccd9400640 1 -- 172.21.15.53:0/2972747298 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd4007740 con 0x7fccdc06ce90 2024-05-27T10:51:44.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.507+0000 7fccd9400640 1 -- 172.21.15.53:0/2972747298 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccd40078e0 con 0x7fccdc06ce90 2024-05-27T10:51:44.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.507+0000 7fccd9400640 1 -- 172.21.15.53:0/2972747298 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd4007cb0 con 0x7fccdc06ce90 2024-05-27T10:51:44.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.507+0000 7fcce1000640 1 -- 172.21.15.53:0/2972747298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccdc06ce90 msgr2=0x7fccdc0b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:44.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.507+0000 7fcce1000640 1 --2- 172.21.15.53:0/2972747298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccdc06ce90 0x7fccdc0b4480 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0b2870 tx=0x7fccd402a5f0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.507+0000 7fcce1000640 1 -- 172.21.15.53:0/2972747298 shutdown_connections 2024-05-27T10:51:44.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.507+0000 7fcce1000640 1 --2- 172.21.15.53:0/2972747298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccdc06ce90 0x7fccdc0b4480 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.507+0000 7fcce1000640 1 --2- 172.21.15.53:0/2972747298 >> v2:172.21.15.47:3300/0 conn(0x7fccdc144810 0x7fccdc06c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.507+0000 7fcce1000640 1 -- 172.21.15.53:0/2972747298 >> 172.21.15.53:0/2972747298 conn(0x7fccdc072410 msgr2=0x7fccdc0727f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:44.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.507+0000 7fcce1000640 1 -- 172.21.15.53:0/2972747298 shutdown_connections 2024-05-27T10:51:44.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.507+0000 7fcce1000640 1 -- 172.21.15.53:0/2972747298 wait complete. 2024-05-27T10:51:44.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.509+0000 7fcce1000640 1 Processor -- start 2024-05-27T10:51:44.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.509+0000 7fcce1000640 1 -- start start 2024-05-27T10:51:44.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.510+0000 7fcce1000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccdc06ce90 0x7fccdc154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:44.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.510+0000 7fcce1000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccdc1442a0 0x7fccdc0ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:44.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.510+0000 7fcce1000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fccdc144810 0x7fccdc0ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:44.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.510+0000 7fcce1000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc067830 con 0x7fccdc1442a0 2024-05-27T10:51:44.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.510+0000 7fcce1000640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc0676b0 con 0x7fccdc06ce90 2024-05-27T10:51:44.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.510+0000 7fcce1000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fccdc0679b0 con 0x7fccdc144810 2024-05-27T10:51:44.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.510+0000 7fccd9e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccdc06ce90 0x7fccdc154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:44.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.510+0000 7fccd9e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccdc06ce90 0x7fccdc154960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44814/0 (socket says 172.21.15.53:44814) 2024-05-27T10:51:44.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.510+0000 7fccd9e00640 1 -- 172.21.15.53:0/3477873300 learned_addr learned my addr 172.21.15.53:0/3477873300 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-27T10:51:44.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.510+0000 7fccda800640 1 --2- 172.21.15.53:0/3477873300 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fccdc144810 0x7fccdc0ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:44.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.511+0000 7fccd3e00640 1 --2- 172.21.15.53:0/3477873300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccdc1442a0 0x7fccdc0ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:44.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.511+0000 7fccd9e00640 1 -- 172.21.15.53:0/3477873300 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fccdc144810 msgr2=0x7fccdc0ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:44.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.511+0000 7fccd9e00640 1 --2- 172.21.15.53:0/3477873300 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fccdc144810 0x7fccdc0ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.511+0000 7fccd9e00640 1 -- 172.21.15.53:0/3477873300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccdc1442a0 msgr2=0x7fccdc0ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:44.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.511+0000 7fccd9e00640 1 --2- 172.21.15.53:0/3477873300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccdc1442a0 0x7fccdc0ae210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.511+0000 7fccd9e00640 1 -- 172.21.15.53:0/3477873300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccdc154ea0 con 0x7fccdc06ce90 2024-05-27T10:51:44.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.511+0000 7fccd3e00640 1 --2- 172.21.15.53:0/3477873300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccdc1442a0 0x7fccdc0ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:51:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.511+0000 7fccd9e00640 1 --2- 172.21.15.53:0/3477873300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccdc06ce90 0x7fccdc154960 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00c460 tx=0x7fcccc00c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.511+0000 7fccd2000640 1 -- 172.21.15.53:0/3477873300 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc017070 con 0x7fccdc06ce90 2024-05-27T10:51:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.511+0000 7fccd2000640 1 -- 172.21.15.53:0/3477873300 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcccc005ce0 con 0x7fccdc06ce90 2024-05-27T10:51:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.511+0000 7fccd2000640 1 -- 172.21.15.53:0/3477873300 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc007290 con 0x7fccdc06ce90 2024-05-27T10:51:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.511+0000 7fcce1000640 1 -- 172.21.15.53:0/3477873300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccdc155660 con 0x7fccdc06ce90 2024-05-27T10:51:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.511+0000 7fcce1000640 1 -- 172.21.15.53:0/3477873300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccdc155c20 con 0x7fccdc06ce90 2024-05-27T10:51:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.512+0000 7fccd2000640 1 -- 172.21.15.53:0/3477873300 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcccc01a070 con 0x7fccdc06ce90 2024-05-27T10:51:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.512+0000 7fccd2000640 1 -- 172.21.15.53:0/3477873300 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fcccc007430 con 0x7fccdc06ce90 2024-05-27T10:51:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.513+0000 7fcce1000640 1 -- 172.21.15.53:0/3477873300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccdc071f10 con 0x7fccdc06ce90 2024-05-27T10:51:44.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.517+0000 7fccd2000640 1 -- 172.21.15.53:0/3477873300 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fccdc071f10 con 0x7fccdc06ce90 2024-05-27T10:51:44.521 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:44.523+0000 7f42f35dc040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-27T10:51:44.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.596+0000 7fcce1000640 1 -- 172.21.15.53:0/3477873300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c8687cb8-e78e-4001-a07e-20cffdf5bd66", "id": 5} v 0) -- 0x7fccdc070820 con 0x7fccdc06ce90 2024-05-27T10:51:44.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.602+0000 7fccd2000640 1 -- 172.21.15.53:0/3477873300 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c8687cb8-e78e-4001-a07e-20cffdf5bd66", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fcccc021020 con 0x7fccdc06ce90 2024-05-27T10:51:44.600 INFO:teuthology.orchestra.run.smithi053.stdout:5 2024-05-27T10:51:44.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.603+0000 7fcce1000640 1 -- 172.21.15.53:0/3477873300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccdc06ce90 msgr2=0x7fccdc154960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:44.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.603+0000 7fcce1000640 1 --2- 172.21.15.53:0/3477873300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccdc06ce90 0x7fccdc154960 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00c460 tx=0x7fcccc00c920 comp rx=0 tx=0).stop 2024-05-27T10:51:44.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.604+0000 7fcce1000640 1 -- 172.21.15.53:0/3477873300 shutdown_connections 2024-05-27T10:51:44.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.604+0000 7fcce1000640 1 --2- 172.21.15.53:0/3477873300 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fccdc144810 0x7fccdc0ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.604+0000 7fcce1000640 1 --2- 172.21.15.53:0/3477873300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccdc1442a0 0x7fccdc0ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.604+0000 7fcce1000640 1 --2- 172.21.15.53:0/3477873300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccdc06ce90 0x7fccdc154960 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.604+0000 7fcce1000640 1 -- 172.21.15.53:0/3477873300 >> 172.21.15.53:0/3477873300 conn(0x7fccdc072410 msgr2=0x7fccdc070010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:44.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.604+0000 7fcce1000640 1 -- 172.21.15.53:0/3477873300 shutdown_connections 2024-05-27T10:51:44.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.604+0000 7fcce1000640 1 -- 172.21.15.53:0/3477873300 wait complete. 2024-05-27T10:51:44.617 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new 3809de92-ab70-43c5-861e-0c7477e17f00 6 2024-05-27T10:51:44.728 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:44.730+0000 7f2ec2e8c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-27T10:51:44.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.791+0000 7f2a07000640 1 Processor -- start 2024-05-27T10:51:44.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.792+0000 7f2a07000640 1 -- start start 2024-05-27T10:51:44.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.793+0000 7f2a07000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2a000b6670 0x7f2a00169600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:44.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.793+0000 7f2a07000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a000ced40 con 0x7f2a0015e630 2024-05-27T10:51:44.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.793+0000 7f2a07000640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a000cf020 con 0x7f2a000cfde0 2024-05-27T10:51:44.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.793+0000 7f2a07000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2a000cf950 con 0x7f2a000b6670 2024-05-27T10:51:44.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.794+0000 7f2a05200640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2a000cfde0 0x7f2a000b5f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34862/0 (socket says 172.21.15.53:34862) 2024-05-27T10:51:44.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.794+0000 7f2a05200640 1 -- 172.21.15.53:0/3937113412 learned_addr learned my addr 172.21.15.53:0/3937113412 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-27T10:51:44.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.794+0000 7f2a06600640 1 --2- 172.21.15.53:0/3937113412 >> v2:172.21.15.47:3300/0 conn(0x7f2a000b6670 0x7f2a00169600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:44.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.794+0000 7f29ffe00640 1 -- 172.21.15.53:0/3937113412 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4292913538 0 0) 0x7f2a000cf020 con 0x7f2a000cfde0 2024-05-27T10:51:44.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.794+0000 7f29ffe00640 1 -- 172.21.15.53:0/3937113412 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29e8003520 con 0x7f2a000cfde0 2024-05-27T10:51:44.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.794+0000 7f29ffe00640 1 -- 172.21.15.53:0/3937113412 <== mon.1 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3034960335 0 0) 0x7f29e8003520 con 0x7f2a000cfde0 2024-05-27T10:51:44.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.794+0000 7f29ffe00640 1 -- 172.21.15.53:0/3937113412 >> v2:172.21.15.47:3300/0 conn(0x7f2a000b6670 msgr2=0x7f2a00169600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:44.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.794+0000 7f29ffe00640 1 --2- 172.21.15.53:0/3937113412 >> v2:172.21.15.47:3300/0 conn(0x7f2a000b6670 0x7f2a00169600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.794+0000 7f29ffe00640 1 -- 172.21.15.53:0/3937113412 >> v1:172.21.15.47:6789/0 conn(0x7f2a0015e630 legacy=0x7f2a000d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:44.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.794+0000 7f29ffe00640 1 -- 172.21.15.53:0/3937113412 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a000cf300 con 0x7f2a000cfde0 2024-05-27T10:51:44.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.794+0000 7f29ffe00640 1 -- 172.21.15.53:0/3937113412 <== mon.1 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f29ec001670 con 0x7f2a000cfde0 2024-05-27T10:51:44.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.794+0000 7f29ffe00640 1 -- 172.21.15.53:0/3937113412 >> v1:172.21.15.53:6789/0 conn(0x7f2a000cfde0 legacy=0x7f2a000b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:44.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.795+0000 7f29ffe00640 1 --2- 172.21.15.53:0/3937113412 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f29e8003a00 0x7f29e8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:44.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.795+0000 7f29ffe00640 1 --2- 172.21.15.53:0/3937113412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e8004800 0x7f29e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:44.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.795+0000 7f29ffe00640 1 --2- 172.21.15.53:0/3937113412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29e80051c0 0x7f29e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:44.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.795+0000 7f29ffe00640 1 -- 172.21.15.53:0/3937113412 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2a000cf950 con 0x7f29e8004800 2024-05-27T10:51:44.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.795+0000 7f29ffe00640 1 -- 172.21.15.53:0/3937113412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f29e800c0c0 con 0x7f29e80051c0 2024-05-27T10:51:44.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.795+0000 7f29ffe00640 1 -- 172.21.15.53:0/3937113412 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f29e800c2c0 con 0x7f29e8003a00 2024-05-27T10:51:44.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.795+0000 7f2a05c00640 1 --2- 172.21.15.53:0/3937113412 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f29e8003a00 0x7f29e8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:44.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.795+0000 7f2a06600640 1 --2- 172.21.15.53:0/3937113412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29e80051c0 0x7f29e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:44.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.795+0000 7f2a05200640 1 --2- 172.21.15.53:0/3937113412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e8004800 0x7f29e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:44.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.795+0000 7f2a06600640 1 -- 172.21.15.53:0/3937113412 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f29e8003a00 msgr2=0x7f29e8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:44.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.795+0000 7f2a06600640 1 --2- 172.21.15.53:0/3937113412 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f29e8003a00 0x7f29e8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.795+0000 7f2a06600640 1 -- 172.21.15.53:0/3937113412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e8004800 msgr2=0x7f29e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:44.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.795+0000 7f2a06600640 1 --2- 172.21.15.53:0/3937113412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e8004800 0x7f29e8004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.795+0000 7f2a06600640 1 -- 172.21.15.53:0/3937113412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e8003520 con 0x7f29e80051c0 2024-05-27T10:51:44.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.796+0000 7f2a06600640 1 -- 172.21.15.53:0/3937113412 reap_dead start 2024-05-27T10:51:44.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.796+0000 7f2a06600640 1 --2- 172.21.15.53:0/3937113412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29e80051c0 0x7f29e800b9c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f29f8009fc0 tx=0x7f29e8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78cda7d9a858d72d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:44.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.797+0000 7f29ffe00640 1 -- 172.21.15.53:0/3937113412 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f8035020 con 0x7f29e80051c0 2024-05-27T10:51:44.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.797+0000 7f29ffe00640 1 -- 172.21.15.53:0/3937113412 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f8003bd0 con 0x7f29e80051c0 2024-05-27T10:51:44.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.797+0000 7f29ffe00640 1 -- 172.21.15.53:0/3937113412 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f8009c10 con 0x7f29e80051c0 2024-05-27T10:51:44.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.797+0000 7f2a07000640 1 -- 172.21.15.53:0/3937113412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29e80051c0 msgr2=0x7f29e800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:44.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.797+0000 7f2a07000640 1 --2- 172.21.15.53:0/3937113412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29e80051c0 0x7f29e800b9c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f29f8009fc0 tx=0x7f29e8005830 comp rx=0 tx=0).stop 2024-05-27T10:51:44.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.797+0000 7f2a07000640 1 -- 172.21.15.53:0/3937113412 shutdown_connections 2024-05-27T10:51:44.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.797+0000 7f2a07000640 1 --2- 172.21.15.53:0/3937113412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29e80051c0 0x7f29e800b9c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.797+0000 7f2a07000640 1 -- 172.21.15.53:0/3937113412 >> 172.21.15.53:0/3937113412 conn(0x7f2a0008bfd0 msgr2=0x7f2a000d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:44.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.797+0000 7f2a07000640 1 -- 172.21.15.53:0/3937113412 shutdown_connections 2024-05-27T10:51:44.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.797+0000 7f2a07000640 1 -- 172.21.15.53:0/3937113412 wait complete. 2024-05-27T10:51:44.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.799+0000 7f2a07000640 1 Processor -- start 2024-05-27T10:51:44.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.799+0000 7f2a07000640 1 -- start start 2024-05-27T10:51:44.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.800+0000 7f2a07000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e80051c0 0x7f2a000ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:44.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.800+0000 7f2a07000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2a000b7330 0x7f2a0015fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:44.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.800+0000 7f2a07000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a001602a0 0x7f2a00160750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:44.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.800+0000 7f2a07000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0015eb90 con 0x7f29e80051c0 2024-05-27T10:51:44.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.800+0000 7f2a07000640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0015ea10 con 0x7f2a001602a0 2024-05-27T10:51:44.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.800+0000 7f2a07000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f2a000b5f60 con 0x7f2a000b7330 2024-05-27T10:51:44.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.800+0000 7f2a05200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2a000b7330 0x7f2a0015fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:44.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.800+0000 7f2a05200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2a000b7330 0x7f2a0015fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:37492/0 (socket says 172.21.15.53:37492) 2024-05-27T10:51:44.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.800+0000 7f2a05200640 1 -- 172.21.15.53:0/2464890376 learned_addr learned my addr 172.21.15.53:0/2464890376 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-27T10:51:44.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.800+0000 7f2a06600640 1 --2- 172.21.15.53:0/2464890376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a001602a0 0x7f2a00160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:44.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.801+0000 7f2a05200640 1 -- 172.21.15.53:0/2464890376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a001602a0 msgr2=0x7f2a00160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:44.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.801+0000 7f2a05200640 1 --2- 172.21.15.53:0/2464890376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a001602a0 0x7f2a00160750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.801+0000 7f2a05200640 1 -- 172.21.15.53:0/2464890376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e80051c0 msgr2=0x7f2a000ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:44.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.801+0000 7f2a05200640 1 --2- 172.21.15.53:0/2464890376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e80051c0 0x7f2a000ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.801+0000 7f2a05200640 1 -- 172.21.15.53:0/2464890376 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a000cb940 con 0x7f2a000b7330 2024-05-27T10:51:44.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.801+0000 7f2a05200640 1 --2- 172.21.15.53:0/2464890376 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2a000b7330 0x7f2a0015fd60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f29ec00d7a0 tx=0x7f29ec00dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:44.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.802+0000 7f29fd600640 1 -- 172.21.15.53:0/2464890376 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec019070 con 0x7f2a000b7330 2024-05-27T10:51:44.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.802+0000 7f29fd600640 1 -- 172.21.15.53:0/2464890376 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ec0072d0 con 0x7f2a000b7330 2024-05-27T10:51:44.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.802+0000 7f29fd600640 1 -- 172.21.15.53:0/2464890376 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec0047e0 con 0x7f2a000b7330 2024-05-27T10:51:44.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.802+0000 7f2a07000640 1 -- 172.21.15.53:0/2464890376 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a000ba040 con 0x7f2a000b7330 2024-05-27T10:51:44.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.802+0000 7f2a07000640 1 -- 172.21.15.53:0/2464890376 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a000cbec0 con 0x7f2a000b7330 2024-05-27T10:51:44.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.802+0000 7f29fd600640 1 -- 172.21.15.53:0/2464890376 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f29ec01c070 con 0x7f2a000b7330 2024-05-27T10:51:44.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.802+0000 7f29fd600640 1 -- 172.21.15.53:0/2464890376 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f29ec00b650 con 0x7f2a000b7330 2024-05-27T10:51:44.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.803+0000 7f2a07000640 1 -- 172.21.15.53:0/2464890376 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a0004fce0 con 0x7f2a000b7330 2024-05-27T10:51:44.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.805+0000 7f29fd600640 1 -- 172.21.15.53:0/2464890376 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f29ec023020 con 0x7f2a000b7330 2024-05-27T10:51:44.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.888+0000 7f2a07000640 1 -- 172.21.15.53:0/2464890376 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3809de92-ab70-43c5-861e-0c7477e17f00", "id": 6} v 0) -- 0x7f2a0008e600 con 0x7f2a000b7330 2024-05-27T10:51:44.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.895+0000 7f29fd600640 1 -- 172.21.15.53:0/2464890376 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3809de92-ab70-43c5-861e-0c7477e17f00", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f29ec00bc00 con 0x7f2a000b7330 2024-05-27T10:51:44.893 INFO:teuthology.orchestra.run.smithi053.stdout:6 2024-05-27T10:51:44.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.896+0000 7f2a07000640 1 -- 172.21.15.53:0/2464890376 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2a000b7330 msgr2=0x7f2a0015fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:44.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.896+0000 7f2a07000640 1 --2- 172.21.15.53:0/2464890376 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2a000b7330 0x7f2a0015fd60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f29ec00d7a0 tx=0x7f29ec00dc60 comp rx=0 tx=0).stop 2024-05-27T10:51:44.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.896+0000 7f2a07000640 1 -- 172.21.15.53:0/2464890376 shutdown_connections 2024-05-27T10:51:44.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.896+0000 7f2a07000640 1 --2- 172.21.15.53:0/2464890376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a001602a0 0x7f2a00160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.896+0000 7f2a07000640 1 --2- 172.21.15.53:0/2464890376 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2a000b7330 0x7f2a0015fd60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.896+0000 7f2a07000640 1 --2- 172.21.15.53:0/2464890376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e80051c0 0x7f2a000ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:44.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.896+0000 7f2a07000640 1 -- 172.21.15.53:0/2464890376 >> 172.21.15.53:0/2464890376 conn(0x7f2a0008bfd0 msgr2=0x7f2a000b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:44.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.896+0000 7f2a07000640 1 -- 172.21.15.53:0/2464890376 shutdown_connections 2024-05-27T10:51:44.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:44.896+0000 7f2a07000640 1 -- 172.21.15.53:0/2464890376 wait complete. 2024-05-27T10:51:44.909 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new 416be35b-2283-4014-be72-4c729adbb6ad 7 2024-05-27T10:51:45.018 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:45.020+0000 7f42f35dc040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-27T10:51:45.045 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:45.047+0000 7f2ec2e8c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-27T10:51:45.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.095+0000 7ff00be00640 1 Processor -- start 2024-05-27T10:51:45.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.095+0000 7ff00be00640 1 -- start start 2024-05-27T10:51:45.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.096+0000 7ff00be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff00c15e630 0x7ff00c0d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:45.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.096+0000 7ff00be00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff00c0cfde0 0x7ff00c0d3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:45.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.096+0000 7ff00be00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff00c0ced40 con 0x7ff00c0b5f60 2024-05-27T10:51:45.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.096+0000 7ff00be00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff00c0cf950 con 0x7ff00c15e630 2024-05-27T10:51:45.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.096+0000 7ff00be00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff00c0cf020 con 0x7ff00c0cfde0 2024-05-27T10:51:45.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.097+0000 7ff002000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff00c0cfde0 0x7ff00c0d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:45.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.097+0000 7ff002000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff00c0cfde0 0x7ff00c0d3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:37508/0 (socket says 172.21.15.53:37508) 2024-05-27T10:51:45.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.097+0000 7ff002000640 1 -- 172.21.15.53:0/3607674739 learned_addr learned my addr 172.21.15.53:0/3607674739 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-27T10:51:45.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.097+0000 7ff00aa00640 1 --2- 172.21.15.53:0/3607674739 >> v2:172.21.15.47:3300/0 conn(0x7ff00c15e630 0x7ff00c0d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:45.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.097+0000 7ff002000640 1 -- 172.21.15.53:0/3607674739 >> v2:172.21.15.47:3300/0 conn(0x7ff00c15e630 msgr2=0x7ff00c0d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:45.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.097+0000 7ff002000640 1 --2- 172.21.15.53:0/3607674739 >> v2:172.21.15.47:3300/0 conn(0x7ff00c15e630 0x7ff00c0d3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:45.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.097+0000 7ff002000640 1 -- 172.21.15.53:0/3607674739 >> v1:172.21.15.47:6789/0 conn(0x7ff00c0b5f60 legacy=0x7ff00c1622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:45.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.097+0000 7ff002000640 1 -- 172.21.15.53:0/3607674739 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff00c0cf300 con 0x7ff00c0cfde0 2024-05-27T10:51:45.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.098+0000 7ff002000640 1 --2- 172.21.15.53:0/3607674739 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff00c0cfde0 0x7ff00c0d3770 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7feff4009870 tx=0x7feff402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b11e61783eab9934 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:45.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.098+0000 7ff00a000640 1 -- 172.21.15.53:0/3607674739 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff4037070 con 0x7ff00c0cfde0 2024-05-27T10:51:45.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.098+0000 7ff00a000640 1 -- 172.21.15.53:0/3607674739 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feff4032440 con 0x7ff00c0cfde0 2024-05-27T10:51:45.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.098+0000 7ff00a000640 1 -- 172.21.15.53:0/3607674739 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff4032810 con 0x7ff00c0cfde0 2024-05-27T10:51:45.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.099+0000 7ff00be00640 1 -- 172.21.15.53:0/3607674739 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff00c0cfde0 msgr2=0x7ff00c0d3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:45.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.099+0000 7ff00be00640 1 --2- 172.21.15.53:0/3607674739 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff00c0cfde0 0x7ff00c0d3770 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7feff4009870 tx=0x7feff402a210 comp rx=0 tx=0).stop 2024-05-27T10:51:45.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.099+0000 7ff00be00640 1 -- 172.21.15.53:0/3607674739 shutdown_connections 2024-05-27T10:51:45.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.099+0000 7ff00be00640 1 --2- 172.21.15.53:0/3607674739 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff00c0cfde0 0x7ff00c0d3770 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:45.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.099+0000 7ff00be00640 1 --2- 172.21.15.53:0/3607674739 >> v2:172.21.15.47:3300/0 conn(0x7ff00c15e630 0x7ff00c0d3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:45.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.099+0000 7ff00be00640 1 -- 172.21.15.53:0/3607674739 >> 172.21.15.53:0/3607674739 conn(0x7ff00c08bfd0 msgr2=0x7ff00c0d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:45.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.099+0000 7ff00be00640 1 -- 172.21.15.53:0/3607674739 shutdown_connections 2024-05-27T10:51:45.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.099+0000 7ff00be00640 1 -- 172.21.15.53:0/3607674739 wait complete. 2024-05-27T10:51:45.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.101+0000 7ff00be00640 1 Processor -- start 2024-05-27T10:51:45.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.101+0000 7ff00be00640 1 -- start start 2024-05-27T10:51:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.102+0000 7ff00be00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff00c0b5f60 0x7ff00c160720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.102+0000 7ff00be00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff00c0cfde0 0x7ff00c158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.102+0000 7ff00be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff00c15e630 0x7ff00c15ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.102+0000 7ff00be00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c15eb90 con 0x7ff00c15e630 2024-05-27T10:51:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.102+0000 7ff00be00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c15ea10 con 0x7ff00c0cfde0 2024-05-27T10:51:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.102+0000 7ff00be00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff00c0b63f0 con 0x7ff00c0b5f60 2024-05-27T10:51:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.102+0000 7ff00aa00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff00c0b5f60 0x7ff00c160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.102+0000 7ff00aa00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff00c0b5f60 0x7ff00c160720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:37514/0 (socket says 172.21.15.53:37514) 2024-05-27T10:51:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.102+0000 7ff00aa00640 1 -- 172.21.15.53:0/1856127631 learned_addr learned my addr 172.21.15.53:0/1856127631 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-27T10:51:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.103+0000 7ff002000640 1 --2- 172.21.15.53:0/1856127631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff00c0cfde0 0x7ff00c158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.103+0000 7ff00b400640 1 --2- 172.21.15.53:0/1856127631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff00c15e630 0x7ff00c15ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.103+0000 7ff00aa00640 1 -- 172.21.15.53:0/1856127631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff00c0cfde0 msgr2=0x7ff00c158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:45.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.103+0000 7ff00aa00640 1 --2- 172.21.15.53:0/1856127631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff00c0cfde0 0x7ff00c158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:45.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.103+0000 7ff00aa00640 1 -- 172.21.15.53:0/1856127631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff00c15e630 msgr2=0x7ff00c15ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:45.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.103+0000 7ff00aa00640 1 --2- 172.21.15.53:0/1856127631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff00c15e630 0x7ff00c15ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:45.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.103+0000 7ff00aa00640 1 -- 172.21.15.53:0/1856127631 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff00c15f680 con 0x7ff00c0b5f60 2024-05-27T10:51:45.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.103+0000 7ff00b400640 1 --2- 172.21.15.53:0/1856127631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff00c15e630 0x7ff00c15ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:51:45.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.103+0000 7ff00aa00640 1 --2- 172.21.15.53:0/1856127631 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff00c0b5f60 0x7ff00c160720 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feffc00ccd0 tx=0x7feffc00a5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:45.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.104+0000 7ff003e00640 1 -- 172.21.15.53:0/1856127631 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc003990 con 0x7ff00c0b5f60 2024-05-27T10:51:45.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.104+0000 7ff003e00640 1 -- 172.21.15.53:0/1856127631 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feffc003b30 con 0x7ff00c0b5f60 2024-05-27T10:51:45.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.104+0000 7ff003e00640 1 -- 172.21.15.53:0/1856127631 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc004020 con 0x7ff00c0b5f60 2024-05-27T10:51:45.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.104+0000 7ff00be00640 1 -- 172.21.15.53:0/1856127631 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff00c15f960 con 0x7ff00c0b5f60 2024-05-27T10:51:45.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.104+0000 7ff00be00640 1 -- 172.21.15.53:0/1856127631 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff00c160200 con 0x7ff00c0b5f60 2024-05-27T10:51:45.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.104+0000 7ff003e00640 1 -- 172.21.15.53:0/1856127631 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7feffc004550 con 0x7ff00c0b5f60 2024-05-27T10:51:45.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.104+0000 7ff003e00640 1 -- 172.21.15.53:0/1856127631 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7feffc018db0 con 0x7ff00c0b5f60 2024-05-27T10:51:45.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.105+0000 7ff00be00640 1 -- 172.21.15.53:0/1856127631 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff00c04fce0 con 0x7ff00c0b5f60 2024-05-27T10:51:45.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.107+0000 7ff003e00640 1 -- 172.21.15.53:0/1856127631 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7feffc014030 con 0x7ff00c0b5f60 2024-05-27T10:51:45.109 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:45.111+0000 7f2ec2e8c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-27T10:51:45.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.188+0000 7ff00be00640 1 -- 172.21.15.53:0/1856127631 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd new", "uuid": "416be35b-2283-4014-be72-4c729adbb6ad", "id": 7} v 0) -- 0x7ff00c08e600 con 0x7ff00c0b5f60 2024-05-27T10:51:45.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.193+0000 7ff003e00640 1 -- 172.21.15.53:0/1856127631 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "416be35b-2283-4014-be72-4c729adbb6ad", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7feffc018400 con 0x7ff00c0b5f60 2024-05-27T10:51:45.191 INFO:teuthology.orchestra.run.smithi053.stdout:7 2024-05-27T10:51:45.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.194+0000 7ff00be00640 1 -- 172.21.15.53:0/1856127631 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff00c0b5f60 msgr2=0x7ff00c160720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:45.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.194+0000 7ff00be00640 1 --2- 172.21.15.53:0/1856127631 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff00c0b5f60 0x7ff00c160720 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feffc00ccd0 tx=0x7feffc00a5c0 comp rx=0 tx=0).stop 2024-05-27T10:51:45.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.194+0000 7ff00be00640 1 -- 172.21.15.53:0/1856127631 shutdown_connections 2024-05-27T10:51:45.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.194+0000 7ff00be00640 1 --2- 172.21.15.53:0/1856127631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff00c15e630 0x7ff00c15ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:45.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.194+0000 7ff00be00640 1 --2- 172.21.15.53:0/1856127631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff00c0cfde0 0x7ff00c158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:45.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.194+0000 7ff00be00640 1 --2- 172.21.15.53:0/1856127631 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff00c0b5f60 0x7ff00c160720 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:45.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.195+0000 7ff00be00640 1 -- 172.21.15.53:0/1856127631 >> 172.21.15.53:0/1856127631 conn(0x7ff00c08bfd0 msgr2=0x7ff00c0d26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:45.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.195+0000 7ff00be00640 1 -- 172.21.15.53:0/1856127631 shutdown_connections 2024-05-27T10:51:45.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:51:45.195+0000 7ff00be00640 1 -- 172.21.15.53:0/1856127631 wait complete. 2024-05-27T10:51:45.207 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-27T10:51:45.208 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-27T10:51:45.214 INFO:tasks.ceph.osd.0:Started 2024-05-27T10:51:45.215 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-27T10:51:45.215 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-27T10:51:45.221 INFO:tasks.ceph.osd.1:Started 2024-05-27T10:51:45.221 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-27T10:51:45.222 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-27T10:51:45.228 INFO:tasks.ceph.osd.2:Started 2024-05-27T10:51:45.229 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-27T10:51:45.229 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-27T10:51:45.235 INFO:tasks.ceph.osd.3:Started 2024-05-27T10:51:45.235 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-27T10:51:45.235 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-27T10:51:45.240 INFO:tasks.ceph.osd.4:Started 2024-05-27T10:51:45.241 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-27T10:51:45.241 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-27T10:51:45.248 INFO:tasks.ceph.osd.5:Started 2024-05-27T10:51:45.248 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-27T10:51:45.248 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-27T10:51:45.252 INFO:tasks.ceph.osd.6:Started 2024-05-27T10:51:45.253 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-27T10:51:45.253 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-27T10:51:45.256 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:45.259+0000 7f2ec2e8c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-27T10:51:45.258 INFO:tasks.ceph.osd.7:Started 2024-05-27T10:51:45.258 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:51:45.359 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:45.361+0000 7f42f35dc040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-27T10:51:45.450 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:45.453+0000 7f42f35dc040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-27T10:51:45.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.468+0000 7fb9d0200640 1 Processor -- start 2024-05-27T10:51:45.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.469+0000 7fb9d0200640 1 -- start start 2024-05-27T10:51:45.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.470+0000 7fb9d0200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb9c81608f0 0x7fb9c806dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:45.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.470+0000 7fb9d0200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9c806e1f0 0x7fb9c8072e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:45.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.470+0000 7fb9d0200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9c806e970 con 0x7fb9c8163f70 2024-05-27T10:51:45.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.470+0000 7fb9d0200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb9c806e690 con 0x7fb9c81608f0 2024-05-27T10:51:45.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.470+0000 7fb9d0200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c8072340 con 0x7fb9c806e1f0 2024-05-27T10:51:45.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.470+0000 7fb9cd800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb9c81608f0 0x7fb9c806dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:45.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.470+0000 7fb9cce00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb9c8163f70 0x7fb9c80d0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:33572/0 (socket says 172.21.15.47:33572) 2024-05-27T10:51:45.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.470+0000 7fb9cce00640 1 -- 172.21.15.47:0/2576451595 learned_addr learned my addr 172.21.15.47:0/2576451595 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:51:45.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.470+0000 7fb9ce200640 1 --2- 172.21.15.47:0/2576451595 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9c806e1f0 0x7fb9c8072e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:45.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.471+0000 7fb9cd800640 1 -- 172.21.15.47:0/2576451595 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9c806e1f0 msgr2=0x7fb9c8072e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:45.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.471+0000 7fb9cd800640 1 --2- 172.21.15.47:0/2576451595 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9c806e1f0 0x7fb9c8072e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:45.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.471+0000 7fb9cd800640 1 -- 172.21.15.47:0/2576451595 >> v1:172.21.15.47:6789/0 conn(0x7fb9c8163f70 legacy=0x7fb9c80d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:45.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.471+0000 7fb9cd800640 1 -- 172.21.15.47:0/2576451595 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c8072620 con 0x7fb9c81608f0 2024-05-27T10:51:45.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.471+0000 7fb9c7e00640 1 -- 172.21.15.47:0/2576451595 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3167122082 0 0) 0x7fb9c806e970 con 0x7fb9c8163f70 2024-05-27T10:51:45.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.472+0000 7fb9cd800640 1 --2- 172.21.15.47:0/2576451595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c81608f0 0x7fb9c806dcb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0097a0 tx=0x7fb9bc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500323b73c305091 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:45.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.472+0000 7fb9c7e00640 1 -- 172.21.15.47:0/2576451595 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc037070 con 0x7fb9c81608f0 2024-05-27T10:51:45.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.472+0000 7fb9c7e00640 1 -- 172.21.15.47:0/2576451595 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9bc032440 con 0x7fb9c81608f0 2024-05-27T10:51:45.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.472+0000 7fb9c7e00640 1 -- 172.21.15.47:0/2576451595 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc032810 con 0x7fb9c81608f0 2024-05-27T10:51:45.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.472+0000 7fb9d0200640 1 -- 172.21.15.47:0/2576451595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c81608f0 msgr2=0x7fb9c806dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:45.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.472+0000 7fb9d0200640 1 --2- 172.21.15.47:0/2576451595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c81608f0 0x7fb9c806dcb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0097a0 tx=0x7fb9bc02a180 comp rx=0 tx=0).stop 2024-05-27T10:51:45.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.473+0000 7fb9d0200640 1 -- 172.21.15.47:0/2576451595 shutdown_connections 2024-05-27T10:51:45.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.473+0000 7fb9d0200640 1 --2- 172.21.15.47:0/2576451595 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9c806e1f0 0x7fb9c8072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:45.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.473+0000 7fb9d0200640 1 --2- 172.21.15.47:0/2576451595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c81608f0 0x7fb9c806dcb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:45.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.473+0000 7fb9d0200640 1 -- 172.21.15.47:0/2576451595 >> 172.21.15.47:0/2576451595 conn(0x7fb9c806bd60 msgr2=0x7fb9c806c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:45.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.473+0000 7fb9d0200640 1 -- 172.21.15.47:0/2576451595 shutdown_connections 2024-05-27T10:51:45.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.473+0000 7fb9d0200640 1 -- 172.21.15.47:0/2576451595 wait complete. 2024-05-27T10:51:45.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.474+0000 7fb9d0200640 1 Processor -- start 2024-05-27T10:51:45.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.474+0000 7fb9d0200640 1 -- start start 2024-05-27T10:51:45.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.475+0000 7fb9d0200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9c806e1f0 0x7fb9c81558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:45.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.475+0000 7fb9d0200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c81608f0 0x7fb9c809d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:45.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.475+0000 7fb9d0200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9c8163f70 0x7fb9c80ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:45.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.475+0000 7fb9d0200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c8073360 con 0x7fb9c81608f0 2024-05-27T10:51:45.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.475+0000 7fb9d0200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c80d1020 con 0x7fb9c8163f70 2024-05-27T10:51:45.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.475+0000 7fb9d0200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c80734e0 con 0x7fb9c806e1f0 2024-05-27T10:51:45.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.476+0000 7fb9cce00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c81608f0 0x7fb9c809d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:45.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.476+0000 7fb9cd800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9c806e1f0 0x7fb9c81558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:45.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.476+0000 7fb9cce00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c81608f0 0x7fb9c809d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39188/0 (socket says 172.21.15.47:39188) 2024-05-27T10:51:45.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.476+0000 7fb9cd800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9c806e1f0 0x7fb9c81558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:60850/0 (socket says 172.21.15.47:60850) 2024-05-27T10:51:45.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.476+0000 7fb9cce00640 1 -- 172.21.15.47:0/2879435838 learned_addr learned my addr 172.21.15.47:0/2879435838 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:51:45.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.476+0000 7fb9ce200640 1 --2- 172.21.15.47:0/2879435838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9c8163f70 0x7fb9c80ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:45.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.476+0000 7fb9cd800640 1 -- 172.21.15.47:0/2879435838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9c8163f70 msgr2=0x7fb9c80ae200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:45.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.476+0000 7fb9cd800640 1 --2- 172.21.15.47:0/2879435838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9c8163f70 0x7fb9c80ae200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:45.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.476+0000 7fb9cd800640 1 -- 172.21.15.47:0/2879435838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c81608f0 msgr2=0x7fb9c809d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:45.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.476+0000 7fb9cd800640 1 --2- 172.21.15.47:0/2879435838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c81608f0 0x7fb9c809d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:45.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.476+0000 7fb9cd800640 1 -- 172.21.15.47:0/2879435838 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c809e330 con 0x7fb9c806e1f0 2024-05-27T10:51:45.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.476+0000 7fb9ce200640 1 --2- 172.21.15.47:0/2879435838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9c8163f70 0x7fb9c80ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T10:51:45.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.476+0000 7fb9cce00640 1 --2- 172.21.15.47:0/2879435838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c81608f0 0x7fb9c809d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T10:51:45.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.476+0000 7fb9cd800640 1 --2- 172.21.15.47:0/2879435838 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9c806e1f0 0x7fb9c81558d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80b4510 tx=0x7fb9bc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:45.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.477+0000 7fb9c5600640 1 -- 172.21.15.47:0/2879435838 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc037050 con 0x7fb9c806e1f0 2024-05-27T10:51:45.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.477+0000 7fb9c5600640 1 -- 172.21.15.47:0/2879435838 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9bc038040 con 0x7fb9c806e1f0 2024-05-27T10:51:45.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.477+0000 7fb9d0200640 1 -- 172.21.15.47:0/2879435838 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c809da90 con 0x7fb9c806e1f0 2024-05-27T10:51:45.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.477+0000 7fb9c5600640 1 -- 172.21.15.47:0/2879435838 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc004450 con 0x7fb9c806e1f0 2024-05-27T10:51:45.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.477+0000 7fb9d0200640 1 -- 172.21.15.47:0/2879435838 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c809e050 con 0x7fb9c806e1f0 2024-05-27T10:51:45.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.477+0000 7fb9c5600640 1 -- 172.21.15.47:0/2879435838 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb9bc03c6d0 con 0x7fb9c806e1f0 2024-05-27T10:51:45.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.477+0000 7fb9c5600640 1 -- 172.21.15.47:0/2879435838 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb9bc03c9c0 con 0x7fb9c806e1f0 2024-05-27T10:51:45.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.478+0000 7fb9d0200640 1 -- 172.21.15.47:0/2879435838 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9c80689e0 con 0x7fb9c806e1f0 2024-05-27T10:51:45.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.482+0000 7fb9c5600640 1 -- 172.21.15.47:0/2879435838 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb9bc03cc10 con 0x7fb9c806e1f0 2024-05-27T10:51:45.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.547+0000 7fb9d0200640 1 -- 172.21.15.47:0/2879435838 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9c80cff60 con 0x7fb9c806e1f0 2024-05-27T10:51:45.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.549+0000 7fb9c5600640 1 -- 172.21.15.47:0/2879435838 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb9bc03cdf0 con 0x7fb9c806e1f0 2024-05-27T10:51:45.547 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:45.547 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":10,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:51:45.190643+0000","last_up_change":"0.000000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:51:45.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.550+0000 7fb9d0200640 1 -- 172.21.15.47:0/2879435838 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9c806e1f0 msgr2=0x7fb9c81558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:45.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.550+0000 7fb9d0200640 1 --2- 172.21.15.47:0/2879435838 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9c806e1f0 0x7fb9c81558d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80b4510 tx=0x7fb9bc0046c0 comp rx=0 tx=0).stop 2024-05-27T10:51:45.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.550+0000 7fb9d0200640 1 -- 172.21.15.47:0/2879435838 shutdown_connections 2024-05-27T10:51:45.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.550+0000 7fb9d0200640 1 --2- 172.21.15.47:0/2879435838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9c8163f70 0x7fb9c80ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:45.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.550+0000 7fb9d0200640 1 --2- 172.21.15.47:0/2879435838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c81608f0 0x7fb9c809d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:45.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.550+0000 7fb9d0200640 1 --2- 172.21.15.47:0/2879435838 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9c806e1f0 0x7fb9c81558d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:45.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.550+0000 7fb9d0200640 1 -- 172.21.15.47:0/2879435838 >> 172.21.15.47:0/2879435838 conn(0x7fb9c806bd60 msgr2=0x7fb9c8160cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:45.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.550+0000 7fb9d0200640 1 -- 172.21.15.47:0/2879435838 shutdown_connections 2024-05-27T10:51:45.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:45.550+0000 7fb9d0200640 1 -- 172.21.15.47:0/2879435838 wait complete. 2024-05-27T10:51:45.571 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-27T10:51:45.571 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-27T10:51:45.590 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:45.593+0000 7f42f35dc040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-27T10:51:45.674 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:45.673+0000 7f2ec2e8c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-27T10:51:45.730 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:45.732+0000 7f2ec2e8c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-27T10:51:45.910 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-05-27T10:51:45.912+0000 7f65e5c20640 -1 Falling back to public interface 2024-05-27T10:51:45.917 INFO:tasks.ceph.osd.4.smithi053.stderr:2024-05-27T10:51:45.920+0000 7f38e7e9d640 -1 Falling back to public interface 2024-05-27T10:51:45.920 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:45.922+0000 7f2ec2e8c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-27T10:51:45.921 INFO:tasks.ceph.osd.5.smithi053.stderr:2024-05-27T10:51:45.923+0000 7f65eb211640 -1 Falling back to public interface 2024-05-27T10:51:45.928 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-05-27T10:51:45.930+0000 7fa340b2c640 -1 Falling back to public interface 2024-05-27T10:51:45.938 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:45.940+0000 7f42f35dc040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-27T10:51:45.947 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-05-27T10:51:45.950+0000 7f1b43e1c640 -1 Falling back to public interface 2024-05-27T10:51:45.956 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-05-27T10:51:45.958+0000 7fd4a0e11640 -1 Falling back to public interface 2024-05-27T10:51:45.964 INFO:tasks.ceph.osd.6.smithi053.stderr:2024-05-27T10:51:45.966+0000 7f576f757640 -1 Falling back to public interface 2024-05-27T10:51:45.994 INFO:tasks.ceph.osd.7.smithi053.stderr:2024-05-27T10:51:45.996+0000 7fe190e10640 -1 Falling back to public interface 2024-05-27T10:51:45.997 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:46.000+0000 7f42f35dc040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-27T10:51:46.096 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:46.098+0000 7f2ec2e8c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-27T10:51:46.157 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:46.159+0000 7f2ec2e8c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-27T10:51:46.194 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:46.196+0000 7f42f35dc040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-27T10:51:46.242 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:46.244+0000 7f2ec2e8c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-27T10:51:46.298 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:46.300+0000 7f2ec2e8c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-27T10:51:46.372 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:46.374+0000 7f42f35dc040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-27T10:51:46.380 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-27T10:51:46.434 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:46.436+0000 7f42f35dc040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-27T10:51:46.520 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:46.522+0000 7f42f35dc040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-27T10:51:46.539 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.541+0000 7f22f5c00640 1 Processor -- start 2024-05-27T10:51:46.539 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.541+0000 7f22f5c00640 1 -- start start 2024-05-27T10:51:46.540 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.542+0000 7f22f5c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22f015e720 0x7f22f00d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:46.540 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.542+0000 7f22f5c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f22f00d2bf0 0x7f22f00d3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:46.540 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.542+0000 7f22f5c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22f00d1a10 con 0x7f22f00d14b0 2024-05-27T10:51:46.540 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.542+0000 7f22f5c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f22f00d1cf0 con 0x7f22f00d2bf0 2024-05-27T10:51:46.540 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.542+0000 7f22f5c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f22f00cf590 con 0x7f22f015e720 2024-05-27T10:51:46.540 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.542+0000 7f22ee000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f22f00d14b0 0x7f22f00cfd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:33578/0 (socket says 172.21.15.47:33578) 2024-05-27T10:51:46.541 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.542+0000 7f22ee000640 1 -- 172.21.15.47:0/2967426504 learned_addr learned my addr 172.21.15.47:0/2967426504 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:51:46.541 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.542+0000 7f22ef400640 1 --2- 172.21.15.47:0/2967426504 >> v2:172.21.15.47:3300/0 conn(0x7f22f00d2bf0 0x7f22f00d3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:46.541 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.543+0000 7f22eea00640 1 --2- 172.21.15.47:0/2967426504 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22f015e720 0x7f22f00d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:46.541 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.543+0000 7f22ed600640 1 -- 172.21.15.47:0/2967426504 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2313278780 0 0) 0x7f22f00d1a10 con 0x7f22f00d14b0 2024-05-27T10:51:46.542 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.543+0000 7f22ed600640 1 -- 172.21.15.47:0/2967426504 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22d4003520 con 0x7f22f00d14b0 2024-05-27T10:51:46.542 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.543+0000 7f22ef400640 1 -- 172.21.15.47:0/2967426504 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22f015e720 msgr2=0x7f22f00d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:46.542 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.543+0000 7f22ef400640 1 --2- 172.21.15.47:0/2967426504 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22f015e720 0x7f22f00d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:46.542 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.543+0000 7f22ef400640 1 -- 172.21.15.47:0/2967426504 >> v1:172.21.15.47:6789/0 conn(0x7f22f00d14b0 legacy=0x7f22f00cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:46.542 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.543+0000 7f22ef400640 1 -- 172.21.15.47:0/2967426504 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f00cf870 con 0x7f22f00d2bf0 2024-05-27T10:51:46.543 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.544+0000 7f22ef400640 1 --2- 172.21.15.47:0/2967426504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22f00d2bf0 0x7f22f00d3080 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009d90 tx=0x7f22e802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763c2f9579c1033d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:46.543 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.544+0000 7f22ed600640 1 -- 172.21.15.47:0/2967426504 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e8007740 con 0x7f22f00d2bf0 2024-05-27T10:51:46.543 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.544+0000 7f22ed600640 1 -- 172.21.15.47:0/2967426504 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22e80078e0 con 0x7f22f00d2bf0 2024-05-27T10:51:46.543 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.545+0000 7f22ed600640 1 -- 172.21.15.47:0/2967426504 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e8007cb0 con 0x7f22f00d2bf0 2024-05-27T10:51:46.543 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.545+0000 7f22f5c00640 1 -- 172.21.15.47:0/2967426504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22f00d2bf0 msgr2=0x7f22f00d3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:46.543 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.545+0000 7f22f5c00640 1 --2- 172.21.15.47:0/2967426504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22f00d2bf0 0x7f22f00d3080 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009d90 tx=0x7f22e802a660 comp rx=0 tx=0).stop 2024-05-27T10:51:46.543 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.545+0000 7f22f5c00640 1 -- 172.21.15.47:0/2967426504 shutdown_connections 2024-05-27T10:51:46.543 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.545+0000 7f22f5c00640 1 --2- 172.21.15.47:0/2967426504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22f00d2bf0 0x7f22f00d3080 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:46.543 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.545+0000 7f22f5c00640 1 --2- 172.21.15.47:0/2967426504 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22f015e720 0x7f22f00d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:46.544 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.545+0000 7f22f5c00640 1 -- 172.21.15.47:0/2967426504 >> 172.21.15.47:0/2967426504 conn(0x7f22f009d950 msgr2=0x7f22f008bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:46.544 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.545+0000 7f22f5c00640 1 -- 172.21.15.47:0/2967426504 shutdown_connections 2024-05-27T10:51:46.544 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.545+0000 7f22f5c00640 1 -- 172.21.15.47:0/2967426504 wait complete. 2024-05-27T10:51:46.544 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.547+0000 7f22f5c00640 1 Processor -- start 2024-05-27T10:51:46.545 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.547+0000 7f22f5c00640 1 -- start start 2024-05-27T10:51:46.547 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.548+0000 7f22f5c00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22f00d14b0 0x7f22f014dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:46.547 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.548+0000 7f22f5c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22f00d2bf0 0x7f22f00b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:46.547 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.548+0000 7f22f5c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22f015e720 0x7f22f00b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:46.547 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.548+0000 7f22f5c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f22f015eb00 con 0x7f22f015e720 2024-05-27T10:51:46.547 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.548+0000 7f22f5c00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f22f00cf240 con 0x7f22f00d14b0 2024-05-27T10:51:46.547 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.548+0000 7f22f5c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f22f015ec80 con 0x7f22f00d2bf0 2024-05-27T10:51:46.547 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.548+0000 7f22ef400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22f015e720 0x7f22f00b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:46.547 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.548+0000 7f22ef400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22f015e720 0x7f22f00b6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39208/0 (socket says 172.21.15.47:39208) 2024-05-27T10:51:46.547 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.548+0000 7f22ef400640 1 -- 172.21.15.47:0/1191699071 learned_addr learned my addr 172.21.15.47:0/1191699071 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:51:46.547 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.548+0000 7f22eea00640 1 --2- 172.21.15.47:0/1191699071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22f00d14b0 0x7f22f014dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:46.547 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.548+0000 7f22ee000640 1 --2- 172.21.15.47:0/1191699071 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22f00d2bf0 0x7f22f00b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:46.547 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.549+0000 7f22ef400640 1 -- 172.21.15.47:0/1191699071 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22f00d2bf0 msgr2=0x7f22f00b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:46.548 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.549+0000 7f22ef400640 1 --2- 172.21.15.47:0/1191699071 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22f00d2bf0 0x7f22f00b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:46.548 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.549+0000 7f22ef400640 1 -- 172.21.15.47:0/1191699071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22f00d14b0 msgr2=0x7f22f014dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:46.548 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.549+0000 7f22ef400640 1 --2- 172.21.15.47:0/1191699071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22f00d14b0 0x7f22f014dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:46.548 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.549+0000 7f22ef400640 1 -- 172.21.15.47:0/1191699071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f00cc630 con 0x7f22f015e720 2024-05-27T10:51:46.548 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.549+0000 7f22ee000640 1 --2- 172.21.15.47:0/1191699071 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22f00d2bf0 0x7f22f00b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:51:46.549 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.549+0000 7f22ef400640 1 --2- 172.21.15.47:0/1191699071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22f015e720 0x7f22f00b6010 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009eb0 tx=0x7f22e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:46.549 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.549+0000 7f22e6a00640 1 -- 172.21.15.47:0/1191699071 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e8040070 con 0x7f22f015e720 2024-05-27T10:51:46.549 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.550+0000 7f22e6a00640 1 -- 172.21.15.47:0/1191699071 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22e8031bc0 con 0x7f22f015e720 2024-05-27T10:51:46.549 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.550+0000 7f22f5c00640 1 -- 172.21.15.47:0/1191699071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f00cc910 con 0x7f22f015e720 2024-05-27T10:51:46.549 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.550+0000 7f22e6a00640 1 -- 172.21.15.47:0/1191699071 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e8009450 con 0x7f22f015e720 2024-05-27T10:51:46.549 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.550+0000 7f22f5c00640 1 -- 172.21.15.47:0/1191699071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f00cced0 con 0x7f22f015e720 2024-05-27T10:51:46.549 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.550+0000 7f22e6a00640 1 -- 172.21.15.47:0/1191699071 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f22e8039040 con 0x7f22f015e720 2024-05-27T10:51:46.549 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.550+0000 7f22e6a00640 1 -- 172.21.15.47:0/1191699071 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f22e8007840 con 0x7f22f015e720 2024-05-27T10:51:46.550 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.551+0000 7f22f5c00640 1 -- 172.21.15.47:0/1191699071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22f004fce0 con 0x7f22f015e720 2024-05-27T10:51:46.551 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.554+0000 7f22e6a00640 1 -- 172.21.15.47:0/1191699071 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f22e8045460 con 0x7f22f015e720 2024-05-27T10:51:46.576 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:46.578+0000 7f42f35dc040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-27T10:51:46.619 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.621+0000 7f22f5c00640 1 -- 172.21.15.47:0/1191699071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22f006cd20 con 0x7f22f015e720 2024-05-27T10:51:46.620 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.622+0000 7f22e6a00640 1 -- 172.21.15.47:0/1191699071 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f22e8045640 con 0x7f22f015e720 2024-05-27T10:51:46.620 INFO:teuthology.misc.health.smithi047.stdout: 2024-05-27T10:51:46.620 INFO:teuthology.misc.health.smithi047.stdout:{"epoch":10,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:51:45.190643+0000","last_up_change":"0.000000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:51:46.621 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.623+0000 7f22f5c00640 1 -- 172.21.15.47:0/1191699071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22f015e720 msgr2=0x7f22f00b6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:46.621 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.623+0000 7f22f5c00640 1 --2- 172.21.15.47:0/1191699071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22f015e720 0x7f22f00b6010 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009eb0 tx=0x7f22e8004a40 comp rx=0 tx=0).stop 2024-05-27T10:51:46.621 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.623+0000 7f22f5c00640 1 -- 172.21.15.47:0/1191699071 shutdown_connections 2024-05-27T10:51:46.622 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.623+0000 7f22f5c00640 1 --2- 172.21.15.47:0/1191699071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22f015e720 0x7f22f00b6010 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:46.622 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.623+0000 7f22f5c00640 1 --2- 172.21.15.47:0/1191699071 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22f00d2bf0 0x7f22f00b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:46.622 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.623+0000 7f22f5c00640 1 --2- 172.21.15.47:0/1191699071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22f00d14b0 0x7f22f014dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:46.622 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.624+0000 7f22f5c00640 1 -- 172.21.15.47:0/1191699071 >> 172.21.15.47:0/1191699071 conn(0x7f22f009d950 msgr2=0x7f22f00b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:46.622 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.624+0000 7f22f5c00640 1 -- 172.21.15.47:0/1191699071 shutdown_connections 2024-05-27T10:51:46.622 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:46.624+0000 7f22f5c00640 1 -- 172.21.15.47:0/1191699071 wait complete. 2024-05-27T10:51:46.634 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-27T10:51:46.869 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:46.871+0000 7f2ec2e8c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-27T10:51:47.006 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:47.008+0000 7f2ec2e8c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-27T10:51:47.153 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:47.155+0000 7f42f35dc040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-27T10:51:47.292 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-05-27T10:51:47.294+0000 7f42f35dc040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-27T10:51:48.056 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:48.057+0000 7f2e63e00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-27T10:51:48.057 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:51:48.059+0000 7f2e63e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-27T10:51:49.513 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-05-27T10:51:49.515+0000 7f65e5c20640 -1 osd.0 0 log_to_monitors true 2024-05-27T10:51:49.540 INFO:tasks.ceph.osd.4.smithi053.stderr:2024-05-27T10:51:49.543+0000 7f38e7e9d640 -1 osd.4 0 log_to_monitors true 2024-05-27T10:51:49.576 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-05-27T10:51:49.578+0000 7fa340b2c640 -1 osd.1 0 log_to_monitors true 2024-05-27T10:51:49.578 INFO:tasks.ceph.osd.6.smithi053.stderr:2024-05-27T10:51:49.581+0000 7f576f757640 -1 osd.6 0 log_to_monitors true 2024-05-27T10:51:49.605 INFO:tasks.ceph.osd.7.smithi053.stderr:2024-05-27T10:51:49.607+0000 7fe190e10640 -1 osd.7 0 log_to_monitors true 2024-05-27T10:51:49.606 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-05-27T10:51:49.608+0000 7fd4a0e11640 -1 osd.2 0 log_to_monitors true 2024-05-27T10:51:49.619 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-05-27T10:51:49.622+0000 7f1b43e1c640 -1 osd.3 0 log_to_monitors true 2024-05-27T10:51:49.806 INFO:tasks.ceph.osd.5.smithi053.stderr:2024-05-27T10:51:49.808+0000 7f65eb211640 -1 osd.5 0 log_to_monitors true 2024-05-27T10:51:52.770 INFO:tasks.ceph.osd.7.smithi053.stderr:2024-05-27T10:51:52.772+0000 7fe18b600640 -1 osd.7 0 waiting for initial osdmap 2024-05-27T10:51:52.776 INFO:tasks.ceph.osd.7.smithi053.stderr:2024-05-27T10:51:52.780+0000 7fe181600640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T10:51:52.791 INFO:tasks.ceph.osd.4.smithi053.stderr:2024-05-27T10:51:52.794+0000 7f38e3800640 -1 osd.4 0 waiting for initial osdmap 2024-05-27T10:51:52.795 INFO:tasks.ceph.osd.6.smithi053.stderr:2024-05-27T10:51:52.799+0000 7f576a600640 -1 osd.6 0 waiting for initial osdmap 2024-05-27T10:51:52.799 INFO:tasks.ceph.osd.4.smithi053.stderr:2024-05-27T10:51:52.803+0000 7f38d8e00640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T10:51:52.800 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-05-27T10:51:52.802+0000 7f1b3e600640 -1 osd.3 0 waiting for initial osdmap 2024-05-27T10:51:52.800 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-05-27T10:51:52.803+0000 7fd49b600640 -1 osd.2 0 waiting for initial osdmap 2024-05-27T10:51:52.804 INFO:tasks.ceph.osd.5.smithi053.stderr:2024-05-27T10:51:52.808+0000 7f65e6400640 -1 osd.5 0 waiting for initial osdmap 2024-05-27T10:51:52.804 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-05-27T10:51:52.807+0000 7f65e1000640 -1 osd.0 0 waiting for initial osdmap 2024-05-27T10:51:52.806 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-05-27T10:51:52.808+0000 7fd491600640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T10:51:52.809 INFO:tasks.ceph.osd.5.smithi053.stderr:2024-05-27T10:51:52.813+0000 7f65dba00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T10:51:52.810 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-05-27T10:51:52.812+0000 7fa33c400640 -1 osd.1 0 waiting for initial osdmap 2024-05-27T10:51:52.810 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-05-27T10:51:52.812+0000 7f1b34600640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T10:51:52.813 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-05-27T10:51:52.815+0000 7f65d6600640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T10:51:52.814 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-05-27T10:51:52.816+0000 7fa331a00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T10:51:52.816 INFO:tasks.ceph.osd.6.smithi053.stderr:2024-05-27T10:51:52.820+0000 7f5760600640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T10:51:53.440 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-27T10:51:53.636 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.638+0000 7f25e3e00640 1 Processor -- start 2024-05-27T10:51:53.636 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.638+0000 7f25e3e00640 1 -- start start 2024-05-27T10:51:53.637 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.639+0000 7f25e3e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25e40cae10 0x7f25e41632b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:53.637 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.639+0000 7f25e3e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f25e41637f0 0x7f25e416c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:53.637 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.639+0000 7f25e3e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25e40d0e60 con 0x7f25e40cd0d0 2024-05-27T10:51:53.637 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.639+0000 7f25e3e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f25e40d00c0 con 0x7f25e41637f0 2024-05-27T10:51:53.638 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.639+0000 7f25e3e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f25e40d03a0 con 0x7f25e40cae10 2024-05-27T10:51:53.638 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.639+0000 7f25e2a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f25e40cd0d0 0x7f25e40ca700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45210/0 (socket says 172.21.15.47:45210) 2024-05-27T10:51:53.638 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.640+0000 7f25e2a00640 1 -- 172.21.15.47:0/3954782596 learned_addr learned my addr 172.21.15.47:0/3954782596 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:51:53.638 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.640+0000 7f25e3400640 1 --2- 172.21.15.47:0/3954782596 >> v2:172.21.15.47:3300/0 conn(0x7f25e41637f0 0x7f25e416c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:53.638 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.640+0000 7f25e2000640 1 --2- 172.21.15.47:0/3954782596 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25e40cae10 0x7f25e41632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:53.638 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.640+0000 7f25e3400640 1 -- 172.21.15.47:0/3954782596 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25e40cae10 msgr2=0x7f25e41632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:53.639 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.640+0000 7f25e3400640 1 --2- 172.21.15.47:0/3954782596 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25e40cae10 0x7f25e41632b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:53.639 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.640+0000 7f25e3400640 1 -- 172.21.15.47:0/3954782596 >> v1:172.21.15.47:6789/0 conn(0x7f25e40cd0d0 legacy=0x7f25e40ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:53.639 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.640+0000 7f25e3400640 1 -- 172.21.15.47:0/3954782596 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e40d0680 con 0x7f25e41637f0 2024-05-27T10:51:53.639 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.641+0000 7f25e3400640 1 --2- 172.21.15.47:0/3954782596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e41637f0 0x7f25e416c920 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0097a0 tx=0x7f25dc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75919de980225ab server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:53.640 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.641+0000 7f25e1600640 1 -- 172.21.15.47:0/3954782596 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc037070 con 0x7f25e41637f0 2024-05-27T10:51:53.640 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.641+0000 7f25e1600640 1 -- 172.21.15.47:0/3954782596 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25dc032440 con 0x7f25e41637f0 2024-05-27T10:51:53.640 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.641+0000 7f25e1600640 1 -- 172.21.15.47:0/3954782596 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc032810 con 0x7f25e41637f0 2024-05-27T10:51:53.640 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.642+0000 7f25e3e00640 1 -- 172.21.15.47:0/3954782596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e41637f0 msgr2=0x7f25e416c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:53.641 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.642+0000 7f25e3e00640 1 --2- 172.21.15.47:0/3954782596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e41637f0 0x7f25e416c920 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0097a0 tx=0x7f25dc02a180 comp rx=0 tx=0).stop 2024-05-27T10:51:53.641 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.642+0000 7f25e3e00640 1 -- 172.21.15.47:0/3954782596 shutdown_connections 2024-05-27T10:51:53.641 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.642+0000 7f25e3e00640 1 --2- 172.21.15.47:0/3954782596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e41637f0 0x7f25e416c920 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:53.641 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.642+0000 7f25e3e00640 1 --2- 172.21.15.47:0/3954782596 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25e40cae10 0x7f25e41632b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:53.641 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.642+0000 7f25e3e00640 1 -- 172.21.15.47:0/3954782596 >> 172.21.15.47:0/3954782596 conn(0x7f25e406d9e0 msgr2=0x7f25e406ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:53.641 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.642+0000 7f25e3e00640 1 -- 172.21.15.47:0/3954782596 shutdown_connections 2024-05-27T10:51:53.641 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.642+0000 7f25e3e00640 1 -- 172.21.15.47:0/3954782596 wait complete. 2024-05-27T10:51:53.641 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.644+0000 7f25e3e00640 1 Processor -- start 2024-05-27T10:51:53.642 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.644+0000 7f25e3e00640 1 -- start start 2024-05-27T10:51:53.643 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.645+0000 7f25e3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e40cae10 0x7f25e4146e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:53.643 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.645+0000 7f25e3e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25e40cd0d0 0x7f25e40c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:53.643 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.645+0000 7f25e3e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25e41637f0 0x7f25e4147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:53.643 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.645+0000 7f25e3e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f25e4163da0 con 0x7f25e40cae10 2024-05-27T10:51:53.643 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.645+0000 7f25e3e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f25e4163c20 con 0x7f25e40cd0d0 2024-05-27T10:51:53.643 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.645+0000 7f25e3e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f25e40cd4b0 con 0x7f25e41637f0 2024-05-27T10:51:53.644 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.645+0000 7f25e2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e40cae10 0x7f25e4146e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:53.644 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.645+0000 7f25e2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e40cae10 0x7f25e4146e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51020/0 (socket says 172.21.15.47:51020) 2024-05-27T10:51:53.644 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.645+0000 7f25e2a00640 1 -- 172.21.15.47:0/2947749170 learned_addr learned my addr 172.21.15.47:0/2947749170 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:51:53.644 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.645+0000 7f25e2a00640 1 -- 172.21.15.47:0/2947749170 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25e41637f0 msgr2=0x7f25e4147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:53.644 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.645+0000 7f25e2a00640 1 --2- 172.21.15.47:0/2947749170 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25e41637f0 0x7f25e4147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:53.644 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.645+0000 7f25e2a00640 1 -- 172.21.15.47:0/2947749170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25e40cd0d0 msgr2=0x7f25e40c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:53.644 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.645+0000 7f25e2a00640 1 --2- 172.21.15.47:0/2947749170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25e40cd0d0 0x7f25e40c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:53.644 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.645+0000 7f25e2a00640 1 -- 172.21.15.47:0/2947749170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e41f8db0 con 0x7f25e40cae10 2024-05-27T10:51:53.645 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.646+0000 7f25e2a00640 1 --2- 172.21.15.47:0/2947749170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e40cae10 0x7f25e4146e40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f25d400ca70 tx=0x7f25d400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:53.645 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.646+0000 7f25daa00640 1 -- 172.21.15.47:0/2947749170 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d4017070 con 0x7f25e40cae10 2024-05-27T10:51:53.645 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.646+0000 7f25daa00640 1 -- 172.21.15.47:0/2947749170 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25d400abd0 con 0x7f25e40cae10 2024-05-27T10:51:53.645 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.646+0000 7f25daa00640 1 -- 172.21.15.47:0/2947749170 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d4012400 con 0x7f25e40cae10 2024-05-27T10:51:53.645 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.646+0000 7f25e3e00640 1 -- 172.21.15.47:0/2947749170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e40b3e40 con 0x7f25e40cae10 2024-05-27T10:51:53.645 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.646+0000 7f25e3e00640 1 -- 172.21.15.47:0/2947749170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e40b4400 con 0x7f25e40cae10 2024-05-27T10:51:53.646 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.647+0000 7f25e3e00640 1 -- 172.21.15.47:0/2947749170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e4075d40 con 0x7f25e40cae10 2024-05-27T10:51:53.646 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.648+0000 7f25daa00640 1 -- 172.21.15.47:0/2947749170 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f25d401a070 con 0x7f25e40cae10 2024-05-27T10:51:53.647 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.649+0000 7f25daa00640 1 --2- 172.21.15.47:0/2947749170 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f25c406c860 0x7f25c406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:53.647 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.649+0000 7f25daa00640 1 -- 172.21.15.47:0/2947749170 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f25d408a9b0 con 0x7f25e40cae10 2024-05-27T10:51:53.647 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.649+0000 7f25e2000640 1 --2- 172.21.15.47:0/2947749170 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f25c406c860 0x7f25c406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:53.648 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.650+0000 7f25e2000640 1 --2- 172.21.15.47:0/2947749170 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f25c406c860 0x7f25c406ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f25d0006fd0 tx=0x7f25d0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:53.653 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.655+0000 7f25daa00640 1 -- 172.21.15.47:0/2947749170 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f25d4059c40 con 0x7f25e40cae10 2024-05-27T10:51:53.863 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.865+0000 7f25e3e00640 1 -- 172.21.15.47:0/2947749170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25e40cd880 con 0x7f25e40cae10 2024-05-27T10:51:53.864 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.866+0000 7f25daa00640 1 -- 172.21.15.47:0/2947749170 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10825 (secure 0 0 0) 0x7f25d4059540 con 0x7f25e40cae10 2024-05-27T10:51:53.864 INFO:teuthology.misc.health.smithi047.stdout: 2024-05-27T10:51:53.864 INFO:teuthology.misc.health.smithi047.stdout:{"epoch":13,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:51:53.770613+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:51:53.867 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.868+0000 7f25e3e00640 1 -- 172.21.15.47:0/2947749170 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f25c406c860 msgr2=0x7f25c406ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:53.867 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.868+0000 7f25e3e00640 1 --2- 172.21.15.47:0/2947749170 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f25c406c860 0x7f25c406ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f25d0006fd0 tx=0x7f25d0008040 comp rx=0 tx=0).stop 2024-05-27T10:51:53.867 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.869+0000 7f25e3e00640 1 -- 172.21.15.47:0/2947749170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e40cae10 msgr2=0x7f25e4146e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:53.867 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.869+0000 7f25e3e00640 1 --2- 172.21.15.47:0/2947749170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e40cae10 0x7f25e4146e40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f25d400ca70 tx=0x7f25d400cf30 comp rx=0 tx=0).stop 2024-05-27T10:51:53.867 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.869+0000 7f25e3e00640 1 -- 172.21.15.47:0/2947749170 shutdown_connections 2024-05-27T10:51:53.867 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.869+0000 7f25e3e00640 1 --2- 172.21.15.47:0/2947749170 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f25c406c860 0x7f25c406ed20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:53.867 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.869+0000 7f25e3e00640 1 --2- 172.21.15.47:0/2947749170 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25e41637f0 0x7f25e4147530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:53.867 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.869+0000 7f25e3e00640 1 --2- 172.21.15.47:0/2947749170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25e40cd0d0 0x7f25e40c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:53.867 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.869+0000 7f25e3e00640 1 --2- 172.21.15.47:0/2947749170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e40cae10 0x7f25e4146e40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:53.867 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.869+0000 7f25e3e00640 1 -- 172.21.15.47:0/2947749170 >> 172.21.15.47:0/2947749170 conn(0x7f25e406d9e0 msgr2=0x7f25e40cefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:53.867 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.869+0000 7f25e3e00640 1 -- 172.21.15.47:0/2947749170 shutdown_connections 2024-05-27T10:51:53.867 INFO:teuthology.misc.health.smithi047.stderr:2024-05-27T10:51:53.869+0000 7f25e3e00640 1 -- 172.21.15.47:0/2947749170 wait complete. 2024-05-27T10:51:53.880 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-27T10:51:53.880 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-27T10:51:53.880 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-27T10:51:53.881 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-27T10:51:53.885 INFO:tasks.ceph.mds.a:Started 2024-05-27T10:51:53.885 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-27T10:51:53.886 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-27T10:51:53.890 INFO:tasks.ceph.mds.c:Started 2024-05-27T10:51:53.890 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-27T10:51:53.890 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-27T10:51:53.898 INFO:tasks.ceph.mds.b:Started 2024-05-27T10:51:53.898 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-27T10:51:53.898 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-27T10:51:53.905 INFO:tasks.ceph.mds.d:Started 2024-05-27T10:51:53.905 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-27T10:51:53.906 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:51:54.027 INFO:tasks.ceph.mds.a.smithi047.stdout:starting mds.a at 2024-05-27T10:51:54.028 INFO:tasks.ceph.mds.c.smithi047.stdout:starting mds.c at 2024-05-27T10:51:54.052 INFO:tasks.ceph.mds.d.smithi053.stdout:starting mds.d at 2024-05-27T10:51:54.052 INFO:tasks.ceph.mds.b.smithi053.stdout:starting mds.b at 2024-05-27T10:51:54.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.080+0000 7fb71f200640 1 Processor -- start 2024-05-27T10:51:54.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.080+0000 7fb71f200640 1 -- start start 2024-05-27T10:51:54.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.082+0000 7fb71f200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb71815eaa0 0x7fb7180d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:54.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.082+0000 7fb71f200640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb71806ca40 0x7fb7180d2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:54.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.082+0000 7fb71f200640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7180d0950 con 0x7fb71806d240 2024-05-27T10:51:54.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.082+0000 7fb71f200640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fb7180cf4b0 con 0x7fb71806ca40 2024-05-27T10:51:54.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.082+0000 7fb71f200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb7180cebc0 con 0x7fb71815eaa0 2024-05-27T10:51:54.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.082+0000 7fb71e800640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb71806ca40 0x7fb7180d2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:54.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.082+0000 7fb71d400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb71815eaa0 0x7fb7180d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:54.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.082+0000 7fb71e800640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb71806ca40 0x7fb7180d2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:56630/0 (socket says 172.21.15.47:56630) 2024-05-27T10:51:54.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.082+0000 7fb71e800640 1 -- 172.21.15.47:0/799412667 learned_addr learned my addr 172.21.15.47:0/799412667 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:51:54.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.083+0000 7fb71e800640 1 -- 172.21.15.47:0/799412667 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb71815eaa0 msgr2=0x7fb7180d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:54.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.083+0000 7fb71e800640 1 --2- 172.21.15.47:0/799412667 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb71815eaa0 0x7fb7180d2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:54.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.083+0000 7fb71e800640 1 -- 172.21.15.47:0/799412667 >> v1:172.21.15.53:6789/0 conn(0x7fb71806d240 legacy=0x7fb71806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:54.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.083+0000 7fb71e800640 1 -- 172.21.15.47:0/799412667 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7180cee60 con 0x7fb71806ca40 2024-05-27T10:51:54.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.084+0000 7fb71e800640 1 --2- 172.21.15.47:0/799412667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb71806ca40 0x7fb7180d2bc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb714009e50 tx=0x7fb71402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27ade5097478bd3f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:54.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.084+0000 7fb71ca00640 1 -- 172.21.15.47:0/799412667 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb714036070 con 0x7fb71806ca40 2024-05-27T10:51:54.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.084+0000 7fb71ca00640 1 -- 172.21.15.47:0/799412667 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb714031600 con 0x7fb71806ca40 2024-05-27T10:51:54.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.084+0000 7fb71ca00640 1 -- 172.21.15.47:0/799412667 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7140319d0 con 0x7fb71806ca40 2024-05-27T10:51:54.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.084+0000 7fb71f200640 1 -- 172.21.15.47:0/799412667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb71806ca40 msgr2=0x7fb7180d2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:54.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.085+0000 7fb71f200640 1 --2- 172.21.15.47:0/799412667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb71806ca40 0x7fb7180d2bc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb714009e50 tx=0x7fb71402a710 comp rx=0 tx=0).stop 2024-05-27T10:51:54.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.085+0000 7fb71f200640 1 -- 172.21.15.47:0/799412667 shutdown_connections 2024-05-27T10:51:54.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.085+0000 7fb71f200640 1 --2- 172.21.15.47:0/799412667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb71806ca40 0x7fb7180d2bc0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:54.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.085+0000 7fb71f200640 1 --2- 172.21.15.47:0/799412667 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb71815eaa0 0x7fb7180d2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:54.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.085+0000 7fb71f200640 1 -- 172.21.15.47:0/799412667 >> 172.21.15.47:0/799412667 conn(0x7fb71808bfd0 msgr2=0x7fb7180d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:54.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.085+0000 7fb71f200640 1 -- 172.21.15.47:0/799412667 shutdown_connections 2024-05-27T10:51:54.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.085+0000 7fb71f200640 1 -- 172.21.15.47:0/799412667 wait complete. 2024-05-27T10:51:54.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.086+0000 7fb71f200640 1 Processor -- start 2024-05-27T10:51:54.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.087+0000 7fb71f200640 1 -- start start 2024-05-27T10:51:54.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.088+0000 7fb71f200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb71806ca40 0x7fb7180ba000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:54.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.088+0000 7fb71f200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb71806d240 0x7fb718161900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:54.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.088+0000 7fb71f200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb71815eaa0 0x7fb7181f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:54.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.088+0000 7fb71f200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb7180b10a0 con 0x7fb71806ca40 2024-05-27T10:51:54.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.088+0000 7fb71f200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb71806cf40 con 0x7fb71815eaa0 2024-05-27T10:51:54.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.088+0000 7fb71f200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb7180b1220 con 0x7fb71806d240 2024-05-27T10:51:54.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.088+0000 7fb71de00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb71806ca40 0x7fb7180ba000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:54.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.088+0000 7fb71de00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb71806ca40 0x7fb7180ba000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51064/0 (socket says 172.21.15.47:51064) 2024-05-27T10:51:54.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.088+0000 7fb71de00640 1 -- 172.21.15.47:0/508634291 learned_addr learned my addr 172.21.15.47:0/508634291 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:51:54.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.088+0000 7fb71d400640 1 --2- 172.21.15.47:0/508634291 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb71806d240 0x7fb718161900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:54.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.089+0000 7fb71e800640 1 --2- 172.21.15.47:0/508634291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb71815eaa0 0x7fb7181f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:54.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.089+0000 7fb71de00640 1 -- 172.21.15.47:0/508634291 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb71806d240 msgr2=0x7fb718161900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:54.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.089+0000 7fb71de00640 1 --2- 172.21.15.47:0/508634291 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb71806d240 0x7fb718161900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:54.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.089+0000 7fb71de00640 1 -- 172.21.15.47:0/508634291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb71815eaa0 msgr2=0x7fb7181f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:54.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.089+0000 7fb71de00640 1 --2- 172.21.15.47:0/508634291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb71815eaa0 0x7fb7181f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:54.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.089+0000 7fb71de00640 1 -- 172.21.15.47:0/508634291 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7180b7750 con 0x7fb71806ca40 2024-05-27T10:51:54.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.089+0000 7fb71e800640 1 --2- 172.21.15.47:0/508634291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb71815eaa0 0x7fb7181f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:51:54.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.089+0000 7fb71de00640 1 --2- 172.21.15.47:0/508634291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb71806ca40 0x7fb7180ba000 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00c450 tx=0x7fb70c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:54.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.089+0000 7fb712000640 1 -- 172.21.15.47:0/508634291 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c0052d0 con 0x7fb71806ca40 2024-05-27T10:51:54.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.089+0000 7fb712000640 1 -- 172.21.15.47:0/508634291 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb70c005470 con 0x7fb71806ca40 2024-05-27T10:51:54.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.089+0000 7fb712000640 1 -- 172.21.15.47:0/508634291 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c012870 con 0x7fb71806ca40 2024-05-27T10:51:54.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.089+0000 7fb71f200640 1 -- 172.21.15.47:0/508634291 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7180b7c80 con 0x7fb71806ca40 2024-05-27T10:51:54.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.090+0000 7fb71f200640 1 -- 172.21.15.47:0/508634291 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7180b7190 con 0x7fb71806ca40 2024-05-27T10:51:54.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.091+0000 7fb71f200640 1 -- 172.21.15.47:0/508634291 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb71804fce0 con 0x7fb71806ca40 2024-05-27T10:51:54.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.091+0000 7fb712000640 1 -- 172.21.15.47:0/508634291 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7fb70c012a10 con 0x7fb71806ca40 2024-05-27T10:51:54.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.092+0000 7fb712000640 1 --2- 172.21.15.47:0/508634291 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb6fc06c860 0x7fb6fc06ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:54.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.092+0000 7fb712000640 1 -- 172.21.15.47:0/508634291 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7fb70c08b1b0 con 0x7fb71806ca40 2024-05-27T10:51:54.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.093+0000 7fb71d400640 1 --2- 172.21.15.47:0/508634291 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb6fc06c860 0x7fb6fc06ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:54.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.093+0000 7fb71d400640 1 --2- 172.21.15.47:0/508634291 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb6fc06c860 0x7fb6fc06ed20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb7180ba540 tx=0x7fb708008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:54.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.098+0000 7fb712000640 1 -- 172.21.15.47:0/508634291 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb70c059b80 con 0x7fb71806ca40 2024-05-27T10:51:54.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.298+0000 7fb71f200640 1 -- 172.21.15.47:0/508634291 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb71815b870 con 0x7fb71806ca40 2024-05-27T10:51:54.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.299+0000 7fb712000640 1 -- 172.21.15.47:0/508634291 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10825 (secure 0 0 0) 0x7fb70c059480 con 0x7fb71806ca40 2024-05-27T10:51:54.298 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:54.298 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":13,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:51:53.770613+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:51:54.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.302+0000 7fb71f200640 1 -- 172.21.15.47:0/508634291 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb6fc06c860 msgr2=0x7fb6fc06ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:54.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.302+0000 7fb71f200640 1 --2- 172.21.15.47:0/508634291 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb6fc06c860 0x7fb6fc06ed20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb7180ba540 tx=0x7fb708008040 comp rx=0 tx=0).stop 2024-05-27T10:51:54.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.302+0000 7fb71f200640 1 -- 172.21.15.47:0/508634291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb71806ca40 msgr2=0x7fb7180ba000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:54.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.302+0000 7fb71f200640 1 --2- 172.21.15.47:0/508634291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb71806ca40 0x7fb7180ba000 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00c450 tx=0x7fb70c00c910 comp rx=0 tx=0).stop 2024-05-27T10:51:54.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.302+0000 7fb71f200640 1 -- 172.21.15.47:0/508634291 shutdown_connections 2024-05-27T10:51:54.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.302+0000 7fb71f200640 1 --2- 172.21.15.47:0/508634291 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb6fc06c860 0x7fb6fc06ed20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:54.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.302+0000 7fb71f200640 1 --2- 172.21.15.47:0/508634291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb71815eaa0 0x7fb7181f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:54.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.302+0000 7fb71f200640 1 --2- 172.21.15.47:0/508634291 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb71806d240 0x7fb718161900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:54.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.302+0000 7fb71f200640 1 --2- 172.21.15.47:0/508634291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb71806ca40 0x7fb7180ba000 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:54.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.302+0000 7fb71f200640 1 -- 172.21.15.47:0/508634291 >> 172.21.15.47:0/508634291 conn(0x7fb71808bfd0 msgr2=0x7fb7180b3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:54.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.302+0000 7fb71f200640 1 -- 172.21.15.47:0/508634291 shutdown_connections 2024-05-27T10:51:54.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.303+0000 7fb71f200640 1 -- 172.21.15.47:0/508634291 wait complete. 2024-05-27T10:51:54.317 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-05-27T10:51:54.317 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T10:51:54.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.528+0000 7fd89be00640 1 Processor -- start 2024-05-27T10:51:54.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.528+0000 7fd89be00640 1 -- start start 2024-05-27T10:51:54.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.530+0000 7fd89be00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c15c420 0x7fd89c071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:54.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.530+0000 7fd89be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd89c0d0a70 0x7fd89c0b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:54.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.530+0000 7fd89be00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd89c15c800 con 0x7fd89c0b4ab0 2024-05-27T10:51:54.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.530+0000 7fd89be00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd89c0afc90 con 0x7fd89c0d0a70 2024-05-27T10:51:54.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.530+0000 7fd89be00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd89c0ad2e0 con 0x7fd89c15c420 2024-05-27T10:51:54.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.530+0000 7fd89b400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd89c0d0a70 0x7fd89c0b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:54.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.530+0000 7fd89b400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd89c0d0a70 0x7fd89c0b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51070/0 (socket says 172.21.15.47:51070) 2024-05-27T10:51:54.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.530+0000 7fd89b400640 1 -- 172.21.15.47:0/991002231 learned_addr learned my addr 172.21.15.47:0/991002231 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:51:54.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.531+0000 7fd89aa00640 1 --2- 172.21.15.47:0/991002231 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c15c420 0x7fd89c071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:54.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.531+0000 7fd89b400640 1 -- 172.21.15.47:0/991002231 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c15c420 msgr2=0x7fd89c071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:54.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.531+0000 7fd89b400640 1 --2- 172.21.15.47:0/991002231 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c15c420 0x7fd89c071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:54.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.531+0000 7fd89b400640 1 -- 172.21.15.47:0/991002231 >> v1:172.21.15.53:6789/0 conn(0x7fd89c0b4ab0 legacy=0x7fd89c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:54.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.531+0000 7fd89b400640 1 -- 172.21.15.47:0/991002231 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89c0ad5c0 con 0x7fd89c0d0a70 2024-05-27T10:51:54.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.532+0000 7fd89b400640 1 --2- 172.21.15.47:0/991002231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd89c0d0a70 0x7fd89c0b3790 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd894009e50 tx=0x7fd89402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8bd01181e47e0f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:54.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.532+0000 7fd899600640 1 -- 172.21.15.47:0/991002231 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd894036070 con 0x7fd89c0d0a70 2024-05-27T10:51:54.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.532+0000 7fd899600640 1 -- 172.21.15.47:0/991002231 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd894031600 con 0x7fd89c0d0a70 2024-05-27T10:51:54.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.532+0000 7fd899600640 1 -- 172.21.15.47:0/991002231 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8940319d0 con 0x7fd89c0d0a70 2024-05-27T10:51:54.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.533+0000 7fd89be00640 1 -- 172.21.15.47:0/991002231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd89c0d0a70 msgr2=0x7fd89c0b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:54.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.533+0000 7fd89be00640 1 --2- 172.21.15.47:0/991002231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd89c0d0a70 0x7fd89c0b3790 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd894009e50 tx=0x7fd89402a680 comp rx=0 tx=0).stop 2024-05-27T10:51:54.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.533+0000 7fd89be00640 1 -- 172.21.15.47:0/991002231 shutdown_connections 2024-05-27T10:51:54.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.533+0000 7fd89be00640 1 --2- 172.21.15.47:0/991002231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd89c0d0a70 0x7fd89c0b3790 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:54.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.533+0000 7fd89be00640 1 --2- 172.21.15.47:0/991002231 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c15c420 0x7fd89c071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:54.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.533+0000 7fd89be00640 1 -- 172.21.15.47:0/991002231 >> 172.21.15.47:0/991002231 conn(0x7fd89c06bb20 msgr2=0x7fd89c06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:54.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.533+0000 7fd89be00640 1 -- 172.21.15.47:0/991002231 shutdown_connections 2024-05-27T10:51:54.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.533+0000 7fd89be00640 1 -- 172.21.15.47:0/991002231 wait complete. 2024-05-27T10:51:54.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.535+0000 7fd89be00640 1 Processor -- start 2024-05-27T10:51:54.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.535+0000 7fd89be00640 1 -- start start 2024-05-27T10:51:54.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.536+0000 7fd89be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd89c0b4ab0 0x7fd89c14ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:54.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.536+0000 7fd89be00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd89c0d0a70 0x7fd89c14f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:54.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.536+0000 7fd89be00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c15c420 0x7fd89c06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:54.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.536+0000 7fd89be00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c0af8f0 con 0x7fd89c0b4ab0 2024-05-27T10:51:54.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.536+0000 7fd89be00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c0ad8a0 con 0x7fd89c0d0a70 2024-05-27T10:51:54.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.536+0000 7fd89be00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd89c0afa70 con 0x7fd89c15c420 2024-05-27T10:51:54.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.536+0000 7fd89aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd89c0b4ab0 0x7fd89c14ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:54.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.536+0000 7fd89aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd89c0b4ab0 0x7fd89c14ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51072/0 (socket says 172.21.15.47:51072) 2024-05-27T10:51:54.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.536+0000 7fd89aa00640 1 -- 172.21.15.47:0/1539041222 learned_addr learned my addr 172.21.15.47:0/1539041222 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:51:54.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.537+0000 7fd89b400640 1 --2- 172.21.15.47:0/1539041222 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c15c420 0x7fd89c06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:54.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.537+0000 7fd89aa00640 1 -- 172.21.15.47:0/1539041222 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c15c420 msgr2=0x7fd89c06dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:54.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.537+0000 7fd89aa00640 1 --2- 172.21.15.47:0/1539041222 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c15c420 0x7fd89c06dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:54.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.537+0000 7fd89aa00640 1 -- 172.21.15.47:0/1539041222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd89c0d0a70 msgr2=0x7fd89c14f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:54.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.537+0000 7fd89aa00640 1 --2- 172.21.15.47:0/1539041222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd89c0d0a70 0x7fd89c14f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:54.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.537+0000 7fd89aa00640 1 -- 172.21.15.47:0/1539041222 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89c157c50 con 0x7fd89c0b4ab0 2024-05-27T10:51:54.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.537+0000 7fd89aa00640 1 --2- 172.21.15.47:0/1539041222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd89c0b4ab0 0x7fd89c14ee20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00d5d0 tx=0x7fd88c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:54.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.537+0000 7fd892a00640 1 -- 172.21.15.47:0/1539041222 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88c0125f0 con 0x7fd89c0b4ab0 2024-05-27T10:51:54.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.537+0000 7fd892a00640 1 -- 172.21.15.47:0/1539041222 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd88c019070 con 0x7fd89c0b4ab0 2024-05-27T10:51:54.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.537+0000 7fd89be00640 1 -- 172.21.15.47:0/1539041222 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd89c1e5f30 con 0x7fd89c0b4ab0 2024-05-27T10:51:54.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.537+0000 7fd892a00640 1 -- 172.21.15.47:0/1539041222 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88c0129f0 con 0x7fd89c0b4ab0 2024-05-27T10:51:54.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.538+0000 7fd89be00640 1 -- 172.21.15.47:0/1539041222 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd89c14f8a0 con 0x7fd89c0b4ab0 2024-05-27T10:51:54.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.539+0000 7fd89be00640 1 -- 172.21.15.47:0/1539041222 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd89c04fce0 con 0x7fd89c0b4ab0 2024-05-27T10:51:54.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.539+0000 7fd892a00640 1 -- 172.21.15.47:0/1539041222 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7fd88c012b90 con 0x7fd89c0b4ab0 2024-05-27T10:51:54.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.540+0000 7fd892a00640 1 --2- 172.21.15.47:0/1539041222 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd87c06c860 0x7fd87c06ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:54.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.540+0000 7fd892a00640 1 -- 172.21.15.47:0/1539041222 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7fd88c08ba20 con 0x7fd89c0b4ab0 2024-05-27T10:51:54.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.541+0000 7fd89a000640 1 --2- 172.21.15.47:0/1539041222 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd87c06c860 0x7fd87c06ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:54.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.541+0000 7fd89a000640 1 --2- 172.21.15.47:0/1539041222 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd87c06c860 0x7fd87c06ed20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd888000f60 tx=0x7fd8880079b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:54.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.545+0000 7fd892a00640 1 -- 172.21.15.47:0/1539041222 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd88c05a3f0 con 0x7fd89c0b4ab0 2024-05-27T10:51:54.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.793+0000 7fd89be00640 1 -- 172.21.15.47:0/1539041222 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd89c1e6450 con 0x7fd89c0b4ab0 2024-05-27T10:51:54.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.794+0000 7fd892a00640 1 -- 172.21.15.47:0/1539041222 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fd88c059cf0 con 0x7fd89c0b4ab0 2024-05-27T10:51:54.792 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:54.792 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3409529039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":3409529039},{"type":"v1","addr":"172.21.15.47:6837","nonce":3409529039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-27T10:51:54.792 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 2 2024-05-27T10:51:54.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.797+0000 7fd89be00640 1 -- 172.21.15.47:0/1539041222 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd87c06c860 msgr2=0x7fd87c06ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:54.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.797+0000 7fd89be00640 1 --2- 172.21.15.47:0/1539041222 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd87c06c860 0x7fd87c06ed20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd888000f60 tx=0x7fd8880079b0 comp rx=0 tx=0).stop 2024-05-27T10:51:54.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.797+0000 7fd89be00640 1 -- 172.21.15.47:0/1539041222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd89c0b4ab0 msgr2=0x7fd89c14ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:54.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.797+0000 7fd89be00640 1 --2- 172.21.15.47:0/1539041222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd89c0b4ab0 0x7fd89c14ee20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00d5d0 tx=0x7fd88c00da90 comp rx=0 tx=0).stop 2024-05-27T10:51:54.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.797+0000 7fd89be00640 1 -- 172.21.15.47:0/1539041222 shutdown_connections 2024-05-27T10:51:54.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.797+0000 7fd89be00640 1 --2- 172.21.15.47:0/1539041222 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd87c06c860 0x7fd87c06ed20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:54.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.797+0000 7fd89be00640 1 --2- 172.21.15.47:0/1539041222 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c15c420 0x7fd89c06dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:54.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.797+0000 7fd89be00640 1 --2- 172.21.15.47:0/1539041222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd89c0d0a70 0x7fd89c14f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:54.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.797+0000 7fd89be00640 1 --2- 172.21.15.47:0/1539041222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd89c0b4ab0 0x7fd89c14ee20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:54.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.797+0000 7fd89be00640 1 -- 172.21.15.47:0/1539041222 >> 172.21.15.47:0/1539041222 conn(0x7fd89c06bb20 msgr2=0x7fd89c158420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:54.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.797+0000 7fd89be00640 1 -- 172.21.15.47:0/1539041222 shutdown_connections 2024-05-27T10:51:54.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:54.797+0000 7fd89be00640 1 -- 172.21.15.47:0/1539041222 wait complete. 2024-05-27T10:51:56.815 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T10:51:57.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.015+0000 7f6b60600640 1 Processor -- start 2024-05-27T10:51:57.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.015+0000 7f6b60600640 1 -- start start 2024-05-27T10:51:57.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.016+0000 7f6b60600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6b58162150 0x7f6b580b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:57.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.016+0000 7f6b60600640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b580cff60 0x7f6b5806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:57.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.016+0000 7f6b60600640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b580d0fa0 con 0x7f6b580d5340 2024-05-27T10:51:57.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.016+0000 7f6b60600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f6b580d0420 con 0x7f6b58162150 2024-05-27T10:51:57.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.016+0000 7f6b60600640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f6b580d0700 con 0x7f6b580cff60 2024-05-27T10:51:57.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.017+0000 7f6b5dc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6b58162150 0x7f6b580b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:57.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.017+0000 7f6b5dc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6b58162150 0x7f6b580b3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51110/0 (socket says 172.21.15.47:51110) 2024-05-27T10:51:57.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.017+0000 7f6b5dc00640 1 -- 172.21.15.47:0/1611825539 learned_addr learned my addr 172.21.15.47:0/1611825539 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:51:57.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.017+0000 7f6b5dc00640 1 -- 172.21.15.47:0/1611825539 >> v2:172.21.15.53:3300/0 conn(0x7f6b580cff60 msgr2=0x7f6b5806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:57.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.017+0000 7f6b5dc00640 1 --2- 172.21.15.47:0/1611825539 >> v2:172.21.15.53:3300/0 conn(0x7f6b580cff60 0x7f6b5806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.017+0000 7f6b5dc00640 1 -- 172.21.15.47:0/1611825539 >> v1:172.21.15.53:6789/0 conn(0x7f6b580d5340 legacy=0x7f6b580b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:57.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.017+0000 7f6b5dc00640 1 -- 172.21.15.47:0/1611825539 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b580d09e0 con 0x7f6b58162150 2024-05-27T10:51:57.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.018+0000 7f6b5dc00640 1 --2- 172.21.15.47:0/1611825539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b58162150 0x7f6b580b3ae0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6b580ba770 tx=0x7f6b4c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7be5f8487eb3377 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:57.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.018+0000 7f6b57e00640 1 -- 172.21.15.47:0/1611825539 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c037070 con 0x7f6b58162150 2024-05-27T10:51:57.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.018+0000 7f6b57e00640 1 -- 172.21.15.47:0/1611825539 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b4c032440 con 0x7f6b58162150 2024-05-27T10:51:57.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.019+0000 7f6b57e00640 1 -- 172.21.15.47:0/1611825539 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c032810 con 0x7f6b58162150 2024-05-27T10:51:57.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.019+0000 7f6b60600640 1 -- 172.21.15.47:0/1611825539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b58162150 msgr2=0x7f6b580b3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:57.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.019+0000 7f6b60600640 1 --2- 172.21.15.47:0/1611825539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b58162150 0x7f6b580b3ae0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6b580ba770 tx=0x7f6b4c02a1a0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.019+0000 7f6b60600640 1 -- 172.21.15.47:0/1611825539 shutdown_connections 2024-05-27T10:51:57.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.019+0000 7f6b60600640 1 --2- 172.21.15.47:0/1611825539 >> v2:172.21.15.53:3300/0 conn(0x7f6b580cff60 0x7f6b5806cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.019+0000 7f6b60600640 1 --2- 172.21.15.47:0/1611825539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b58162150 0x7f6b580b3ae0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.019+0000 7f6b60600640 1 -- 172.21.15.47:0/1611825539 >> 172.21.15.47:0/1611825539 conn(0x7f6b5808bfd0 msgr2=0x7f6b580d4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:57.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.019+0000 7f6b60600640 1 -- 172.21.15.47:0/1611825539 shutdown_connections 2024-05-27T10:51:57.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.019+0000 7f6b60600640 1 -- 172.21.15.47:0/1611825539 wait complete. 2024-05-27T10:51:57.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.021+0000 7f6b60600640 1 Processor -- start 2024-05-27T10:51:57.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.021+0000 7f6b60600640 1 -- start start 2024-05-27T10:51:57.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.022+0000 7f6b60600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b580cff60 0x7f6b580b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:57.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.022+0000 7f6b60600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b580d5340 0x7f6b581f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:57.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.022+0000 7f6b60600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b58162150 0x7f6b580cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:57.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.022+0000 7f6b60600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6b580b6a30 con 0x7f6b580d5340 2024-05-27T10:51:57.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.022+0000 7f6b60600640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6b580b68b0 con 0x7f6b58162150 2024-05-27T10:51:57.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.022+0000 7f6b60600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f6b5806d310 con 0x7f6b580cff60 2024-05-27T10:51:57.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.022+0000 7f6b5d200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b580d5340 0x7f6b581f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:57.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.022+0000 7f6b5d200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b580d5340 0x7f6b581f86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51124/0 (socket says 172.21.15.47:51124) 2024-05-27T10:51:57.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.022+0000 7f6b5d200640 1 -- 172.21.15.47:0/921358196 learned_addr learned my addr 172.21.15.47:0/921358196 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:51:57.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.023+0000 7f6b5dc00640 1 --2- 172.21.15.47:0/921358196 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b580cff60 0x7f6b580b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:57.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.023+0000 7f6b5d200640 1 -- 172.21.15.47:0/921358196 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b580cff60 msgr2=0x7f6b580b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:57.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.023+0000 7f6b5d200640 1 --2- 172.21.15.47:0/921358196 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b580cff60 0x7f6b580b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.023+0000 7f6b5d200640 1 -- 172.21.15.47:0/921358196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b58162150 msgr2=0x7f6b580cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:57.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.023+0000 7f6b5d200640 1 --2- 172.21.15.47:0/921358196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b58162150 0x7f6b580cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.023+0000 7f6b5d200640 1 -- 172.21.15.47:0/921358196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b580b1d00 con 0x7f6b580d5340 2024-05-27T10:51:57.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.023+0000 7f6b5d200640 1 --2- 172.21.15.47:0/921358196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b580d5340 0x7f6b581f86c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400c400 tx=0x7f6b4400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:57.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.023+0000 7f6b55600640 1 -- 172.21.15.47:0/921358196 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44017070 con 0x7f6b580d5340 2024-05-27T10:51:57.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.023+0000 7f6b55600640 1 -- 172.21.15.47:0/921358196 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b440035f0 con 0x7f6b580d5340 2024-05-27T10:51:57.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.024+0000 7f6b60600640 1 -- 172.21.15.47:0/921358196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b580b1fe0 con 0x7f6b580d5340 2024-05-27T10:51:57.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.024+0000 7f6b55600640 1 -- 172.21.15.47:0/921358196 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44003a20 con 0x7f6b580d5340 2024-05-27T10:51:57.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.024+0000 7f6b60600640 1 -- 172.21.15.47:0/921358196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b580b25a0 con 0x7f6b580d5340 2024-05-27T10:51:57.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.025+0000 7f6b60600640 1 -- 172.21.15.47:0/921358196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b580689e0 con 0x7f6b580d5340 2024-05-27T10:51:57.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.026+0000 7f6b55600640 1 -- 172.21.15.47:0/921358196 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f6b44003bc0 con 0x7f6b580d5340 2024-05-27T10:51:57.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.027+0000 7f6b55600640 1 --2- 172.21.15.47:0/921358196 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6b3806c860 0x7f6b3806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:57.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.027+0000 7f6b55600640 1 -- 172.21.15.47:0/921358196 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4857+0+0 (secure 0 0 0) 0x7f6b4408aef0 con 0x7f6b580d5340 2024-05-27T10:51:57.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.028+0000 7f6b5dc00640 1 --2- 172.21.15.47:0/921358196 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6b3806c860 0x7f6b3806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:57.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.028+0000 7f6b5dc00640 1 --2- 172.21.15.47:0/921358196 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6b3806c860 0x7f6b3806ed20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c034000 tx=0x7f6b4c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:57.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.032+0000 7f6b55600640 1 -- 172.21.15.47:0/921358196 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6b440b9b80 con 0x7f6b580d5340 2024-05-27T10:51:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.286+0000 7f6b60600640 1 -- 172.21.15.47:0/921358196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b5806e870 con 0x7f6b580d5340 2024-05-27T10:51:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.286+0000 7f6b55600640 1 -- 172.21.15.47:0/921358196 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3864 (secure 0 0 0) 0x7f6b44059190 con 0x7f6b580d5340 2024-05-27T10:51:57.283 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:57.283 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/4062514569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4062514569},{"type":"v1","addr":"172.21.15.47:6836","nonce":4062514569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/4113289884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":4113289884},{"type":"v1","addr":"172.21.15.53:6834","nonce":4113289884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3409529039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":3409529039},{"type":"v1","addr":"172.21.15.47:6837","nonce":3409529039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/4292385883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":4292385883},{"type":"v1","addr":"172.21.15.53:6835","nonce":4292385883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-27T10:51:57.284 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 3 2024-05-27T10:51:57.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.289+0000 7f6b60600640 1 -- 172.21.15.47:0/921358196 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6b3806c860 msgr2=0x7f6b3806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:57.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.289+0000 7f6b60600640 1 --2- 172.21.15.47:0/921358196 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6b3806c860 0x7f6b3806ed20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c034000 tx=0x7f6b4c02e000 comp rx=0 tx=0).stop 2024-05-27T10:51:57.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.289+0000 7f6b60600640 1 -- 172.21.15.47:0/921358196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b580d5340 msgr2=0x7f6b581f86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:57.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.289+0000 7f6b60600640 1 --2- 172.21.15.47:0/921358196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b580d5340 0x7f6b581f86c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400c400 tx=0x7f6b4400c8c0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.289+0000 7f6b60600640 1 -- 172.21.15.47:0/921358196 shutdown_connections 2024-05-27T10:51:57.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.289+0000 7f6b60600640 1 --2- 172.21.15.47:0/921358196 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6b3806c860 0x7f6b3806ed20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.289+0000 7f6b60600640 1 --2- 172.21.15.47:0/921358196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b58162150 0x7f6b580cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.289+0000 7f6b60600640 1 --2- 172.21.15.47:0/921358196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b580d5340 0x7f6b581f86c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.289+0000 7f6b60600640 1 --2- 172.21.15.47:0/921358196 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b580cff60 0x7f6b580b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.289+0000 7f6b60600640 1 -- 172.21.15.47:0/921358196 >> 172.21.15.47:0/921358196 conn(0x7f6b5808bfd0 msgr2=0x7f6b580b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:57.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.289+0000 7f6b60600640 1 -- 172.21.15.47:0/921358196 shutdown_connections 2024-05-27T10:51:57.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.289+0000 7f6b60600640 1 -- 172.21.15.47:0/921358196 wait complete. 2024-05-27T10:51:57.305 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:51:57.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.517+0000 7fcdeb400640 1 Processor -- start 2024-05-27T10:51:57.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.518+0000 7fcdeb400640 1 -- start start 2024-05-27T10:51:57.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.519+0000 7fcdeb400640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcde409aa40 0x7fcde409ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:57.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.519+0000 7fcdeb400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcde415ca40 0x7fcde40cd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.519+0000 7fcdeb400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde409b360 con 0x7fcde40d03a0 2024-05-27T10:51:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.520+0000 7fcdeb400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fcde415cfd0 con 0x7fcde415ca40 2024-05-27T10:51:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.520+0000 7fcdeb400640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fcde415d2b0 con 0x7fcde409aa40 2024-05-27T10:51:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.520+0000 7fcde3e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fcde40d03a0 0x7fcde409b780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45236/0 (socket says 172.21.15.47:45236) 2024-05-27T10:51:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.520+0000 7fcde3e00640 1 -- 172.21.15.47:0/1010127058 learned_addr learned my addr 172.21.15.47:0/1010127058 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:51:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.520+0000 7fcde9400640 1 --2- 172.21.15.47:0/1010127058 >> v2:172.21.15.47:3300/0 conn(0x7fcde415ca40 0x7fcde40cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.520+0000 7fcde8a00640 1 --2- 172.21.15.47:0/1010127058 >> v2:172.21.15.53:3300/0 conn(0x7fcde409aa40 0x7fcde409ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.520+0000 7fcde9400640 1 -- 172.21.15.47:0/1010127058 >> v2:172.21.15.53:3300/0 conn(0x7fcde409aa40 msgr2=0x7fcde409ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.520+0000 7fcde9400640 1 --2- 172.21.15.47:0/1010127058 >> v2:172.21.15.53:3300/0 conn(0x7fcde409aa40 0x7fcde409ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.520+0000 7fcde9400640 1 -- 172.21.15.47:0/1010127058 >> v1:172.21.15.47:6789/0 conn(0x7fcde40d03a0 legacy=0x7fcde409b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.520+0000 7fcde9400640 1 -- 172.21.15.47:0/1010127058 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde415d590 con 0x7fcde415ca40 2024-05-27T10:51:57.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.522+0000 7fcde9400640 1 --2- 172.21.15.47:0/1010127058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcde415ca40 0x7fcde40cd440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcde40733f0 tx=0x7fcddc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ddee772d2f74bf server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:57.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.522+0000 7fcde3400640 1 -- 172.21.15.47:0/1010127058 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcddc037070 con 0x7fcde415ca40 2024-05-27T10:51:57.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.522+0000 7fcde3400640 1 -- 172.21.15.47:0/1010127058 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcddc032440 con 0x7fcde415ca40 2024-05-27T10:51:57.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.522+0000 7fcde3400640 1 -- 172.21.15.47:0/1010127058 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcddc032810 con 0x7fcde415ca40 2024-05-27T10:51:57.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.523+0000 7fcdeb400640 1 -- 172.21.15.47:0/1010127058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcde415ca40 msgr2=0x7fcde40cd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:57.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.523+0000 7fcdeb400640 1 --2- 172.21.15.47:0/1010127058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcde415ca40 0x7fcde40cd440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcde40733f0 tx=0x7fcddc02a1a0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.523+0000 7fcdeb400640 1 -- 172.21.15.47:0/1010127058 shutdown_connections 2024-05-27T10:51:57.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.523+0000 7fcdeb400640 1 --2- 172.21.15.47:0/1010127058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcde415ca40 0x7fcde40cd440 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.523+0000 7fcdeb400640 1 --2- 172.21.15.47:0/1010127058 >> v2:172.21.15.53:3300/0 conn(0x7fcde409aa40 0x7fcde409ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.523+0000 7fcdeb400640 1 -- 172.21.15.47:0/1010127058 >> 172.21.15.47:0/1010127058 conn(0x7fcde40b3f60 msgr2=0x7fcde40b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:57.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.523+0000 7fcdeb400640 1 -- 172.21.15.47:0/1010127058 shutdown_connections 2024-05-27T10:51:57.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.523+0000 7fcdeb400640 1 -- 172.21.15.47:0/1010127058 wait complete. 2024-05-27T10:51:57.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.525+0000 7fcdeb400640 1 Processor -- start 2024-05-27T10:51:57.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.525+0000 7fcdeb400640 1 -- start start 2024-05-27T10:51:57.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.526+0000 7fcdeb400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcde409aa40 0x7fcde4154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:57.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.526+0000 7fcdeb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcde40d03a0 0x7fcde4150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:57.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.526+0000 7fcdeb400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcde415ca40 0x7fcde4157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:57.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.526+0000 7fcdeb400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcde40cdb00 con 0x7fcde40d03a0 2024-05-27T10:51:57.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.526+0000 7fcdeb400640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcde40cd980 con 0x7fcde409aa40 2024-05-27T10:51:57.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.526+0000 7fcdeb400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fcde40cdc80 con 0x7fcde415ca40 2024-05-27T10:51:57.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.526+0000 7fcde3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcde40d03a0 0x7fcde4150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:57.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.526+0000 7fcde3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcde40d03a0 0x7fcde4150000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51152/0 (socket says 172.21.15.47:51152) 2024-05-27T10:51:57.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.526+0000 7fcde3e00640 1 -- 172.21.15.47:0/3450577526 learned_addr learned my addr 172.21.15.47:0/3450577526 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:51:57.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.526+0000 7fcde8a00640 1 --2- 172.21.15.47:0/3450577526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcde409aa40 0x7fcde4154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:57.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.526+0000 7fcde3e00640 1 -- 172.21.15.47:0/3450577526 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcde415ca40 msgr2=0x7fcde4157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:57.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.526+0000 7fcde3e00640 1 --2- 172.21.15.47:0/3450577526 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcde415ca40 0x7fcde4157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.526+0000 7fcde3e00640 1 -- 172.21.15.47:0/3450577526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcde409aa40 msgr2=0x7fcde4154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:57.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.526+0000 7fcde3e00640 1 --2- 172.21.15.47:0/3450577526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcde409aa40 0x7fcde4154a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.527+0000 7fcde3e00640 1 -- 172.21.15.47:0/3450577526 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde40cbdf0 con 0x7fcde40d03a0 2024-05-27T10:51:57.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.527+0000 7fcde3e00640 1 --2- 172.21.15.47:0/3450577526 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcde40d03a0 0x7fcde4150000 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc00c3a0 tx=0x7fcdcc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:57.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.527+0000 7fcde0c00640 1 -- 172.21.15.47:0/3450577526 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc017070 con 0x7fcde40d03a0 2024-05-27T10:51:57.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.527+0000 7fcde0c00640 1 -- 172.21.15.47:0/3450577526 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdcc005ce0 con 0x7fcde40d03a0 2024-05-27T10:51:57.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.527+0000 7fcdeb400640 1 -- 172.21.15.47:0/3450577526 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde40cc0d0 con 0x7fcde40d03a0 2024-05-27T10:51:57.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.527+0000 7fcde0c00640 1 -- 172.21.15.47:0/3450577526 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc0072f0 con 0x7fcde40d03a0 2024-05-27T10:51:57.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.527+0000 7fcdeb400640 1 -- 172.21.15.47:0/3450577526 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde4157a40 con 0x7fcde40d03a0 2024-05-27T10:51:57.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.529+0000 7fcdeb400640 1 -- 172.21.15.47:0/3450577526 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde40690f0 con 0x7fcde40d03a0 2024-05-27T10:51:57.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.530+0000 7fcde0c00640 1 -- 172.21.15.47:0/3450577526 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7fcdcc01a070 con 0x7fcde40d03a0 2024-05-27T10:51:57.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.531+0000 7fcde0c00640 1 --2- 172.21.15.47:0/3450577526 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fcdc006c860 0x7fcdc006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:57.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.531+0000 7fcde0c00640 1 -- 172.21.15.47:0/3450577526 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fcdcc08aac0 con 0x7fcde40d03a0 2024-05-27T10:51:57.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.531+0000 7fcde8a00640 1 --2- 172.21.15.47:0/3450577526 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fcdc006c860 0x7fcdc006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:57.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.532+0000 7fcde8a00640 1 --2- 172.21.15.47:0/3450577526 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fcdc006c860 0x7fcdc006ed20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4009f30 tx=0x7fcdd400b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:57.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.536+0000 7fcde0c00640 1 -- 172.21.15.47:0/3450577526 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcdcc059310 con 0x7fcde40d03a0 2024-05-27T10:51:57.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.744+0000 7fcdeb400640 1 -- 172.21.15.47:0/3450577526 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcde40b4e70 con 0x7fcde40d03a0 2024-05-27T10:51:57.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.746+0000 7fcde0c00640 1 -- 172.21.15.47:0/3450577526 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12800 (secure 0 0 0) 0x7fcdcc058c10 con 0x7fcde40d03a0 2024-05-27T10:51:57.743 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:57.743 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":16,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:51:57.130739+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:51:57.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.749+0000 7fcdeb400640 1 -- 172.21.15.47:0/3450577526 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fcdc006c860 msgr2=0x7fcdc006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:57.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.749+0000 7fcdeb400640 1 --2- 172.21.15.47:0/3450577526 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fcdc006c860 0x7fcdc006ed20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4009f30 tx=0x7fcdd400b040 comp rx=0 tx=0).stop 2024-05-27T10:51:57.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.749+0000 7fcdeb400640 1 -- 172.21.15.47:0/3450577526 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcde40d03a0 msgr2=0x7fcde4150000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:57.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.749+0000 7fcdeb400640 1 --2- 172.21.15.47:0/3450577526 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcde40d03a0 0x7fcde4150000 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc00c3a0 tx=0x7fcdcc00c860 comp rx=0 tx=0).stop 2024-05-27T10:51:57.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.749+0000 7fcdeb400640 1 -- 172.21.15.47:0/3450577526 shutdown_connections 2024-05-27T10:51:57.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.749+0000 7fcdeb400640 1 --2- 172.21.15.47:0/3450577526 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fcdc006c860 0x7fcdc006ed20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.749+0000 7fcdeb400640 1 --2- 172.21.15.47:0/3450577526 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcde415ca40 0x7fcde4157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.749+0000 7fcdeb400640 1 --2- 172.21.15.47:0/3450577526 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcde40d03a0 0x7fcde4150000 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.749+0000 7fcdeb400640 1 --2- 172.21.15.47:0/3450577526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcde409aa40 0x7fcde4154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.749+0000 7fcdeb400640 1 -- 172.21.15.47:0/3450577526 >> 172.21.15.47:0/3450577526 conn(0x7fcde40b3f60 msgr2=0x7fcde415baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:57.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.749+0000 7fcdeb400640 1 -- 172.21.15.47:0/3450577526 shutdown_connections 2024-05-27T10:51:57.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.749+0000 7fcdeb400640 1 -- 172.21.15.47:0/3450577526 wait complete. 2024-05-27T10:51:57.765 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T10:51:55.073251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T10:51:57.766 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T10:51:57.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.984+0000 7f3de8a00640 1 Processor -- start 2024-05-27T10:51:57.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.984+0000 7f3de8a00640 1 -- start start 2024-05-27T10:51:57.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.986+0000 7f3de8a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3de415ea00 0x7f3de40d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:57.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.986+0000 7f3de8a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de40cf4c0 con 0x7f3de40d2f90 2024-05-27T10:51:57.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.986+0000 7f3de8a00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de40cf760 con 0x7f3de4162c90 2024-05-27T10:51:57.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.986+0000 7f3de8a00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3de40cfa40 con 0x7f3de415ea00 2024-05-27T10:51:57.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.986+0000 7f3de1e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3de415ea00 0x7f3de40d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:57.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.986+0000 7f3de1e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3de415ea00 0x7f3de40d0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:52258/0 (socket says 172.21.15.47:52258) 2024-05-27T10:51:57.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.986+0000 7f3de1e00640 1 -- 172.21.15.47:0/1326100248 learned_addr learned my addr 172.21.15.47:0/1326100248 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:51:57.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.986+0000 7f3de2800640 1 --1- 172.21.15.47:0/1326100248 >> v1:172.21.15.53:6789/0 conn(0x7f3de4162c90 0x7f3de406cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.47:55678/0 (socket says 172.21.15.47:55678) 2024-05-27T10:51:57.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.987+0000 7f3de1e00640 1 -- 172.21.15.47:0/1326100248 >> v1:172.21.15.53:6789/0 conn(0x7f3de4162c90 legacy=0x7f3de406cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:57.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.987+0000 7f3de1e00640 1 -- 172.21.15.47:0/1326100248 >> v1:172.21.15.47:6789/0 conn(0x7f3de40d2f90 legacy=0x7f3de4162580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:57.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.987+0000 7f3de1e00640 1 -- 172.21.15.47:0/1326100248 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de40cfd20 con 0x7f3de415ea00 2024-05-27T10:51:57.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.988+0000 7f3de1e00640 1 --2- 172.21.15.47:0/1326100248 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3de415ea00 0x7f3de40d0520 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40098a0 tx=0x7f3dd402a2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed8add903988816b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:57.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.989+0000 7f3de1400640 1 -- 172.21.15.47:0/1326100248 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4037070 con 0x7f3de415ea00 2024-05-27T10:51:57.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.989+0000 7f3de1400640 1 -- 172.21.15.47:0/1326100248 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dd4032640 con 0x7f3de415ea00 2024-05-27T10:51:57.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.989+0000 7f3de1400640 1 -- 172.21.15.47:0/1326100248 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4032a10 con 0x7f3de415ea00 2024-05-27T10:51:57.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.989+0000 7f3de8a00640 1 -- 172.21.15.47:0/1326100248 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3de415ea00 msgr2=0x7f3de40d0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:57.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.989+0000 7f3de8a00640 1 --2- 172.21.15.47:0/1326100248 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3de415ea00 0x7f3de40d0520 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40098a0 tx=0x7f3dd402a2e0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.990+0000 7f3de8a00640 1 -- 172.21.15.47:0/1326100248 shutdown_connections 2024-05-27T10:51:57.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.990+0000 7f3de8a00640 1 --2- 172.21.15.47:0/1326100248 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3de415ea00 0x7f3de40d0520 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.990+0000 7f3de8a00640 1 -- 172.21.15.47:0/1326100248 >> 172.21.15.47:0/1326100248 conn(0x7f3de408bfd0 msgr2=0x7f3de40d4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:57.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.990+0000 7f3de8a00640 1 -- 172.21.15.47:0/1326100248 shutdown_connections 2024-05-27T10:51:57.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.990+0000 7f3de8a00640 1 -- 172.21.15.47:0/1326100248 wait complete. 2024-05-27T10:51:57.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.991+0000 7f3de8a00640 1 Processor -- start 2024-05-27T10:51:57.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.992+0000 7f3de8a00640 1 -- start start 2024-05-27T10:51:57.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.993+0000 7f3de8a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3de40d2f90 0x7f3de40ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:57.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.993+0000 7f3de8a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3de415ea00 0x7f3de40cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:57.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.993+0000 7f3de8a00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3de4162c90 0x7f3de415a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:57.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.993+0000 7f3de8a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3de40d0a60 con 0x7f3de40d2f90 2024-05-27T10:51:57.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.993+0000 7f3de8a00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3de415ede0 con 0x7f3de4162c90 2024-05-27T10:51:57.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.993+0000 7f3de8a00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3de4163200 con 0x7f3de415ea00 2024-05-27T10:51:57.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.993+0000 7f3de1e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3de40d2f90 0x7f3de40ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:57.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.993+0000 7f3de1e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3de40d2f90 0x7f3de40ce140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51176/0 (socket says 172.21.15.47:51176) 2024-05-27T10:51:57.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.993+0000 7f3de1e00640 1 -- 172.21.15.47:0/805149298 learned_addr learned my addr 172.21.15.47:0/805149298 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:51:57.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.993+0000 7f3de2800640 1 --2- 172.21.15.47:0/805149298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3de4162c90 0x7f3de415a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:57.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.993+0000 7f3dd9400640 1 --2- 172.21.15.47:0/805149298 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3de415ea00 0x7f3de40cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:57.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.994+0000 7f3de1e00640 1 -- 172.21.15.47:0/805149298 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3de415ea00 msgr2=0x7f3de40cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:57.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.994+0000 7f3de1e00640 1 --2- 172.21.15.47:0/805149298 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3de415ea00 0x7f3de40cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.994+0000 7f3de1e00640 1 -- 172.21.15.47:0/805149298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3de4162c90 msgr2=0x7f3de415a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:57.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.994+0000 7f3de1e00640 1 --2- 172.21.15.47:0/805149298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3de4162c90 0x7f3de415a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:57.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.994+0000 7f3de1e00640 1 -- 172.21.15.47:0/805149298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de40cd380 con 0x7f3de40d2f90 2024-05-27T10:51:57.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:57.994+0000 7f3de1e00640 1 --2- 172.21.15.47:0/805149298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3de40d2f90 0x7f3de40ce140 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40098a0 tx=0x7f3dd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:58.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.043+0000 7f3ddaa00640 1 -- 172.21.15.47:0/805149298 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4037040 con 0x7f3de40d2f90 2024-05-27T10:51:58.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.043+0000 7f3de8a00640 1 -- 172.21.15.47:0/805149298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de40cd660 con 0x7f3de40d2f90 2024-05-27T10:51:58.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.043+0000 7f3de8a00640 1 -- 172.21.15.47:0/805149298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de40cdc20 con 0x7f3de40d2f90 2024-05-27T10:51:58.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.043+0000 7f3ddaa00640 1 -- 172.21.15.47:0/805149298 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dd4030770 con 0x7f3de40d2f90 2024-05-27T10:51:58.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.043+0000 7f3ddaa00640 1 -- 172.21.15.47:0/805149298 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4030b40 con 0x7f3de40d2f90 2024-05-27T10:51:58.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.045+0000 7f3de8a00640 1 -- 172.21.15.47:0/805149298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3de40ceb40 con 0x7f3de40d2f90 2024-05-27T10:51:58.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.050+0000 7f3ddaa00640 1 -- 172.21.15.47:0/805149298 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f3dd4044020 con 0x7f3de40d2f90 2024-05-27T10:51:58.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.051+0000 7f3ddaa00640 1 --2- 172.21.15.47:0/805149298 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3dc006c860 0x7f3dc006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:58.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.052+0000 7f3ddaa00640 1 -- 172.21.15.47:0/805149298 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f3dd40ac0c0 con 0x7f3de40d2f90 2024-05-27T10:51:58.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.052+0000 7f3dd9400640 1 --2- 172.21.15.47:0/805149298 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3dc006c860 0x7f3dc006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:58.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.053+0000 7f3dd9400640 1 --2- 172.21.15.47:0/805149298 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3dc006c860 0x7f3dc006ed20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3de40b2d30 tx=0x7f3dcc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:58.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.055+0000 7f3ddaa00640 1 -- 172.21.15.47:0/805149298 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3dd404b020 con 0x7f3de40d2f90 2024-05-27T10:51:58.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.062+0000 7f3ddaa00640 1 -- 172.21.15.47:0/805149298 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3dd4032500 con 0x7f3de40d2f90 2024-05-27T10:51:58.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.274+0000 7f3de8a00640 1 -- 172.21.15.47:0/805149298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3de404fdc0 con 0x7f3de40d2f90 2024-05-27T10:51:58.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.274+0000 7f3ddaa00640 1 -- 172.21.15.47:0/805149298 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f3dd40aa290 con 0x7f3de40d2f90 2024-05-27T10:51:58.272 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-27T10:51:58.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.277+0000 7f3de8a00640 1 -- 172.21.15.47:0/805149298 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3dc006c860 msgr2=0x7f3dc006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:58.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.277+0000 7f3de8a00640 1 --2- 172.21.15.47:0/805149298 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3dc006c860 0x7f3dc006ed20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3de40b2d30 tx=0x7f3dcc009040 comp rx=0 tx=0).stop 2024-05-27T10:51:58.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.277+0000 7f3de8a00640 1 -- 172.21.15.47:0/805149298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3de40d2f90 msgr2=0x7f3de40ce140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:58.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.277+0000 7f3de8a00640 1 --2- 172.21.15.47:0/805149298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3de40d2f90 0x7f3de40ce140 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40098a0 tx=0x7f3dd40046c0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.277+0000 7f3de8a00640 1 -- 172.21.15.47:0/805149298 shutdown_connections 2024-05-27T10:51:58.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.277+0000 7f3de8a00640 1 --2- 172.21.15.47:0/805149298 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3dc006c860 0x7f3dc006ed20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.277+0000 7f3de8a00640 1 --2- 172.21.15.47:0/805149298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3de4162c90 0x7f3de415a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.277+0000 7f3de8a00640 1 --2- 172.21.15.47:0/805149298 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3de415ea00 0x7f3de40cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.277+0000 7f3de8a00640 1 --2- 172.21.15.47:0/805149298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3de40d2f90 0x7f3de40ce140 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.277+0000 7f3de8a00640 1 -- 172.21.15.47:0/805149298 >> 172.21.15.47:0/805149298 conn(0x7f3de408bfd0 msgr2=0x7f3de40b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:58.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.277+0000 7f3de8a00640 1 -- 172.21.15.47:0/805149298 shutdown_connections 2024-05-27T10:51:58.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.277+0000 7f3de8a00640 1 -- 172.21.15.47:0/805149298 wait complete. 2024-05-27T10:51:58.297 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-27T10:51:58.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.500+0000 7fd3e3200640 1 Processor -- start 2024-05-27T10:51:58.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.500+0000 7fd3e3200640 1 -- start start 2024-05-27T10:51:58.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.501+0000 7fd3e3200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd3e40ce180 0x7fd3e40d2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:58.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.501+0000 7fd3e3200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd3e40b23b0 0x7fd3e40d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:58.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.501+0000 7fd3e3200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3e40b2d00 con 0x7fd3e40ce560 2024-05-27T10:51:58.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.501+0000 7fd3e3200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd3e40d0480 con 0x7fd3e40b23b0 2024-05-27T10:51:58.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.501+0000 7fd3e3200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e40b32c0 con 0x7fd3e40ce180 2024-05-27T10:51:58.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.502+0000 7fd3e2800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd3e40b23b0 0x7fd3e40d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:58.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.502+0000 7fd3e2800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd3e40b23b0 0x7fd3e40d0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51180/0 (socket says 172.21.15.47:51180) 2024-05-27T10:51:58.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.502+0000 7fd3e2800640 1 -- 172.21.15.47:0/3486927054 learned_addr learned my addr 172.21.15.47:0/3486927054 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:51:58.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.502+0000 7fd3e1e00640 1 --2- 172.21.15.47:0/3486927054 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd3e40ce180 0x7fd3e40d2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:58.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.502+0000 7fd3e2800640 1 -- 172.21.15.47:0/3486927054 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd3e40ce180 msgr2=0x7fd3e40d2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:58.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.502+0000 7fd3e2800640 1 --2- 172.21.15.47:0/3486927054 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd3e40ce180 0x7fd3e40d2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.502+0000 7fd3e2800640 1 -- 172.21.15.47:0/3486927054 >> v1:172.21.15.47:6789/0 conn(0x7fd3e40ce560 legacy=0x7fd3e40b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:58.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.502+0000 7fd3e2800640 1 -- 172.21.15.47:0/3486927054 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e40b2fe0 con 0x7fd3e40b23b0 2024-05-27T10:51:58.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.502+0000 7fd3e1e00640 1 --2- 172.21.15.47:0/3486927054 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd3e40ce180 0x7fd3e40d2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:51:58.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.503+0000 7fd3e2800640 1 --2- 172.21.15.47:0/3486927054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3e40b23b0 0x7fd3e40d0eb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009870 tx=0x7fd3dc02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3e5d8309e1d0ef server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:58.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.504+0000 7fd3e0a00640 1 -- 172.21.15.47:0/3486927054 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc037070 con 0x7fd3e40b23b0 2024-05-27T10:51:58.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.504+0000 7fd3e0a00640 1 -- 172.21.15.47:0/3486927054 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3dc032440 con 0x7fd3e40b23b0 2024-05-27T10:51:58.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.504+0000 7fd3e0a00640 1 -- 172.21.15.47:0/3486927054 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc032810 con 0x7fd3e40b23b0 2024-05-27T10:51:58.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.504+0000 7fd3e3200640 1 -- 172.21.15.47:0/3486927054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3e40b23b0 msgr2=0x7fd3e40d0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:58.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.504+0000 7fd3e3200640 1 --2- 172.21.15.47:0/3486927054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3e40b23b0 0x7fd3e40d0eb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009870 tx=0x7fd3dc02a250 comp rx=0 tx=0).stop 2024-05-27T10:51:58.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.504+0000 7fd3e3200640 1 -- 172.21.15.47:0/3486927054 shutdown_connections 2024-05-27T10:51:58.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.504+0000 7fd3e3200640 1 --2- 172.21.15.47:0/3486927054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3e40b23b0 0x7fd3e40d0eb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.504+0000 7fd3e3200640 1 --2- 172.21.15.47:0/3486927054 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd3e40ce180 0x7fd3e40d2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.504+0000 7fd3e3200640 1 -- 172.21.15.47:0/3486927054 >> 172.21.15.47:0/3486927054 conn(0x7fd3e40d22f0 msgr2=0x7fd3e40d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:58.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.505+0000 7fd3e3200640 1 -- 172.21.15.47:0/3486927054 shutdown_connections 2024-05-27T10:51:58.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.505+0000 7fd3e3200640 1 -- 172.21.15.47:0/3486927054 wait complete. 2024-05-27T10:51:58.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.506+0000 7fd3e3200640 1 Processor -- start 2024-05-27T10:51:58.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.506+0000 7fd3e3200640 1 -- start start 2024-05-27T10:51:58.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.507+0000 7fd3e3200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3e40b23b0 0x7fd3e40ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:58.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.507+0000 7fd3e3200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd3e40ce180 0x7fd3e415fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:58.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.507+0000 7fd3e3200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3e40ce560 0x7fd3e41e8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:58.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.507+0000 7fd3e3200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e40b36c0 con 0x7fd3e40ce560 2024-05-27T10:51:58.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.507+0000 7fd3e3200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e40d0990 con 0x7fd3e40b23b0 2024-05-27T10:51:58.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.507+0000 7fd3e3200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e40b27e0 con 0x7fd3e40ce180 2024-05-27T10:51:58.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.508+0000 7fd3e2800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3e40ce560 0x7fd3e41e8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:58.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.508+0000 7fd3e2800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3e40ce560 0x7fd3e41e8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51196/0 (socket says 172.21.15.47:51196) 2024-05-27T10:51:58.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.508+0000 7fd3e2800640 1 -- 172.21.15.47:0/622043195 learned_addr learned my addr 172.21.15.47:0/622043195 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:51:58.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.508+0000 7fd3e1e00640 1 --2- 172.21.15.47:0/622043195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3e40b23b0 0x7fd3e40ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:58.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.508+0000 7fd3e1400640 1 --2- 172.21.15.47:0/622043195 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd3e40ce180 0x7fd3e415fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:58.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.508+0000 7fd3e2800640 1 -- 172.21.15.47:0/622043195 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd3e40ce180 msgr2=0x7fd3e415fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:58.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.508+0000 7fd3e2800640 1 --2- 172.21.15.47:0/622043195 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd3e40ce180 0x7fd3e415fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.508+0000 7fd3e2800640 1 -- 172.21.15.47:0/622043195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3e40b23b0 msgr2=0x7fd3e40ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:58.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.508+0000 7fd3e2800640 1 --2- 172.21.15.47:0/622043195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3e40b23b0 0x7fd3e40ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.508+0000 7fd3e2800640 1 -- 172.21.15.47:0/622043195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e41602f0 con 0x7fd3e40ce560 2024-05-27T10:51:58.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.509+0000 7fd3e2800640 1 --2- 172.21.15.47:0/622043195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3e40ce560 0x7fd3e41e8e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009870 tx=0x7fd3dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:58.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.509+0000 7fd3da000640 1 -- 172.21.15.47:0/622043195 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc037040 con 0x7fd3e40ce560 2024-05-27T10:51:58.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.509+0000 7fd3da000640 1 -- 172.21.15.47:0/622043195 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3dc042070 con 0x7fd3e40ce560 2024-05-27T10:51:58.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.509+0000 7fd3da000640 1 -- 172.21.15.47:0/622043195 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc030bd0 con 0x7fd3e40ce560 2024-05-27T10:51:58.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.509+0000 7fd3e3200640 1 -- 172.21.15.47:0/622043195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e4160d20 con 0x7fd3e40ce560 2024-05-27T10:51:58.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.509+0000 7fd3e3200640 1 -- 172.21.15.47:0/622043195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e40cc100 con 0x7fd3e40ce560 2024-05-27T10:51:58.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.510+0000 7fd3e3200640 1 -- 172.21.15.47:0/622043195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e404fce0 con 0x7fd3e40ce560 2024-05-27T10:51:58.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.511+0000 7fd3da000640 1 -- 172.21.15.47:0/622043195 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd3dc047460 con 0x7fd3e40ce560 2024-05-27T10:51:58.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.512+0000 7fd3da000640 1 --2- 172.21.15.47:0/622043195 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd3c006c8f0 0x7fd3c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:58.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.512+0000 7fd3da000640 1 -- 172.21.15.47:0/622043195 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd3dc0ac490 con 0x7fd3e40ce560 2024-05-27T10:51:58.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.512+0000 7fd3e1e00640 1 --2- 172.21.15.47:0/622043195 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd3c006c8f0 0x7fd3c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:58.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.513+0000 7fd3e1e00640 1 --2- 172.21.15.47:0/622043195 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd3c006c8f0 0x7fd3c006edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40075b0 tx=0x7fd3d4007540 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:58.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.517+0000 7fd3da000640 1 -- 172.21.15.47:0/622043195 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd3dc07ac00 con 0x7fd3e40ce560 2024-05-27T10:51:58.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.726+0000 7fd3e3200640 1 -- 172.21.15.47:0/622043195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd3e406ed10 con 0x7fd3e40ce560 2024-05-27T10:51:58.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.727+0000 7fd3da000640 1 -- 172.21.15.47:0/622043195 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fd3dc07a500 con 0x7fd3e40ce560 2024-05-27T10:51:58.725 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:51:58.725 INFO:teuthology.orchestra.run.smithi047.stdout:[ 2024-05-27T10:51:58.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:51:58.725 INFO:teuthology.orchestra.run.smithi047.stdout: "poolnum": 1, 2024-05-27T10:51:58.725 INFO:teuthology.orchestra.run.smithi047.stdout: "poolname": ".mgr" 2024-05-27T10:51:58.725 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:51:58.726 INFO:teuthology.orchestra.run.smithi047.stdout:] 2024-05-27T10:51:58.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.730+0000 7fd3e3200640 1 -- 172.21.15.47:0/622043195 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd3c006c8f0 msgr2=0x7fd3c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:58.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.730+0000 7fd3e3200640 1 --2- 172.21.15.47:0/622043195 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd3c006c8f0 0x7fd3c006edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40075b0 tx=0x7fd3d4007540 comp rx=0 tx=0).stop 2024-05-27T10:51:58.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.730+0000 7fd3e3200640 1 -- 172.21.15.47:0/622043195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3e40ce560 msgr2=0x7fd3e41e8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:58.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.730+0000 7fd3e3200640 1 --2- 172.21.15.47:0/622043195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3e40ce560 0x7fd3e41e8e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009870 tx=0x7fd3dc0046c0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.730+0000 7fd3e3200640 1 -- 172.21.15.47:0/622043195 shutdown_connections 2024-05-27T10:51:58.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.730+0000 7fd3e3200640 1 --2- 172.21.15.47:0/622043195 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd3c006c8f0 0x7fd3c006edb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.730+0000 7fd3e3200640 1 --2- 172.21.15.47:0/622043195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3e40ce560 0x7fd3e41e8e10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.730+0000 7fd3e3200640 1 --2- 172.21.15.47:0/622043195 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd3e40ce180 0x7fd3e415fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.730+0000 7fd3e3200640 1 --2- 172.21.15.47:0/622043195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3e40b23b0 0x7fd3e40ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.730+0000 7fd3e3200640 1 -- 172.21.15.47:0/622043195 >> 172.21.15.47:0/622043195 conn(0x7fd3e40d22f0 msgr2=0x7fd3e4070660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:58.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.730+0000 7fd3e3200640 1 -- 172.21.15.47:0/622043195 shutdown_connections 2024-05-27T10:51:58.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.731+0000 7fd3e3200640 1 -- 172.21.15.47:0/622043195 wait complete. 2024-05-27T10:51:58.747 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-27T10:51:58.747 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-27T10:51:58.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.962+0000 7f6b70800640 1 Processor -- start 2024-05-27T10:51:58.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.963+0000 7f6b70800640 1 -- start start 2024-05-27T10:51:58.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.964+0000 7f6b70800640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b6815c540 0x7f6b680af490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:58.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.964+0000 7f6b70800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b6806df50 0x7f6b6815c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:58.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.964+0000 7f6b70800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6b6806bd60 0x7f6b6806c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:58.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.964+0000 7f6b70800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f6b6806c710 con 0x7f6b6806bd60 2024-05-27T10:51:58.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.964+0000 7f6b70800640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f6b6806e430 con 0x7f6b6815c540 2024-05-27T10:51:58.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.964+0000 7f6b70800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f6b6806e710 con 0x7f6b6806df50 2024-05-27T10:51:58.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.965+0000 7f6b6e800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6b6806bd60 0x7f6b6806c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:58.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.965+0000 7f6b6e800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6b6806bd60 0x7f6b6806c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51208/0 (socket says 172.21.15.47:51208) 2024-05-27T10:51:58.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.965+0000 7f6b6e800640 1 -- 172.21.15.47:0/2692647142 learned_addr learned my addr 172.21.15.47:0/2692647142 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:51:58.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.965+0000 7f6b6d400640 1 --2- 172.21.15.47:0/2692647142 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b6806df50 0x7f6b6815c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:58.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.965+0000 7f6b6de00640 1 --2- 172.21.15.47:0/2692647142 >> v2:172.21.15.53:3300/0 conn(0x7f6b6815c540 0x7f6b680af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:58.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.965+0000 7f6b6e800640 1 -- 172.21.15.47:0/2692647142 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b6806df50 msgr2=0x7f6b6815c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:58.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.965+0000 7f6b6e800640 1 --2- 172.21.15.47:0/2692647142 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b6806df50 0x7f6b6815c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.965+0000 7f6b6e800640 1 -- 172.21.15.47:0/2692647142 >> v2:172.21.15.53:3300/0 conn(0x7f6b6815c540 msgr2=0x7f6b680af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:51:58.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.965+0000 7f6b6e800640 1 --2- 172.21.15.47:0/2692647142 >> v2:172.21.15.53:3300/0 conn(0x7f6b6815c540 0x7f6b680af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.965+0000 7f6b6e800640 1 -- 172.21.15.47:0/2692647142 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b6806e9f0 con 0x7f6b6806bd60 2024-05-27T10:51:58.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.966+0000 7f6b6e800640 1 --2- 172.21.15.47:0/2692647142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b6806bd60 0x7f6b6806c1d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b6806e920 tx=0x7f6b6402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d5d04285639417 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:58.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.967+0000 7f6b6ca00640 1 -- 172.21.15.47:0/2692647142 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64036070 con 0x7f6b6806bd60 2024-05-27T10:51:58.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.967+0000 7f6b6ca00640 1 -- 172.21.15.47:0/2692647142 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b64031600 con 0x7f6b6806bd60 2024-05-27T10:51:58.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.967+0000 7f6b6ca00640 1 -- 172.21.15.47:0/2692647142 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b640319d0 con 0x7f6b6806bd60 2024-05-27T10:51:58.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.968+0000 7f6b70800640 1 -- 172.21.15.47:0/2692647142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b6806bd60 msgr2=0x7f6b6806c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:58.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.968+0000 7f6b70800640 1 --2- 172.21.15.47:0/2692647142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b6806bd60 0x7f6b6806c1d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b6806e920 tx=0x7f6b6402a680 comp rx=0 tx=0).stop 2024-05-27T10:51:58.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.968+0000 7f6b70800640 1 -- 172.21.15.47:0/2692647142 shutdown_connections 2024-05-27T10:51:58.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.968+0000 7f6b70800640 1 --2- 172.21.15.47:0/2692647142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b6806bd60 0x7f6b6806c1d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.968+0000 7f6b70800640 1 --2- 172.21.15.47:0/2692647142 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b6806df50 0x7f6b6815c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.968+0000 7f6b70800640 1 --2- 172.21.15.47:0/2692647142 >> v2:172.21.15.53:3300/0 conn(0x7f6b6815c540 0x7f6b680af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.968+0000 7f6b70800640 1 -- 172.21.15.47:0/2692647142 >> 172.21.15.47:0/2692647142 conn(0x7f6b680b21e0 msgr2=0x7f6b680b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:51:58.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.968+0000 7f6b70800640 1 -- 172.21.15.47:0/2692647142 shutdown_connections 2024-05-27T10:51:58.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.968+0000 7f6b70800640 1 -- 172.21.15.47:0/2692647142 wait complete. 2024-05-27T10:51:58.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.970+0000 7f6b70800640 1 Processor -- start 2024-05-27T10:51:58.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.970+0000 7f6b70800640 1 -- start start 2024-05-27T10:51:58.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.971+0000 7f6b70800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b6806bd60 0x7f6b6814e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:58.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.971+0000 7f6b70800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b6806df50 0x7f6b6815a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:58.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.971+0000 7f6b70800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6815c540 0x7f6b6815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:58.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.971+0000 7f6b70800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6b680afb50 con 0x7f6b6806bd60 2024-05-27T10:51:58.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.971+0000 7f6b70800640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6b680af9d0 con 0x7f6b6815c540 2024-05-27T10:51:58.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.971+0000 7f6b70800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f6b6815ce60 con 0x7f6b6806df50 2024-05-27T10:51:58.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.971+0000 7f6b6de00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b6806bd60 0x7f6b6814e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:58.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.971+0000 7f6b6de00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b6806bd60 0x7f6b6814e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51222/0 (socket says 172.21.15.47:51222) 2024-05-27T10:51:58.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.971+0000 7f6b6de00640 1 -- 172.21.15.47:0/1524650850 learned_addr learned my addr 172.21.15.47:0/1524650850 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:51:58.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.972+0000 7f6b6e800640 1 --2- 172.21.15.47:0/1524650850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6815c540 0x7f6b6815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:58.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.972+0000 7f6b6de00640 1 -- 172.21.15.47:0/1524650850 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b6806df50 msgr2=0x7f6b6815a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:58.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.972+0000 7f6b6de00640 1 --2- 172.21.15.47:0/1524650850 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b6806df50 0x7f6b6815a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.972+0000 7f6b6de00640 1 -- 172.21.15.47:0/1524650850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6815c540 msgr2=0x7f6b6815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:51:58.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.972+0000 7f6b6de00640 1 --2- 172.21.15.47:0/1524650850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6815c540 0x7f6b6815aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:51:58.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.972+0000 7f6b6de00640 1 -- 172.21.15.47:0/1524650850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b680cc280 con 0x7f6b6806bd60 2024-05-27T10:51:58.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.972+0000 7f6b6de00640 1 --2- 172.21.15.47:0/1524650850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b6806bd60 0x7f6b6814e240 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00e870 tx=0x7f6b5c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:58.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.972+0000 7f6b62000640 1 -- 172.21.15.47:0/1524650850 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c017070 con 0x7f6b6806bd60 2024-05-27T10:51:58.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.972+0000 7f6b62000640 1 -- 172.21.15.47:0/1524650850 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5c00c940 con 0x7f6b6806bd60 2024-05-27T10:51:58.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.972+0000 7f6b70800640 1 -- 172.21.15.47:0/1524650850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b681562a0 con 0x7f6b6806bd60 2024-05-27T10:51:58.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.973+0000 7f6b62000640 1 -- 172.21.15.47:0/1524650850 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c00cd30 con 0x7f6b6806bd60 2024-05-27T10:51:58.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.973+0000 7f6b70800640 1 -- 172.21.15.47:0/1524650850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b68156540 con 0x7f6b6806bd60 2024-05-27T10:51:58.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.974+0000 7f6b70800640 1 -- 172.21.15.47:0/1524650850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b681560d0 con 0x7f6b6806bd60 2024-05-27T10:51:58.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.975+0000 7f6b62000640 1 -- 172.21.15.47:0/1524650850 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6b5c01a070 con 0x7f6b6806bd60 2024-05-27T10:51:58.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.976+0000 7f6b62000640 1 --2- 172.21.15.47:0/1524650850 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6b4c06c8f0 0x7f6b4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:51:58.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.976+0000 7f6b62000640 1 -- 172.21.15.47:0/1524650850 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f6b5c08b6e0 con 0x7f6b6806bd60 2024-05-27T10:51:58.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.976+0000 7f6b6d400640 1 --2- 172.21.15.47:0/1524650850 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6b4c06c8f0 0x7f6b4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:51:58.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.977+0000 7f6b6d400640 1 --2- 172.21.15.47:0/1524650850 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6b4c06c8f0 0x7f6b4c06edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6b58006a90 tx=0x7f6b58006a20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:51:58.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:58.981+0000 7f6b62000640 1 -- 172.21.15.47:0/1524650850 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6b5c059e50 con 0x7f6b6806bd60 2024-05-27T10:51:59.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:51:59.186+0000 7f6b70800640 1 -- 172.21.15.47:0/1524650850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6b680689e0 con 0x7f6b6806bd60 2024-05-27T10:52:00.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.188+0000 7f6b62000640 1 -- 172.21.15.47:0/1524650850 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f6b5c059750 con 0x7f6b6806bd60 2024-05-27T10:52:00.185 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' created 2024-05-27T10:52:00.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.192+0000 7f6b70800640 1 -- 172.21.15.47:0/1524650850 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6b4c06c8f0 msgr2=0x7f6b4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:00.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.192+0000 7f6b70800640 1 --2- 172.21.15.47:0/1524650850 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6b4c06c8f0 0x7f6b4c06edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6b58006a90 tx=0x7f6b58006a20 comp rx=0 tx=0).stop 2024-05-27T10:52:00.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.192+0000 7f6b70800640 1 -- 172.21.15.47:0/1524650850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b6806bd60 msgr2=0x7f6b6814e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:00.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.192+0000 7f6b70800640 1 --2- 172.21.15.47:0/1524650850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b6806bd60 0x7f6b6814e240 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00e870 tx=0x7f6b5c00ed30 comp rx=0 tx=0).stop 2024-05-27T10:52:00.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.192+0000 7f6b70800640 1 -- 172.21.15.47:0/1524650850 shutdown_connections 2024-05-27T10:52:00.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.192+0000 7f6b70800640 1 --2- 172.21.15.47:0/1524650850 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6b4c06c8f0 0x7f6b4c06edb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:00.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.192+0000 7f6b70800640 1 --2- 172.21.15.47:0/1524650850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6815c540 0x7f6b6815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:00.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.192+0000 7f6b70800640 1 --2- 172.21.15.47:0/1524650850 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b6806df50 0x7f6b6815a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:00.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.192+0000 7f6b70800640 1 --2- 172.21.15.47:0/1524650850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b6806bd60 0x7f6b6814e240 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:00.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.192+0000 7f6b70800640 1 -- 172.21.15.47:0/1524650850 >> 172.21.15.47:0/1524650850 conn(0x7f6b680b21e0 msgr2=0x7f6b6806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:00.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.192+0000 7f6b70800640 1 -- 172.21.15.47:0/1524650850 shutdown_connections 2024-05-27T10:52:00.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.192+0000 7f6b70800640 1 -- 172.21.15.47:0/1524650850 wait complete. 2024-05-27T10:52:00.219 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-27T10:52:00.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.426+0000 7f4621a00640 1 Processor -- start 2024-05-27T10:52:00.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.426+0000 7f4621a00640 1 -- start start 2024-05-27T10:52:00.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.428+0000 7f4621a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f461c0afd70 0x7f461c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:00.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.428+0000 7f4621a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f461c072440 0x7f461c0b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:00.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.428+0000 7f4621a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f461c06de00 con 0x7f461c1473d0 2024-05-27T10:52:00.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.428+0000 7f4621a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f461c06e0e0 con 0x7f461c0afd70 2024-05-27T10:52:00.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.428+0000 7f4621a00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f461c06e3c0 con 0x7f461c072440 2024-05-27T10:52:00.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.428+0000 7f461aa00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f461c1473d0 0x7f461c071d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45266/0 (socket says 172.21.15.47:45266) 2024-05-27T10:52:00.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.428+0000 7f461aa00640 1 -- 172.21.15.47:0/2170001637 learned_addr learned my addr 172.21.15.47:0/2170001637 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:00.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.428+0000 7f461a000640 1 --2- 172.21.15.47:0/2170001637 >> v2:172.21.15.47:3300/0 conn(0x7f461c0afd70 0x7f461c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:00.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.428+0000 7f4619600640 1 -- 172.21.15.47:0/2170001637 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3389914543 0 0) 0x7f461c06de00 con 0x7f461c1473d0 2024-05-27T10:52:00.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.428+0000 7f461b400640 1 --2- 172.21.15.47:0/2170001637 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f461c072440 0x7f461c0b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:00.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.429+0000 7f4619600640 1 -- 172.21.15.47:0/2170001637 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4600003520 con 0x7f461c1473d0 2024-05-27T10:52:00.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.429+0000 7f4619600640 1 -- 172.21.15.47:0/2170001637 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3982472570 0 0) 0x7f4600003520 con 0x7f461c1473d0 2024-05-27T10:52:00.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.429+0000 7f4619600640 1 -- 172.21.15.47:0/2170001637 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f461c072440 msgr2=0x7f461c0b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:00.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.429+0000 7f4619600640 1 --2- 172.21.15.47:0/2170001637 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f461c072440 0x7f461c0b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:00.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.429+0000 7f4619600640 1 -- 172.21.15.47:0/2170001637 >> v2:172.21.15.47:3300/0 conn(0x7f461c0afd70 msgr2=0x7f461c0b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:00.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.429+0000 7f4619600640 1 --2- 172.21.15.47:0/2170001637 >> v2:172.21.15.47:3300/0 conn(0x7f461c0afd70 0x7f461c0b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:00.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.429+0000 7f4619600640 1 -- 172.21.15.47:0/2170001637 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461c06e6a0 con 0x7f461c1473d0 2024-05-27T10:52:00.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.429+0000 7f4619600640 1 -- 172.21.15.47:0/2170001637 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f460c001670 con 0x7f461c1473d0 2024-05-27T10:52:00.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.429+0000 7f4619600640 1 -- 172.21.15.47:0/2170001637 >> v1:172.21.15.47:6789/0 conn(0x7f461c1473d0 legacy=0x7f461c071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:00.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.429+0000 7f4619600640 1 --2- 172.21.15.47:0/2170001637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46000039b0 0x7f4600003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:00.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.429+0000 7f4619600640 1 --2- 172.21.15.47:0/2170001637 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f461c072440 0x7f4600004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:00.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.429+0000 7f4619600640 1 --2- 172.21.15.47:0/2170001637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4600004d40 0x7f46000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:00.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.429+0000 7f4619600640 1 -- 172.21.15.47:0/2170001637 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f461c06e0e0 con 0x7f4600004d40 2024-05-27T10:52:00.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.429+0000 7f4619600640 1 -- 172.21.15.47:0/2170001637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f461c06e3c0 con 0x7f46000039b0 2024-05-27T10:52:00.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.429+0000 7f4619600640 1 -- 172.21.15.47:0/2170001637 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f460000b9f0 con 0x7f461c072440 2024-05-27T10:52:00.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.429+0000 7f461b400640 1 --2- 172.21.15.47:0/2170001637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4600004d40 0x7f46000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:00.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.430+0000 7f461aa00640 1 --2- 172.21.15.47:0/2170001637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46000039b0 0x7f4600003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:00.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.430+0000 7f461b400640 1 -- 172.21.15.47:0/2170001637 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f461c072440 msgr2=0x7f4600004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:00.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.430+0000 7f461b400640 1 --2- 172.21.15.47:0/2170001637 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f461c072440 0x7f4600004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:00.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.430+0000 7f461b400640 1 -- 172.21.15.47:0/2170001637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46000039b0 msgr2=0x7f4600003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:00.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.430+0000 7f461b400640 1 --2- 172.21.15.47:0/2170001637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46000039b0 0x7f4600003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:00.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.430+0000 7f461b400640 1 -- 172.21.15.47:0/2170001637 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4600003520 con 0x7f4600004d40 2024-05-27T10:52:00.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.431+0000 7f461b400640 1 --2- 172.21.15.47:0/2170001637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4600004d40 0x7f46000051c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4614009fc0 tx=0x7f4600005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e47f721545f02d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:00.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.431+0000 7f4619600640 1 -- 172.21.15.47:0/2170001637 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614009c10 con 0x7f4600004d40 2024-05-27T10:52:00.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.431+0000 7f4619600640 1 -- 172.21.15.47:0/2170001637 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4614036070 con 0x7f4600004d40 2024-05-27T10:52:00.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.431+0000 7f4619600640 1 -- 172.21.15.47:0/2170001637 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461402d070 con 0x7f4600004d40 2024-05-27T10:52:00.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.432+0000 7f4621a00640 1 -- 172.21.15.47:0/2170001637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4600004d40 msgr2=0x7f46000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:00.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.432+0000 7f4621a00640 1 --2- 172.21.15.47:0/2170001637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4600004d40 0x7f46000051c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4614009fc0 tx=0x7f4600005830 comp rx=0 tx=0).stop 2024-05-27T10:52:00.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.432+0000 7f461b400640 1 -- 172.21.15.47:0/2170001637 reap_dead start 2024-05-27T10:52:00.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.432+0000 7f4621a00640 1 -- 172.21.15.47:0/2170001637 shutdown_connections 2024-05-27T10:52:00.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.432+0000 7f4621a00640 1 -- 172.21.15.47:0/2170001637 >> 172.21.15.47:0/2170001637 conn(0x7f461c0b21e0 msgr2=0x7f461c0b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:00.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.432+0000 7f4621a00640 1 -- 172.21.15.47:0/2170001637 shutdown_connections 2024-05-27T10:52:00.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.432+0000 7f4621a00640 1 -- 172.21.15.47:0/2170001637 wait complete. 2024-05-27T10:52:00.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.434+0000 7f4621a00640 1 Processor -- start 2024-05-27T10:52:00.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.434+0000 7f4621a00640 1 -- start start 2024-05-27T10:52:00.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.435+0000 7f4621a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4600004d40 0x7f461c0cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:00.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.435+0000 7f4621a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f461c15d450 0x7f461c161340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:00.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.435+0000 7f4621a00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f461c1424d0 0x7f461c142950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:00.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.435+0000 7f4621a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f461c0b54d0 con 0x7f4600004d40 2024-05-27T10:52:00.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.435+0000 7f4621a00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f461c0b5350 con 0x7f461c1424d0 2024-05-27T10:52:00.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.435+0000 7f4621a00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f461c0b5650 con 0x7f461c15d450 2024-05-27T10:52:00.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.435+0000 7f461aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4600004d40 0x7f461c0cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:00.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.435+0000 7f461aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4600004d40 0x7f461c0cd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51250/0 (socket says 172.21.15.47:51250) 2024-05-27T10:52:00.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.435+0000 7f461aa00640 1 -- 172.21.15.47:0/1144783419 learned_addr learned my addr 172.21.15.47:0/1144783419 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:00.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.436+0000 7f461b400640 1 --2- 172.21.15.47:0/1144783419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f461c1424d0 0x7f461c142950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:00.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.436+0000 7f461a000640 1 --2- 172.21.15.47:0/1144783419 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f461c15d450 0x7f461c161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:00.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.436+0000 7f461aa00640 1 -- 172.21.15.47:0/1144783419 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f461c15d450 msgr2=0x7f461c161340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:00.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.436+0000 7f461aa00640 1 --2- 172.21.15.47:0/1144783419 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f461c15d450 0x7f461c161340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:00.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.436+0000 7f461aa00640 1 -- 172.21.15.47:0/1144783419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f461c1424d0 msgr2=0x7f461c142950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:00.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.436+0000 7f461aa00640 1 --2- 172.21.15.47:0/1144783419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f461c1424d0 0x7f461c142950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:00.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.436+0000 7f461aa00640 1 -- 172.21.15.47:0/1144783419 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461c0cdf60 con 0x7f4600004d40 2024-05-27T10:52:00.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.436+0000 7f461b400640 1 --2- 172.21.15.47:0/1144783419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f461c1424d0 0x7f461c142950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:00.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.436+0000 7f461a000640 1 --2- 172.21.15.47:0/1144783419 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f461c15d450 0x7f461c161340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:00.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.436+0000 7f461aa00640 1 --2- 172.21.15.47:0/1144783419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4600004d40 0x7f461c0cd8d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f460c00e8d0 tx=0x7f460c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:00.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.436+0000 7f4612a00640 1 -- 172.21.15.47:0/1144783419 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460c005240 con 0x7f4600004d40 2024-05-27T10:52:00.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.436+0000 7f4612a00640 1 -- 172.21.15.47:0/1144783419 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460c0053e0 con 0x7f4600004d40 2024-05-27T10:52:00.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.436+0000 7f4612a00640 1 -- 172.21.15.47:0/1144783419 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460c0047e0 con 0x7f4600004d40 2024-05-27T10:52:00.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.436+0000 7f4621a00640 1 -- 172.21.15.47:0/1144783419 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f461c0ce240 con 0x7f4600004d40 2024-05-27T10:52:00.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.437+0000 7f4621a00640 1 -- 172.21.15.47:0/1144783419 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f461c0ce800 con 0x7f4600004d40 2024-05-27T10:52:00.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.438+0000 7f4621a00640 1 -- 172.21.15.47:0/1144783419 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f461c142e90 con 0x7f4600004d40 2024-05-27T10:52:00.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.439+0000 7f4612a00640 1 -- 172.21.15.47:0/1144783419 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f460c004980 con 0x7f4600004d40 2024-05-27T10:52:00.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.440+0000 7f4612a00640 1 --2- 172.21.15.47:0/1144783419 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f45fc06c940 0x7f45fc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:00.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.440+0000 7f4612a00640 1 -- 172.21.15.47:0/1144783419 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f460c08b3b0 con 0x7f4600004d40 2024-05-27T10:52:00.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.440+0000 7f461a000640 1 --2- 172.21.15.47:0/1144783419 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f45fc06c940 0x7f45fc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:00.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.441+0000 7f461a000640 1 --2- 172.21.15.47:0/1144783419 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f45fc06c940 0x7f45fc06ee00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f461c1f8480 tx=0x7f4608008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:00.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.445+0000 7f4612a00640 1 -- 172.21.15.47:0/1144783419 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f460c059a30 con 0x7f4600004d40 2024-05-27T10:52:00.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:00.651+0000 7f4621a00640 1 -- 172.21.15.47:0/1144783419 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f461c0b4e10 con 0x7f4600004d40 2024-05-27T10:52:01.011 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T10:52:01.018 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T10:52:01.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.194+0000 7f4612a00640 1 -- 172.21.15.47:0/1144783419 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7f461c0b4e10 con 0x7f4600004d40 2024-05-27T10:52:01.196 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' created 2024-05-27T10:52:01.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.197+0000 7f4621a00640 1 -- 172.21.15.47:0/1144783419 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f45fc06c940 msgr2=0x7f45fc06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:01.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.197+0000 7f4621a00640 1 --2- 172.21.15.47:0/1144783419 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f45fc06c940 0x7f45fc06ee00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f461c1f8480 tx=0x7f4608008040 comp rx=0 tx=0).stop 2024-05-27T10:52:01.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.197+0000 7f4621a00640 1 -- 172.21.15.47:0/1144783419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4600004d40 msgr2=0x7f461c0cd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:01.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.197+0000 7f4621a00640 1 --2- 172.21.15.47:0/1144783419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4600004d40 0x7f461c0cd8d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f460c00e8d0 tx=0x7f460c00ed90 comp rx=0 tx=0).stop 2024-05-27T10:52:01.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.198+0000 7f4621a00640 1 -- 172.21.15.47:0/1144783419 shutdown_connections 2024-05-27T10:52:01.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.198+0000 7f4621a00640 1 --2- 172.21.15.47:0/1144783419 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f45fc06c940 0x7f45fc06ee00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:01.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.198+0000 7f4621a00640 1 --2- 172.21.15.47:0/1144783419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f461c1424d0 0x7f461c142950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:01.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.198+0000 7f4621a00640 1 --2- 172.21.15.47:0/1144783419 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f461c15d450 0x7f461c161340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:01.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.198+0000 7f4621a00640 1 --2- 172.21.15.47:0/1144783419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4600004d40 0x7f461c0cd8d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:01.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.198+0000 7f4621a00640 1 -- 172.21.15.47:0/1144783419 >> 172.21.15.47:0/1144783419 conn(0x7f461c0b21e0 msgr2=0x7f461c15dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:01.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.200+0000 7f4621a00640 1 -- 172.21.15.47:0/1144783419 shutdown_connections 2024-05-27T10:52:01.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.201+0000 7f4621a00640 1 -- 172.21.15.47:0/1144783419 wait complete. 2024-05-27T10:52:01.235 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-27T10:52:01.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.419+0000 7f1143200640 1 Processor -- start 2024-05-27T10:52:01.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.419+0000 7f1143200640 1 -- start start 2024-05-27T10:52:01.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.420+0000 7f1143200640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f114415c510 0x7f11440b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:01.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.420+0000 7f1143200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11440b4620 con 0x7f11440d0a30 2024-05-27T10:52:01.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.420+0000 7f1143200640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11440b4900 con 0x7f114406da80 2024-05-27T10:52:01.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.420+0000 7f1143200640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f11440b4be0 con 0x7f114415c510 2024-05-27T10:52:01.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.421+0000 7f1142800640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f11440d0a30 0x7f11440ce9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43806/0 (socket says 172.21.15.47:43806) 2024-05-27T10:52:01.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.421+0000 7f1142800640 1 -- 172.21.15.47:0/2551829153 learned_addr learned my addr 172.21.15.47:0/2551829153 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:01.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.421+0000 7f1141e00640 1 --2- 172.21.15.47:0/2551829153 >> v2:172.21.15.53:3300/0 conn(0x7f114415c510 0x7f11440b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:01.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.421+0000 7f1141400640 1 -- 172.21.15.47:0/2551829153 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1562560153 0 0) 0x7f11440b4620 con 0x7f11440d0a30 2024-05-27T10:52:01.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.421+0000 7f1141400640 1 -- 172.21.15.47:0/2551829153 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1128003520 con 0x7f11440d0a30 2024-05-27T10:52:01.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.422+0000 7f1141400640 1 -- 172.21.15.47:0/2551829153 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 950143171 0 0) 0x7f1128003520 con 0x7f11440d0a30 2024-05-27T10:52:01.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.422+0000 7f1141400640 1 -- 172.21.15.47:0/2551829153 >> v2:172.21.15.53:3300/0 conn(0x7f114415c510 msgr2=0x7f11440b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:01.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.422+0000 7f1141400640 1 --2- 172.21.15.47:0/2551829153 >> v2:172.21.15.53:3300/0 conn(0x7f114415c510 0x7f11440b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:01.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.422+0000 7f1141400640 1 -- 172.21.15.47:0/2551829153 >> v1:172.21.15.53:6789/0 conn(0x7f114406da80 legacy=0x7f11440d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:01.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.422+0000 7f1141400640 1 -- 172.21.15.47:0/2551829153 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11440b4ec0 con 0x7f11440d0a30 2024-05-27T10:52:01.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.422+0000 7f1141400640 1 -- 172.21.15.47:0/2551829153 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f113c0019f0 con 0x7f11440d0a30 2024-05-27T10:52:01.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.422+0000 7f1141400640 1 -- 172.21.15.47:0/2551829153 >> v1:172.21.15.47:6789/0 conn(0x7f11440d0a30 legacy=0x7f11440ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:01.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.422+0000 7f1141400640 1 --2- 172.21.15.47:0/2551829153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11280039b0 0x7f1128003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:01.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.422+0000 7f1141400640 1 --2- 172.21.15.47:0/2551829153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11280043b0 0x7f1128004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:01.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.422+0000 7f1141400640 1 --2- 172.21.15.47:0/2551829153 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1128005080 0x7f112800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:01.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.422+0000 7f1141400640 1 -- 172.21.15.47:0/2551829153 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f11440b4be0 con 0x7f11280043b0 2024-05-27T10:52:01.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.422+0000 7f1141400640 1 -- 172.21.15.47:0/2551829153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f112800bfe0 con 0x7f11280039b0 2024-05-27T10:52:01.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.422+0000 7f1141400640 1 -- 172.21.15.47:0/2551829153 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f112800c1e0 con 0x7f1128005080 2024-05-27T10:52:01.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.422+0000 7f1139400640 1 --2- 172.21.15.47:0/2551829153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11280043b0 0x7f1128004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:01.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.423+0000 7f1142800640 1 --2- 172.21.15.47:0/2551829153 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1128005080 0x7f112800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:01.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.423+0000 7f1139400640 1 -- 172.21.15.47:0/2551829153 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1128005080 msgr2=0x7f112800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:01.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.423+0000 7f1139400640 1 --2- 172.21.15.47:0/2551829153 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1128005080 0x7f112800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:01.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.423+0000 7f1139400640 1 -- 172.21.15.47:0/2551829153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11280039b0 msgr2=0x7f1128003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:01.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.423+0000 7f1139400640 1 --2- 172.21.15.47:0/2551829153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11280039b0 0x7f1128003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:01.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.423+0000 7f1139400640 1 -- 172.21.15.47:0/2551829153 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1128003520 con 0x7f11280043b0 2024-05-27T10:52:01.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.423+0000 7f1142800640 1 -- 172.21.15.47:0/2551829153 reap_dead start 2024-05-27T10:52:01.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.424+0000 7f1139400640 1 --2- 172.21.15.47:0/2551829153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11280043b0 0x7f1128004880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1134001860 tx=0x7f1128005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=961de63b3177653a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:01.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.424+0000 7f1141400640 1 -- 172.21.15.47:0/2551829153 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134037070 con 0x7f11280043b0 2024-05-27T10:52:01.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.424+0000 7f1141400640 1 -- 172.21.15.47:0/2551829153 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f113402abf0 con 0x7f11280043b0 2024-05-27T10:52:01.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.424+0000 7f1141400640 1 -- 172.21.15.47:0/2551829153 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134001430 con 0x7f11280043b0 2024-05-27T10:52:01.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.425+0000 7f1143200640 1 -- 172.21.15.47:0/2551829153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11280043b0 msgr2=0x7f1128004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:01.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.425+0000 7f1143200640 1 --2- 172.21.15.47:0/2551829153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11280043b0 0x7f1128004880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1134001860 tx=0x7f1128005830 comp rx=0 tx=0).stop 2024-05-27T10:52:01.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.425+0000 7f1143200640 1 -- 172.21.15.47:0/2551829153 shutdown_connections 2024-05-27T10:52:01.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.425+0000 7f1143200640 1 --2- 172.21.15.47:0/2551829153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11280043b0 0x7f1128004880 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:01.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.425+0000 7f1143200640 1 -- 172.21.15.47:0/2551829153 >> 172.21.15.47:0/2551829153 conn(0x7f114406bb20 msgr2=0x7f114406bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:01.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.425+0000 7f1143200640 1 -- 172.21.15.47:0/2551829153 shutdown_connections 2024-05-27T10:52:01.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.425+0000 7f1143200640 1 -- 172.21.15.47:0/2551829153 wait complete. 2024-05-27T10:52:01.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.427+0000 7f1143200640 1 Processor -- start 2024-05-27T10:52:01.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.427+0000 7f1143200640 1 -- start start 2024-05-27T10:52:01.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.428+0000 7f1143200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11280043b0 0x7f11441573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:01.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.428+0000 7f1143200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1144147480 0x7f11441553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:01.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.428+0000 7f1143200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1144155900 0x7f1144153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:01.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.428+0000 7f1143200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f11440d04a0 con 0x7f1144155900 2024-05-27T10:52:01.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.428+0000 7f1143200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f11440d0320 con 0x7f1144147480 2024-05-27T10:52:01.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.428+0000 7f1143200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f11440d0620 con 0x7f11280043b0 2024-05-27T10:52:01.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.428+0000 7f1142800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1144155900 0x7f1144153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:01.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.428+0000 7f1142800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1144155900 0x7f1144153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34870/0 (socket says 172.21.15.47:34870) 2024-05-27T10:52:01.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.428+0000 7f1142800640 1 -- 172.21.15.47:0/3829372487 learned_addr learned my addr 172.21.15.47:0/3829372487 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:01.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.428+0000 7f1141e00640 1 --2- 172.21.15.47:0/3829372487 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11280043b0 0x7f11441573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:01.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.428+0000 7f1142800640 1 -- 172.21.15.47:0/3829372487 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11280043b0 msgr2=0x7f11441573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:01.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.428+0000 7f1142800640 1 --2- 172.21.15.47:0/3829372487 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11280043b0 0x7f11441573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:01.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.428+0000 7f1142800640 1 -- 172.21.15.47:0/3829372487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1144147480 msgr2=0x7f11441553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:01.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.428+0000 7f1142800640 1 --2- 172.21.15.47:0/3829372487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1144147480 0x7f11441553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:01.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.428+0000 7f1142800640 1 -- 172.21.15.47:0/3829372487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1144157900 con 0x7f1144155900 2024-05-27T10:52:01.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.429+0000 7f1142800640 1 --2- 172.21.15.47:0/3829372487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1144155900 0x7f1144153dd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f11440b3a60 tx=0x7f113c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:01.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.429+0000 7f113aa00640 1 -- 172.21.15.47:0/3829372487 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c004d60 con 0x7f1144155900 2024-05-27T10:52:01.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.429+0000 7f113aa00640 1 -- 172.21.15.47:0/3829372487 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f113c00bb80 con 0x7f1144155900 2024-05-27T10:52:01.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.429+0000 7f1143200640 1 -- 172.21.15.47:0/3829372487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1144154ac0 con 0x7f1144155900 2024-05-27T10:52:01.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.429+0000 7f113aa00640 1 -- 172.21.15.47:0/3829372487 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c007070 con 0x7f1144155900 2024-05-27T10:52:01.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.429+0000 7f1143200640 1 -- 172.21.15.47:0/3829372487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f114415d000 con 0x7f1144155900 2024-05-27T10:52:01.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.430+0000 7f1143200640 1 -- 172.21.15.47:0/3829372487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f114404fce0 con 0x7f1144155900 2024-05-27T10:52:01.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.431+0000 7f113aa00640 1 -- 172.21.15.47:0/3829372487 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f113c01b020 con 0x7f1144155900 2024-05-27T10:52:01.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.432+0000 7f113aa00640 1 --2- 172.21.15.47:0/3829372487 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f112006c970 0x7f112006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:01.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.432+0000 7f113aa00640 1 -- 172.21.15.47:0/3829372487 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f113c08bc20 con 0x7f1144155900 2024-05-27T10:52:01.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.432+0000 7f1141e00640 1 --2- 172.21.15.47:0/3829372487 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f112006c970 0x7f112006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:01.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.433+0000 7f1141e00640 1 --2- 172.21.15.47:0/3829372487 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f112006c970 0x7f112006ee30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f112c0047b0 tx=0x7f112c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:01.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.437+0000 7f113aa00640 1 -- 172.21.15.47:0/3829372487 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f113c05a090 con 0x7f1144155900 2024-05-27T10:52:01.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:01.682+0000 7f1143200640 1 -- 172.21.15.47:0/3829372487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f11440b2e40 con 0x7f1144155900 2024-05-27T10:52:02.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.238+0000 7f113aa00640 1 -- 172.21.15.47:0/3829372487 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f113c059990 con 0x7f1144155900 2024-05-27T10:52:02.236 INFO:teuthology.orchestra.run.smithi047.stderr:new fs with metadata pool 2 and data pool 3 2024-05-27T10:52:02.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.242+0000 7f1143200640 1 -- 172.21.15.47:0/3829372487 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f112006c970 msgr2=0x7f112006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:02.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.242+0000 7f1143200640 1 --2- 172.21.15.47:0/3829372487 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f112006c970 0x7f112006ee30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f112c0047b0 tx=0x7f112c008040 comp rx=0 tx=0).stop 2024-05-27T10:52:02.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.242+0000 7f1143200640 1 -- 172.21.15.47:0/3829372487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1144155900 msgr2=0x7f1144153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:02.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.242+0000 7f1143200640 1 --2- 172.21.15.47:0/3829372487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1144155900 0x7f1144153dd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f11440b3a60 tx=0x7f113c00b4a0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.243+0000 7f1143200640 1 -- 172.21.15.47:0/3829372487 shutdown_connections 2024-05-27T10:52:02.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.243+0000 7f1143200640 1 --2- 172.21.15.47:0/3829372487 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f112006c970 0x7f112006ee30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.243+0000 7f1143200640 1 --2- 172.21.15.47:0/3829372487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1144155900 0x7f1144153dd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.243+0000 7f1143200640 1 --2- 172.21.15.47:0/3829372487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1144147480 0x7f11441553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.243+0000 7f1143200640 1 --2- 172.21.15.47:0/3829372487 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11280043b0 0x7f11441573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.243+0000 7f1143200640 1 -- 172.21.15.47:0/3829372487 >> 172.21.15.47:0/3829372487 conn(0x7f114406bb20 msgr2=0x7f11440ce8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.244+0000 7f1143200640 1 -- 172.21.15.47:0/3829372487 shutdown_connections 2024-05-27T10:52:02.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.244+0000 7f1143200640 1 -- 172.21.15.47:0/3829372487 wait complete. 2024-05-27T10:52:02.276 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:52:02.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.454+0000 7f8d79c00640 1 Processor -- start 2024-05-27T10:52:02.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.454+0000 7f8d79c00640 1 -- start start 2024-05-27T10:52:02.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.455+0000 7f8d79c00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8d740d0a70 0x7f8d7406e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:02.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.455+0000 7f8d79c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d7406f3a0 con 0x7f8d7406ebd0 2024-05-27T10:52:02.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.455+0000 7f8d79c00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d7406f680 con 0x7f8d7415b380 2024-05-27T10:52:02.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.455+0000 7f8d79c00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f8d740adcc0 con 0x7f8d740d0a70 2024-05-27T10:52:02.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.455+0000 7f8d79200640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f8d7406ebd0 0x7f8d740ae130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43812/0 (socket says 172.21.15.47:43812) 2024-05-27T10:52:02.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.455+0000 7f8d79200640 1 -- 172.21.15.47:0/444483112 learned_addr learned my addr 172.21.15.47:0/444483112 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:02.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.456+0000 7f8d6b400640 1 --2- 172.21.15.47:0/444483112 >> v2:172.21.15.53:3300/0 conn(0x7f8d740d0a70 0x7f8d7406e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:02.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.456+0000 7f8d73400640 1 -- 172.21.15.47:0/444483112 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3130777407 0 0) 0x7f8d7406f3a0 con 0x7f8d7406ebd0 2024-05-27T10:52:02.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.456+0000 7f8d73400640 1 -- 172.21.15.47:0/444483112 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d58003520 con 0x7f8d7406ebd0 2024-05-27T10:52:02.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.456+0000 7f8d73400640 1 -- 172.21.15.47:0/444483112 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 351200136 0 0) 0x7f8d58003520 con 0x7f8d7406ebd0 2024-05-27T10:52:02.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.456+0000 7f8d73400640 1 -- 172.21.15.47:0/444483112 >> v2:172.21.15.53:3300/0 conn(0x7f8d740d0a70 msgr2=0x7f8d7406e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:02.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.456+0000 7f8d73400640 1 --2- 172.21.15.47:0/444483112 >> v2:172.21.15.53:3300/0 conn(0x7f8d740d0a70 0x7f8d7406e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.456+0000 7f8d73400640 1 -- 172.21.15.47:0/444483112 >> v1:172.21.15.53:6789/0 conn(0x7f8d7415b380 legacy=0x7f8d740d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:02.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.456+0000 7f8d73400640 1 -- 172.21.15.47:0/444483112 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7406f960 con 0x7f8d7406ebd0 2024-05-27T10:52:02.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.456+0000 7f8d73400640 1 -- 172.21.15.47:0/444483112 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f8d6c0019f0 con 0x7f8d7406ebd0 2024-05-27T10:52:02.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.456+0000 7f8d73400640 1 -- 172.21.15.47:0/444483112 >> v1:172.21.15.47:6789/0 conn(0x7f8d7406ebd0 legacy=0x7f8d740ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:02.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.456+0000 7f8d73400640 1 --2- 172.21.15.47:0/444483112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d580039b0 0x7f8d58003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:02.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.456+0000 7f8d73400640 1 --2- 172.21.15.47:0/444483112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d58004800 0x7f8d58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:02.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.456+0000 7f8d73400640 1 --2- 172.21.15.47:0/444483112 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8d580051c0 0x7f8d5800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:02.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.457+0000 7f8d73400640 1 -- 172.21.15.47:0/444483112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5800c130 con 0x7f8d58004800 2024-05-27T10:52:02.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.457+0000 7f8d73400640 1 -- 172.21.15.47:0/444483112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5800c2e0 con 0x7f8d580039b0 2024-05-27T10:52:02.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.457+0000 7f8d73400640 1 -- 172.21.15.47:0/444483112 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8d5800c4e0 con 0x7f8d580051c0 2024-05-27T10:52:02.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.457+0000 7f8d6b400640 1 --2- 172.21.15.47:0/444483112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d58004800 0x7f8d58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:02.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.457+0000 7f8d6b400640 1 -- 172.21.15.47:0/444483112 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8d580051c0 msgr2=0x7f8d5800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:02.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.457+0000 7f8d6b400640 1 --2- 172.21.15.47:0/444483112 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8d580051c0 0x7f8d5800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.457+0000 7f8d6b400640 1 -- 172.21.15.47:0/444483112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d580039b0 msgr2=0x7f8d58003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:02.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.457+0000 7f8d6b400640 1 --2- 172.21.15.47:0/444483112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d580039b0 0x7f8d58003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.457+0000 7f8d6b400640 1 -- 172.21.15.47:0/444483112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d58003520 con 0x7f8d58004800 2024-05-27T10:52:02.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.457+0000 7f8d79200640 1 -- 172.21.15.47:0/444483112 reap_dead start 2024-05-27T10:52:02.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.458+0000 7f8d6b400640 1 --2- 172.21.15.47:0/444483112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d58004800 0x7f8d58004c80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009ac0 tx=0x7f8d58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f81e9adb62208ae server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:02.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.458+0000 7f8d73400640 1 -- 172.21.15.47:0/444483112 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c036070 con 0x7f8d58004800 2024-05-27T10:52:02.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.458+0000 7f8d73400640 1 -- 172.21.15.47:0/444483112 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d5c031400 con 0x7f8d58004800 2024-05-27T10:52:02.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.458+0000 7f8d73400640 1 -- 172.21.15.47:0/444483112 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c009690 con 0x7f8d58004800 2024-05-27T10:52:02.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.459+0000 7f8d79c00640 1 -- 172.21.15.47:0/444483112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d58004800 msgr2=0x7f8d58004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:02.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.459+0000 7f8d79c00640 1 --2- 172.21.15.47:0/444483112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d58004800 0x7f8d58004c80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009ac0 tx=0x7f8d58005830 comp rx=0 tx=0).stop 2024-05-27T10:52:02.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.459+0000 7f8d79c00640 1 -- 172.21.15.47:0/444483112 shutdown_connections 2024-05-27T10:52:02.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.459+0000 7f8d79c00640 1 --2- 172.21.15.47:0/444483112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d58004800 0x7f8d58004c80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.459+0000 7f8d79c00640 1 -- 172.21.15.47:0/444483112 >> 172.21.15.47:0/444483112 conn(0x7f8d7406bb20 msgr2=0x7f8d7406bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:02.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.459+0000 7f8d79c00640 1 -- 172.21.15.47:0/444483112 shutdown_connections 2024-05-27T10:52:02.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.459+0000 7f8d79c00640 1 -- 172.21.15.47:0/444483112 wait complete. 2024-05-27T10:52:02.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.460+0000 7f8d79c00640 1 Processor -- start 2024-05-27T10:52:02.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.461+0000 7f8d79c00640 1 -- start start 2024-05-27T10:52:02.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.461+0000 7f8d79c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d58004800 0x7f8d74157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:02.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.461+0000 7f8d79c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8d740b2fc0 0x7f8d740b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:02.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.462+0000 7f8d79c00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d741592c0 0x7f8d74159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.462+0000 7f8d79c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7406f000 con 0x7f8d58004800 2024-05-27T10:52:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.462+0000 7f8d79c00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7406ff20 con 0x7f8d741592c0 2024-05-27T10:52:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.462+0000 7f8d79c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8d7406f180 con 0x7f8d740b2fc0 2024-05-27T10:52:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.462+0000 7f8d73e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d58004800 0x7f8d74157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.462+0000 7f8d73e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d58004800 0x7f8d74157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34876/0 (socket says 172.21.15.47:34876) 2024-05-27T10:52:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.462+0000 7f8d73e00640 1 -- 172.21.15.47:0/3310991143 learned_addr learned my addr 172.21.15.47:0/3310991143 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.462+0000 7f8d6b400640 1 --2- 172.21.15.47:0/3310991143 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8d740b2fc0 0x7f8d740b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.462+0000 7f8d79200640 1 --2- 172.21.15.47:0/3310991143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d741592c0 0x7f8d74159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.462+0000 7f8d73e00640 1 -- 172.21.15.47:0/3310991143 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8d740b2fc0 msgr2=0x7f8d740b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.462+0000 7f8d73e00640 1 --2- 172.21.15.47:0/3310991143 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8d740b2fc0 0x7f8d740b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.462+0000 7f8d73e00640 1 -- 172.21.15.47:0/3310991143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d741592c0 msgr2=0x7f8d74159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.462+0000 7f8d73e00640 1 --2- 172.21.15.47:0/3310991143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d741592c0 0x7f8d74159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.462+0000 7f8d73e00640 1 -- 172.21.15.47:0/3310991143 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d74159fa0 con 0x7f8d58004800 2024-05-27T10:52:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.463+0000 7f8d73e00640 1 --2- 172.21.15.47:0/3310991143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d58004800 0x7f8d74157750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400c3f0 tx=0x7f8d6400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.463+0000 7f8d70c00640 1 -- 172.21.15.47:0/3310991143 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d640052d0 con 0x7f8d58004800 2024-05-27T10:52:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.463+0000 7f8d70c00640 1 -- 172.21.15.47:0/3310991143 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d64005490 con 0x7f8d58004800 2024-05-27T10:52:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.463+0000 7f8d70c00640 1 -- 172.21.15.47:0/3310991143 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d64007260 con 0x7f8d58004800 2024-05-27T10:52:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.463+0000 7f8d79c00640 1 -- 172.21.15.47:0/3310991143 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d7415a280 con 0x7f8d58004800 2024-05-27T10:52:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.463+0000 7f8d79c00640 1 -- 172.21.15.47:0/3310991143 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d7415a840 con 0x7f8d58004800 2024-05-27T10:52:02.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.464+0000 7f8d79c00640 1 -- 172.21.15.47:0/3310991143 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d7404fce0 con 0x7f8d58004800 2024-05-27T10:52:02.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.465+0000 7f8d70c00640 1 -- 172.21.15.47:0/3310991143 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d64007400 con 0x7f8d58004800 2024-05-27T10:52:02.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.466+0000 7f8d70c00640 1 --2- 172.21.15.47:0/3310991143 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f8d5006c830 0x7f8d5006ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:02.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.467+0000 7f8d70c00640 1 -- 172.21.15.47:0/3310991143 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f8d6408b060 con 0x7f8d58004800 2024-05-27T10:52:02.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.467+0000 7f8d6b400640 1 --2- 172.21.15.47:0/3310991143 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f8d5006c830 0x7f8d5006ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:02.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.467+0000 7f8d6b400640 1 --2- 172.21.15.47:0/3310991143 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f8d5006c830 0x7f8d5006ecf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c033000 tx=0x7f8d5c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:02.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.472+0000 7f8d70c00640 1 -- 172.21.15.47:0/3310991143 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8d64059480 con 0x7f8d58004800 2024-05-27T10:52:02.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.666+0000 7f8d79c00640 1 -- 172.21.15.47:0/3310991143 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d740af8c0 con 0x7f8d58004800 2024-05-27T10:52:02.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.669+0000 7f8d70c00640 1 -- 172.21.15.47:0/3310991143 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16534 (secure 0 0 0) 0x7f8d64058d80 con 0x7f8d58004800 2024-05-27T10:52:02.667 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:02.667 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:01.683119+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:52:02.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.672+0000 7f8d79c00640 1 -- 172.21.15.47:0/3310991143 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f8d5006c830 msgr2=0x7f8d5006ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:02.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.672+0000 7f8d79c00640 1 --2- 172.21.15.47:0/3310991143 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f8d5006c830 0x7f8d5006ecf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c033000 tx=0x7f8d5c008030 comp rx=0 tx=0).stop 2024-05-27T10:52:02.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.672+0000 7f8d79c00640 1 -- 172.21.15.47:0/3310991143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d58004800 msgr2=0x7f8d74157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:02.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.672+0000 7f8d79c00640 1 --2- 172.21.15.47:0/3310991143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d58004800 0x7f8d74157750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400c3f0 tx=0x7f8d6400c8b0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.672+0000 7f8d79c00640 1 -- 172.21.15.47:0/3310991143 shutdown_connections 2024-05-27T10:52:02.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.672+0000 7f8d79c00640 1 --2- 172.21.15.47:0/3310991143 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f8d5006c830 0x7f8d5006ecf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.672+0000 7f8d79c00640 1 --2- 172.21.15.47:0/3310991143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d741592c0 0x7f8d74159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.672+0000 7f8d79c00640 1 --2- 172.21.15.47:0/3310991143 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8d740b2fc0 0x7f8d740b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.672+0000 7f8d79c00640 1 --2- 172.21.15.47:0/3310991143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d58004800 0x7f8d74157750 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.672+0000 7f8d79c00640 1 -- 172.21.15.47:0/3310991143 >> 172.21.15.47:0/3310991143 conn(0x7f8d7406bb20 msgr2=0x7f8d740b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:02.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.672+0000 7f8d79c00640 1 -- 172.21.15.47:0/3310991143 shutdown_connections 2024-05-27T10:52:02.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.672+0000 7f8d79c00640 1 -- 172.21.15.47:0/3310991143 wait complete. 2024-05-27T10:52:02.688 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:52:02.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.897+0000 7f300a400640 1 Processor -- start 2024-05-27T10:52:02.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.897+0000 7f300a400640 1 -- start start 2024-05-27T10:52:02.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.898+0000 7f300a400640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f300415c420 0x7f3004071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:02.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.898+0000 7f300a400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f30040d0a70 0x7f30040b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:02.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.898+0000 7f300a400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f300415c800 con 0x7f30040b4ab0 2024-05-27T10:52:02.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.898+0000 7f300a400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f30040afc90 con 0x7f30040d0a70 2024-05-27T10:52:02.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.898+0000 7f300a400640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f30040ad2e0 con 0x7f300415c420 2024-05-27T10:52:02.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.899+0000 7f3009a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f30040d0a70 0x7f30040b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:02.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.899+0000 7f3009a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f30040d0a70 0x7f30040b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34880/0 (socket says 172.21.15.47:34880) 2024-05-27T10:52:02.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.899+0000 7f3003e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f30040b4ab0 0x7f30040d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43824/0 (socket says 172.21.15.47:43824) 2024-05-27T10:52:02.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.899+0000 7f3009a00640 1 -- 172.21.15.47:0/2396634715 learned_addr learned my addr 172.21.15.47:0/2396634715 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:02.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.899+0000 7f3009000640 1 --2- 172.21.15.47:0/2396634715 >> v2:172.21.15.53:3300/0 conn(0x7f300415c420 0x7f3004071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:02.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.899+0000 7f3009a00640 1 -- 172.21.15.47:0/2396634715 >> v2:172.21.15.53:3300/0 conn(0x7f300415c420 msgr2=0x7f3004071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:02.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.899+0000 7f3009a00640 1 --2- 172.21.15.47:0/2396634715 >> v2:172.21.15.53:3300/0 conn(0x7f300415c420 0x7f3004071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.899+0000 7f3009a00640 1 -- 172.21.15.47:0/2396634715 >> v1:172.21.15.47:6789/0 conn(0x7f30040b4ab0 legacy=0x7f30040d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:02.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.899+0000 7f3009a00640 1 -- 172.21.15.47:0/2396634715 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30040ad5c0 con 0x7f30040d0a70 2024-05-27T10:52:02.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.900+0000 7f3009a00640 1 --2- 172.21.15.47:0/2396634715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30040d0a70 0x7f30040b3790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f30040b4600 tx=0x7f2ffc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f483d0842587bb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:02.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.900+0000 7f3003400640 1 -- 172.21.15.47:0/2396634715 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc036070 con 0x7f30040d0a70 2024-05-27T10:52:02.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.901+0000 7f3003400640 1 -- 172.21.15.47:0/2396634715 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ffc031600 con 0x7f30040d0a70 2024-05-27T10:52:02.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.901+0000 7f3003400640 1 -- 172.21.15.47:0/2396634715 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc0319d0 con 0x7f30040d0a70 2024-05-27T10:52:02.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.901+0000 7f300a400640 1 -- 172.21.15.47:0/2396634715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30040d0a70 msgr2=0x7f30040b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:02.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.901+0000 7f300a400640 1 --2- 172.21.15.47:0/2396634715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30040d0a70 0x7f30040b3790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f30040b4600 tx=0x7f2ffc02a6a0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.901+0000 7f300a400640 1 -- 172.21.15.47:0/2396634715 shutdown_connections 2024-05-27T10:52:02.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.901+0000 7f300a400640 1 --2- 172.21.15.47:0/2396634715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30040d0a70 0x7f30040b3790 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.901+0000 7f300a400640 1 --2- 172.21.15.47:0/2396634715 >> v2:172.21.15.53:3300/0 conn(0x7f300415c420 0x7f3004071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.901+0000 7f300a400640 1 -- 172.21.15.47:0/2396634715 >> 172.21.15.47:0/2396634715 conn(0x7f300406bb20 msgr2=0x7f300406bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:02.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.901+0000 7f300a400640 1 -- 172.21.15.47:0/2396634715 shutdown_connections 2024-05-27T10:52:02.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.901+0000 7f300a400640 1 -- 172.21.15.47:0/2396634715 wait complete. 2024-05-27T10:52:02.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.903+0000 7f300a400640 1 Processor -- start 2024-05-27T10:52:02.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.903+0000 7f300a400640 1 -- start start 2024-05-27T10:52:02.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.904+0000 7f300a400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30040b4ab0 0x7f300414e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:02.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.904+0000 7f300a400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30040d0a70 0x7f300415e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:02.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.904+0000 7f300a400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f300415c420 0x7f300415eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:02.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.904+0000 7f300a400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f30040af8f0 con 0x7f300415c420 2024-05-27T10:52:02.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.904+0000 7f300a400640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f30040ad8a0 con 0x7f30040d0a70 2024-05-27T10:52:02.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.904+0000 7f300a400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f30040afa70 con 0x7f30040b4ab0 2024-05-27T10:52:02.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.904+0000 7f3009a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f300415c420 0x7f300415eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:02.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.904+0000 7f3009a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f300415c420 0x7f300415eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34896/0 (socket says 172.21.15.47:34896) 2024-05-27T10:52:02.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.904+0000 7f3009a00640 1 -- 172.21.15.47:0/1025948936 learned_addr learned my addr 172.21.15.47:0/1025948936 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:02.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.905+0000 7f3003e00640 1 --2- 172.21.15.47:0/1025948936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30040d0a70 0x7f300415e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:02.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.905+0000 7f3009000640 1 --2- 172.21.15.47:0/1025948936 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30040b4ab0 0x7f300414e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:02.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.905+0000 7f3009a00640 1 -- 172.21.15.47:0/1025948936 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30040b4ab0 msgr2=0x7f300414e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:02.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.905+0000 7f3009a00640 1 --2- 172.21.15.47:0/1025948936 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30040b4ab0 0x7f300414e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.905+0000 7f3009a00640 1 -- 172.21.15.47:0/1025948936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30040d0a70 msgr2=0x7f300415e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:02.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.905+0000 7f3009a00640 1 --2- 172.21.15.47:0/1025948936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30040d0a70 0x7f300415e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:02.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.905+0000 7f3009a00640 1 -- 172.21.15.47:0/1025948936 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f300415f730 con 0x7f300415c420 2024-05-27T10:52:02.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.905+0000 7f3009a00640 1 --2- 172.21.15.47:0/1025948936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f300415c420 0x7f300415eea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc02ac90 tx=0x7f2ffc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:02.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.905+0000 7f3000c00640 1 -- 172.21.15.47:0/1025948936 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc03f020 con 0x7f300415c420 2024-05-27T10:52:02.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.905+0000 7f3000c00640 1 -- 172.21.15.47:0/1025948936 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ffc037040 con 0x7f300415c420 2024-05-27T10:52:02.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.905+0000 7f300a400640 1 -- 172.21.15.47:0/1025948936 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30040affb0 con 0x7f300415c420 2024-05-27T10:52:02.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.905+0000 7f3000c00640 1 -- 172.21.15.47:0/1025948936 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc036070 con 0x7f300415c420 2024-05-27T10:52:02.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.906+0000 7f300a400640 1 -- 172.21.15.47:0/1025948936 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f300415f3e0 con 0x7f300415c420 2024-05-27T10:52:02.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.907+0000 7f300a400640 1 -- 172.21.15.47:0/1025948936 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f300404fce0 con 0x7f300415c420 2024-05-27T10:52:02.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.908+0000 7f3000c00640 1 -- 172.21.15.47:0/1025948936 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ffc042020 con 0x7f300415c420 2024-05-27T10:52:02.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.909+0000 7f3000c00640 1 --2- 172.21.15.47:0/1025948936 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2fe406c8f0 0x7f2fe406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:02.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.909+0000 7f3000c00640 1 -- 172.21.15.47:0/1025948936 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f2ffc0ac420 con 0x7f300415c420 2024-05-27T10:52:02.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.909+0000 7f3009000640 1 --2- 172.21.15.47:0/1025948936 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2fe406c8f0 0x7f2fe406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:02.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.910+0000 7f3009000640 1 --2- 172.21.15.47:0/1025948936 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2fe406c8f0 0x7f2fe406edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8006fd0 tx=0x7f2ff8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:02.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:02.914+0000 7f3000c00640 1 -- 172.21.15.47:0/1025948936 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2ffc049020 con 0x7f300415c420 2024-05-27T10:52:03.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.116+0000 7f300a400640 1 -- 172.21.15.47:0/1025948936 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f300414ed90 con 0x7f300415c420 2024-05-27T10:52:03.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.118+0000 7f3000c00640 1 -- 172.21.15.47:0/1025948936 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16534 (secure 0 0 0) 0x7f2ffc07a7b0 con 0x7f300415c420 2024-05-27T10:52:03.115 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:03.115 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:01.683119+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:52:03.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.120+0000 7f300a400640 1 -- 172.21.15.47:0/1025948936 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2fe406c8f0 msgr2=0x7f2fe406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:03.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.120+0000 7f300a400640 1 --2- 172.21.15.47:0/1025948936 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2fe406c8f0 0x7f2fe406edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8006fd0 tx=0x7f2ff8008040 comp rx=0 tx=0).stop 2024-05-27T10:52:03.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.120+0000 7f300a400640 1 -- 172.21.15.47:0/1025948936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f300415c420 msgr2=0x7f300415eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:03.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.120+0000 7f300a400640 1 --2- 172.21.15.47:0/1025948936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f300415c420 0x7f300415eea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc02ac90 tx=0x7f2ffc004a40 comp rx=0 tx=0).stop 2024-05-27T10:52:03.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.121+0000 7f300a400640 1 -- 172.21.15.47:0/1025948936 shutdown_connections 2024-05-27T10:52:03.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.121+0000 7f300a400640 1 --2- 172.21.15.47:0/1025948936 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2fe406c8f0 0x7f2fe406edb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:03.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.121+0000 7f300a400640 1 --2- 172.21.15.47:0/1025948936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f300415c420 0x7f300415eea0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:03.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.121+0000 7f300a400640 1 --2- 172.21.15.47:0/1025948936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30040d0a70 0x7f300415e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:03.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.121+0000 7f300a400640 1 --2- 172.21.15.47:0/1025948936 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30040b4ab0 0x7f300414e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:03.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.121+0000 7f300a400640 1 -- 172.21.15.47:0/1025948936 >> 172.21.15.47:0/1025948936 conn(0x7f300406bb20 msgr2=0x7f3004159ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:03.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.121+0000 7f300a400640 1 -- 172.21.15.47:0/1025948936 shutdown_connections 2024-05-27T10:52:03.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.121+0000 7f300a400640 1 -- 172.21.15.47:0/1025948936 wait complete. 2024-05-27T10:52:03.137 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-27T10:52:03.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.358+0000 7f3b37200640 1 Processor -- start 2024-05-27T10:52:03.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.358+0000 7f3b37200640 1 -- start start 2024-05-27T10:52:03.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.360+0000 7f3b37200640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3b3815e630 0x7f3b380d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:03.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.360+0000 7f3b37200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3b380b6670 0x7f3b380d3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:03.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.360+0000 7f3b37200640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b380ced40 con 0x7f3b380cfde0 2024-05-27T10:52:03.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.360+0000 7f3b37200640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f3b380cf950 con 0x7f3b3815e630 2024-05-27T10:52:03.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.360+0000 7f3b37200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3b380cf020 con 0x7f3b380b6670 2024-05-27T10:52:03.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.361+0000 7f3b35e00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3b3815e630 0x7f3b380d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:03.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.361+0000 7f3b35400640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3b380cfde0 0x7f3b380b5f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.47:38728/0 (socket says 172.21.15.47:38728) 2024-05-27T10:52:03.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.361+0000 7f3b35400640 1 -- 172.21.15.47:0/3405088857 learned_addr learned my addr 172.21.15.47:0/3405088857 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:03.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.361+0000 7f3b36800640 1 --2- 172.21.15.47:0/3405088857 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3b380b6670 0x7f3b380d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:03.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.362+0000 7f3b36800640 1 -- 172.21.15.47:0/3405088857 >> v2:172.21.15.53:3300/0 conn(0x7f3b3815e630 msgr2=0x7f3b380d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:03.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.362+0000 7f3b36800640 1 --2- 172.21.15.47:0/3405088857 >> v2:172.21.15.53:3300/0 conn(0x7f3b3815e630 0x7f3b380d3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:03.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.362+0000 7f3b36800640 1 -- 172.21.15.47:0/3405088857 >> v1:172.21.15.53:6789/0 conn(0x7f3b380cfde0 legacy=0x7f3b380b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:03.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.362+0000 7f3b36800640 1 -- 172.21.15.47:0/3405088857 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b380cf300 con 0x7f3b380b6670 2024-05-27T10:52:03.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.362+0000 7f3b35e00640 1 --2- 172.21.15.47:0/3405088857 >> v2:172.21.15.53:3300/0 conn(0x7f3b3815e630 0x7f3b380d3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T10:52:03.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.363+0000 7f3b36800640 1 --2- 172.21.15.47:0/3405088857 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3b380b6670 0x7f3b380d3770 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009d90 tx=0x7f3b3002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9df6a492df85fe1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:03.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.364+0000 7f3b34a00640 1 -- 172.21.15.47:0/3405088857 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30007740 con 0x7f3b380b6670 2024-05-27T10:52:03.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.364+0000 7f3b34a00640 1 -- 172.21.15.47:0/3405088857 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b300078e0 con 0x7f3b380b6670 2024-05-27T10:52:03.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.364+0000 7f3b34a00640 1 -- 172.21.15.47:0/3405088857 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30007cb0 con 0x7f3b380b6670 2024-05-27T10:52:03.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.365+0000 7f3b37200640 1 -- 172.21.15.47:0/3405088857 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3b380b6670 msgr2=0x7f3b380d3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:03.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.365+0000 7f3b37200640 1 --2- 172.21.15.47:0/3405088857 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3b380b6670 0x7f3b380d3770 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009d90 tx=0x7f3b3002a660 comp rx=0 tx=0).stop 2024-05-27T10:52:03.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.365+0000 7f3b37200640 1 -- 172.21.15.47:0/3405088857 shutdown_connections 2024-05-27T10:52:03.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.365+0000 7f3b37200640 1 --2- 172.21.15.47:0/3405088857 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3b380b6670 0x7f3b380d3770 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:03.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.365+0000 7f3b37200640 1 --2- 172.21.15.47:0/3405088857 >> v2:172.21.15.53:3300/0 conn(0x7f3b3815e630 0x7f3b380d3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:03.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.365+0000 7f3b37200640 1 -- 172.21.15.47:0/3405088857 >> 172.21.15.47:0/3405088857 conn(0x7f3b3808bfd0 msgr2=0x7f3b380d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:03.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.365+0000 7f3b37200640 1 -- 172.21.15.47:0/3405088857 shutdown_connections 2024-05-27T10:52:03.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.365+0000 7f3b37200640 1 -- 172.21.15.47:0/3405088857 wait complete. 2024-05-27T10:52:03.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.366+0000 7f3b37200640 1 Processor -- start 2024-05-27T10:52:03.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.367+0000 7f3b37200640 1 -- start start 2024-05-27T10:52:03.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.367+0000 7f3b37200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3b380b6670 0x7f3b380b9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:03.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.368+0000 7f3b37200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b380cfde0 0x7f3b3815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:03.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.368+0000 7f3b37200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b3815e630 0x7f3b380b98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:03.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.368+0000 7f3b37200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3815eb90 con 0x7f3b380cfde0 2024-05-27T10:52:03.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.368+0000 7f3b37200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3815ea10 con 0x7f3b3815e630 2024-05-27T10:52:03.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.368+0000 7f3b37200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3b381685f0 con 0x7f3b380b6670 2024-05-27T10:52:03.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.368+0000 7f3b35400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b380cfde0 0x7f3b3815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:03.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.368+0000 7f3b35400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b380cfde0 0x7f3b3815cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34904/0 (socket says 172.21.15.47:34904) 2024-05-27T10:52:03.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.368+0000 7f3b35400640 1 -- 172.21.15.47:0/2926097851 learned_addr learned my addr 172.21.15.47:0/2926097851 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:03.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.368+0000 7f3b35e00640 1 --2- 172.21.15.47:0/2926097851 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3b380b6670 0x7f3b380b9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:03.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.368+0000 7f3b36800640 1 --2- 172.21.15.47:0/2926097851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b3815e630 0x7f3b380b98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:03.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.368+0000 7f3b35400640 1 -- 172.21.15.47:0/2926097851 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3b380b6670 msgr2=0x7f3b380b9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:03.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.368+0000 7f3b35400640 1 --2- 172.21.15.47:0/2926097851 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3b380b6670 0x7f3b380b9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:03.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.368+0000 7f3b35400640 1 -- 172.21.15.47:0/2926097851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b3815e630 msgr2=0x7f3b380b98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:03.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.368+0000 7f3b35400640 1 --2- 172.21.15.47:0/2926097851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b3815e630 0x7f3b380b98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:03.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.368+0000 7f3b35400640 1 -- 172.21.15.47:0/2926097851 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b380b96b0 con 0x7f3b380cfde0 2024-05-27T10:52:03.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.369+0000 7f3b35400640 1 --2- 172.21.15.47:0/2926097851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b380cfde0 0x7f3b3815cef0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000c400 tx=0x7f3b2000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:03.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.369+0000 7f3b2e000640 1 -- 172.21.15.47:0/2926097851 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b20017070 con 0x7f3b380cfde0 2024-05-27T10:52:03.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.369+0000 7f3b2e000640 1 -- 172.21.15.47:0/2926097851 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b20005ce0 con 0x7f3b380cfde0 2024-05-27T10:52:03.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.369+0000 7f3b2e000640 1 -- 172.21.15.47:0/2926097851 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b200072f0 con 0x7f3b380cfde0 2024-05-27T10:52:03.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.369+0000 7f3b37200640 1 -- 172.21.15.47:0/2926097851 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b381619b0 con 0x7f3b380cfde0 2024-05-27T10:52:03.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.369+0000 7f3b37200640 1 -- 172.21.15.47:0/2926097851 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b3814d960 con 0x7f3b380cfde0 2024-05-27T10:52:03.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.370+0000 7f3b37200640 1 -- 172.21.15.47:0/2926097851 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b380ce950 con 0x7f3b380cfde0 2024-05-27T10:52:03.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.371+0000 7f3b2e000640 1 -- 172.21.15.47:0/2926097851 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3b2001a070 con 0x7f3b380cfde0 2024-05-27T10:52:03.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.372+0000 7f3b2e000640 1 --2- 172.21.15.47:0/2926097851 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3b1406c920 0x7f3b1406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:03.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.372+0000 7f3b2e000640 1 -- 172.21.15.47:0/2926097851 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3b2008b0a0 con 0x7f3b380cfde0 2024-05-27T10:52:03.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.372+0000 7f3b35e00640 1 --2- 172.21.15.47:0/2926097851 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3b1406c920 0x7f3b1406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:03.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.373+0000 7f3b35e00640 1 --2- 172.21.15.47:0/2926097851 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3b1406c920 0x7f3b1406ede0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009a30 tx=0x7f3b28008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:03.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.376+0000 7f3b2e000640 1 -- 172.21.15.47:0/2926097851 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3b380ce950 con 0x7f3b380cfde0 2024-05-27T10:52:03.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:03.608+0000 7f3b37200640 1 -- 172.21.15.47:0/2926097851 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3b3804fce0 con 0x7f3b380cfde0 2024-05-27T10:52:04.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.272+0000 7f3b2e000640 1 -- 172.21.15.47:0/2926097851 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f3b380b96b0 con 0x7f3b380cfde0 2024-05-27T10:52:04.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.275+0000 7f3b37200640 1 -- 172.21.15.47:0/2926097851 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3b1406c920 msgr2=0x7f3b1406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:04.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.275+0000 7f3b37200640 1 --2- 172.21.15.47:0/2926097851 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3b1406c920 0x7f3b1406ede0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009a30 tx=0x7f3b28008040 comp rx=0 tx=0).stop 2024-05-27T10:52:04.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.275+0000 7f3b37200640 1 -- 172.21.15.47:0/2926097851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b380cfde0 msgr2=0x7f3b3815cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:04.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.275+0000 7f3b37200640 1 --2- 172.21.15.47:0/2926097851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b380cfde0 0x7f3b3815cef0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000c400 tx=0x7f3b2000c8c0 comp rx=0 tx=0).stop 2024-05-27T10:52:04.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.275+0000 7f3b37200640 1 -- 172.21.15.47:0/2926097851 shutdown_connections 2024-05-27T10:52:04.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.275+0000 7f3b37200640 1 --2- 172.21.15.47:0/2926097851 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3b1406c920 0x7f3b1406ede0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:04.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.275+0000 7f3b37200640 1 --2- 172.21.15.47:0/2926097851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b3815e630 0x7f3b380b98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:04.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.275+0000 7f3b37200640 1 --2- 172.21.15.47:0/2926097851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b380cfde0 0x7f3b3815cef0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:04.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.275+0000 7f3b37200640 1 --2- 172.21.15.47:0/2926097851 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3b380b6670 0x7f3b380b9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:04.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.275+0000 7f3b37200640 1 -- 172.21.15.47:0/2926097851 >> 172.21.15.47:0/2926097851 conn(0x7f3b3808bfd0 msgr2=0x7f3b380b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:04.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.276+0000 7f3b37200640 1 -- 172.21.15.47:0/2926097851 shutdown_connections 2024-05-27T10:52:04.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.276+0000 7f3b37200640 1 -- 172.21.15.47:0/2926097851 wait complete. 2024-05-27T10:52:04.297 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-27T10:52:04.297 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-27T10:52:04.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.513+0000 7fc88be00640 1 Processor -- start 2024-05-27T10:52:04.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.513+0000 7fc88be00640 1 -- start start 2024-05-27T10:52:04.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.515+0000 7fc88be00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc88c06da80 0x7fc88c0d0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:04.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.515+0000 7fc88be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc88c0d0860 0x7fc88c0ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:04.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.515+0000 7fc88be00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88c0b4620 con 0x7fc88c15c510 2024-05-27T10:52:04.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.515+0000 7fc88be00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc88c0d0cd0 con 0x7fc88c0d0860 2024-05-27T10:52:04.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.515+0000 7fc88be00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc88c0b43e0 con 0x7fc88c06da80 2024-05-27T10:52:04.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.515+0000 7fc88b400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc88c0d0860 0x7fc88c0ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:04.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.515+0000 7fc88b400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc88c0d0860 0x7fc88c0ce9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34916/0 (socket says 172.21.15.47:34916) 2024-05-27T10:52:04.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.515+0000 7fc88b400640 1 -- 172.21.15.47:0/416566073 learned_addr learned my addr 172.21.15.47:0/416566073 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:04.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.515+0000 7fc88a000640 1 --2- 172.21.15.47:0/416566073 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc88c06da80 0x7fc88c0d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:04.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.516+0000 7fc88b400640 1 -- 172.21.15.47:0/416566073 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc88c06da80 msgr2=0x7fc88c0d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:04.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.516+0000 7fc88b400640 1 --2- 172.21.15.47:0/416566073 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc88c06da80 0x7fc88c0d0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:04.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.516+0000 7fc88b400640 1 -- 172.21.15.47:0/416566073 >> v1:172.21.15.53:6789/0 conn(0x7fc88c15c510 legacy=0x7fc88c0b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:04.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.516+0000 7fc88b400640 1 -- 172.21.15.47:0/416566073 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c0b4900 con 0x7fc88c0d0860 2024-05-27T10:52:04.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.517+0000 7fc88b400640 1 --2- 172.21.15.47:0/416566073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc88c0d0860 0x7fc88c0ce9f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc884009e50 tx=0x7fc88402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01778d989a390e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:04.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.517+0000 7fc889600640 1 -- 172.21.15.47:0/416566073 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc884036070 con 0x7fc88c0d0860 2024-05-27T10:52:04.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.517+0000 7fc889600640 1 -- 172.21.15.47:0/416566073 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc884031600 con 0x7fc88c0d0860 2024-05-27T10:52:04.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.517+0000 7fc889600640 1 -- 172.21.15.47:0/416566073 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8840319d0 con 0x7fc88c0d0860 2024-05-27T10:52:04.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.518+0000 7fc88be00640 1 -- 172.21.15.47:0/416566073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc88c0d0860 msgr2=0x7fc88c0ce9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:04.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.518+0000 7fc88be00640 1 --2- 172.21.15.47:0/416566073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc88c0d0860 0x7fc88c0ce9f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc884009e50 tx=0x7fc88402a730 comp rx=0 tx=0).stop 2024-05-27T10:52:04.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.518+0000 7fc88be00640 1 -- 172.21.15.47:0/416566073 shutdown_connections 2024-05-27T10:52:04.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.518+0000 7fc88be00640 1 --2- 172.21.15.47:0/416566073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc88c0d0860 0x7fc88c0ce9f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:04.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.518+0000 7fc88be00640 1 --2- 172.21.15.47:0/416566073 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc88c06da80 0x7fc88c0d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:04.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.518+0000 7fc88be00640 1 -- 172.21.15.47:0/416566073 >> 172.21.15.47:0/416566073 conn(0x7fc88c06bb20 msgr2=0x7fc88c06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:04.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.518+0000 7fc88be00640 1 -- 172.21.15.47:0/416566073 shutdown_connections 2024-05-27T10:52:04.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.518+0000 7fc88be00640 1 -- 172.21.15.47:0/416566073 wait complete. 2024-05-27T10:52:04.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.520+0000 7fc88be00640 1 Processor -- start 2024-05-27T10:52:04.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.520+0000 7fc88be00640 1 -- start start 2024-05-27T10:52:04.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.521+0000 7fc88be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc88c06da80 0x7fc88c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:04.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.521+0000 7fc88be00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc88c0d0860 0x7fc88c14a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:04.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.521+0000 7fc88be00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc88c15c510 0x7fc88c15f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:04.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.521+0000 7fc88be00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c15c8f0 con 0x7fc88c06da80 2024-05-27T10:52:04.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.521+0000 7fc88be00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c0b4ec0 con 0x7fc88c0d0860 2024-05-27T10:52:04.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.521+0000 7fc88be00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc88c0cef30 con 0x7fc88c15c510 2024-05-27T10:52:04.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.521+0000 7fc88aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc88c06da80 0x7fc88c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:04.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.521+0000 7fc88aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc88c06da80 0x7fc88c15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34924/0 (socket says 172.21.15.47:34924) 2024-05-27T10:52:04.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.521+0000 7fc88aa00640 1 -- 172.21.15.47:0/2156582188 learned_addr learned my addr 172.21.15.47:0/2156582188 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:04.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.522+0000 7fc88a000640 1 --2- 172.21.15.47:0/2156582188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc88c0d0860 0x7fc88c14a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:04.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.522+0000 7fc88b400640 1 --2- 172.21.15.47:0/2156582188 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc88c15c510 0x7fc88c15f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:04.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.522+0000 7fc88aa00640 1 -- 172.21.15.47:0/2156582188 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc88c15c510 msgr2=0x7fc88c15f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:04.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.522+0000 7fc88aa00640 1 --2- 172.21.15.47:0/2156582188 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc88c15c510 0x7fc88c15f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:04.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.522+0000 7fc88aa00640 1 -- 172.21.15.47:0/2156582188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc88c0d0860 msgr2=0x7fc88c14a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:04.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.522+0000 7fc88aa00640 1 --2- 172.21.15.47:0/2156582188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc88c0d0860 0x7fc88c14a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:04.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.522+0000 7fc88aa00640 1 -- 172.21.15.47:0/2156582188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c09b410 con 0x7fc88c06da80 2024-05-27T10:52:04.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.522+0000 7fc88aa00640 1 --2- 172.21.15.47:0/2156582188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc88c06da80 0x7fc88c15d950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc87c00c430 tx=0x7fc87c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:04.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.522+0000 7fc882a00640 1 -- 172.21.15.47:0/2156582188 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c017070 con 0x7fc88c06da80 2024-05-27T10:52:04.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.522+0000 7fc882a00640 1 -- 172.21.15.47:0/2156582188 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc87c0052d0 con 0x7fc88c06da80 2024-05-27T10:52:04.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.522+0000 7fc882a00640 1 -- 172.21.15.47:0/2156582188 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c003830 con 0x7fc88c06da80 2024-05-27T10:52:04.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.523+0000 7fc88be00640 1 -- 172.21.15.47:0/2156582188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc88c15dfe0 con 0x7fc88c06da80 2024-05-27T10:52:04.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.523+0000 7fc88be00640 1 -- 172.21.15.47:0/2156582188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc88c09b6b0 con 0x7fc88c06da80 2024-05-27T10:52:04.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.524+0000 7fc88be00640 1 -- 172.21.15.47:0/2156582188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc88c04fce0 con 0x7fc88c06da80 2024-05-27T10:52:04.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.525+0000 7fc882a00640 1 -- 172.21.15.47:0/2156582188 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc87c01a070 con 0x7fc88c06da80 2024-05-27T10:52:04.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.526+0000 7fc882a00640 1 --2- 172.21.15.47:0/2156582188 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc86c06c940 0x7fc86c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:04.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.527+0000 7fc882a00640 1 -- 172.21.15.47:0/2156582188 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc87c08aef0 con 0x7fc88c06da80 2024-05-27T10:52:04.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.527+0000 7fc88a000640 1 --2- 172.21.15.47:0/2156582188 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc86c06c940 0x7fc86c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:04.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.527+0000 7fc88a000640 1 --2- 172.21.15.47:0/2156582188 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc86c06c940 0x7fc86c06ee00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc88c0b1190 tx=0x7fc878008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:04.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.532+0000 7fc882a00640 1 -- 172.21.15.47:0/2156582188 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc87c059370 con 0x7fc88c06da80 2024-05-27T10:52:04.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:04.790+0000 7fc88be00640 1 -- 172.21.15.47:0/2156582188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc88c15cd20 con 0x7fc88c06da80 2024-05-27T10:52:05.058 INFO:tasks.ceph.mds.b.smithi053.stderr:2024-05-27T10:52:05.060+0000 7fa7b4200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-27T10:52:05.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.294+0000 7fc882a00640 1 -- 172.21.15.47:0/2156582188 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fc87c058c70 con 0x7fc88c06da80 2024-05-27T10:52:05.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.299+0000 7fc88be00640 1 -- 172.21.15.47:0/2156582188 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc86c06c940 msgr2=0x7fc86c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:05.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.299+0000 7fc88be00640 1 --2- 172.21.15.47:0/2156582188 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc86c06c940 0x7fc86c06ee00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc88c0b1190 tx=0x7fc878008040 comp rx=0 tx=0).stop 2024-05-27T10:52:05.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.299+0000 7fc88be00640 1 -- 172.21.15.47:0/2156582188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc88c06da80 msgr2=0x7fc88c15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:05.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.299+0000 7fc88be00640 1 --2- 172.21.15.47:0/2156582188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc88c06da80 0x7fc88c15d950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc87c00c430 tx=0x7fc87c00c8f0 comp rx=0 tx=0).stop 2024-05-27T10:52:05.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.299+0000 7fc88be00640 1 -- 172.21.15.47:0/2156582188 shutdown_connections 2024-05-27T10:52:05.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.299+0000 7fc88be00640 1 --2- 172.21.15.47:0/2156582188 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc86c06c940 0x7fc86c06ee00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:05.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.299+0000 7fc88be00640 1 --2- 172.21.15.47:0/2156582188 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc88c15c510 0x7fc88c15f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:05.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.299+0000 7fc88be00640 1 --2- 172.21.15.47:0/2156582188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc88c0d0860 0x7fc88c14a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:05.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.299+0000 7fc88be00640 1 --2- 172.21.15.47:0/2156582188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc88c06da80 0x7fc88c15d950 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:05.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.299+0000 7fc88be00640 1 -- 172.21.15.47:0/2156582188 >> 172.21.15.47:0/2156582188 conn(0x7fc88c06bb20 msgr2=0x7fc88c06ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:05.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.299+0000 7fc88be00640 1 -- 172.21.15.47:0/2156582188 shutdown_connections 2024-05-27T10:52:05.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.299+0000 7fc88be00640 1 -- 172.21.15.47:0/2156582188 wait complete. 2024-05-27T10:52:05.323 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-27T10:52:05.323 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T10:52:05.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.540+0000 7fb85ac00640 1 Processor -- start 2024-05-27T10:52:05.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.540+0000 7fb85ac00640 1 -- start start 2024-05-27T10:52:05.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.542+0000 7fb85ac00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb8540d0a70 0x7fb8540b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:05.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.542+0000 7fb85ac00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb85415c800 con 0x7fb8540b4ab0 2024-05-27T10:52:05.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.542+0000 7fb85ac00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8540726d0 con 0x7fb85415c420 2024-05-27T10:52:05.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.542+0000 7fb85ac00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb8540afc90 con 0x7fb8540d0a70 2024-05-27T10:52:05.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.542+0000 7fb85a200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb8540d0a70 0x7fb8540b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:05.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.542+0000 7fb85a200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb8540d0a70 0x7fb8540b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34936/0 (socket says 172.21.15.47:34936) 2024-05-27T10:52:05.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.542+0000 7fb85a200640 1 -- 172.21.15.47:0/3917101689 learned_addr learned my addr 172.21.15.47:0/3917101689 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:05.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.543+0000 7fb85a200640 1 -- 172.21.15.47:0/3917101689 >> v1:172.21.15.53:6789/0 conn(0x7fb85415c420 legacy=0x7fb854071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:05.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.543+0000 7fb85a200640 1 -- 172.21.15.47:0/3917101689 >> v1:172.21.15.47:6789/0 conn(0x7fb8540b4ab0 legacy=0x7fb8540d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:05.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.543+0000 7fb85a200640 1 -- 172.21.15.47:0/3917101689 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8540ad2e0 con 0x7fb8540d0a70 2024-05-27T10:52:05.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.544+0000 7fb85a200640 1 --2- 172.21.15.47:0/3917101689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8540d0a70 0x7fb8540b3790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb84c009e50 tx=0x7fb84c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bceb1468e7bb04 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:05.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.545+0000 7fb853e00640 1 -- 172.21.15.47:0/3917101689 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c036070 con 0x7fb8540d0a70 2024-05-27T10:52:05.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.545+0000 7fb853e00640 1 -- 172.21.15.47:0/3917101689 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb84c031600 con 0x7fb8540d0a70 2024-05-27T10:52:05.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.545+0000 7fb853e00640 1 -- 172.21.15.47:0/3917101689 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c0319d0 con 0x7fb8540d0a70 2024-05-27T10:52:05.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.545+0000 7fb85ac00640 1 -- 172.21.15.47:0/3917101689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8540d0a70 msgr2=0x7fb8540b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:05.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.545+0000 7fb85ac00640 1 --2- 172.21.15.47:0/3917101689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8540d0a70 0x7fb8540b3790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb84c009e50 tx=0x7fb84c02a730 comp rx=0 tx=0).stop 2024-05-27T10:52:05.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.545+0000 7fb85ac00640 1 -- 172.21.15.47:0/3917101689 shutdown_connections 2024-05-27T10:52:05.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.545+0000 7fb85ac00640 1 --2- 172.21.15.47:0/3917101689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8540d0a70 0x7fb8540b3790 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:05.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.545+0000 7fb85ac00640 1 -- 172.21.15.47:0/3917101689 >> 172.21.15.47:0/3917101689 conn(0x7fb85406bb20 msgr2=0x7fb85406bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:05.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.546+0000 7fb85ac00640 1 -- 172.21.15.47:0/3917101689 shutdown_connections 2024-05-27T10:52:05.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.546+0000 7fb85ac00640 1 -- 172.21.15.47:0/3917101689 wait complete. 2024-05-27T10:52:05.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.547+0000 7fb85ac00640 1 Processor -- start 2024-05-27T10:52:05.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.547+0000 7fb85ac00640 1 -- start start 2024-05-27T10:52:05.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.548+0000 7fb85ac00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb8540b4ab0 0x7fb85415de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:05.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.548+0000 7fb85ac00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8540d0a70 0x7fb85415f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:05.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.548+0000 7fb85ac00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb85415c420 0x7fb8541463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:05.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.548+0000 7fb85ac00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb8540ad8a0 con 0x7fb85415c420 2024-05-27T10:52:05.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.548+0000 7fb85ac00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb8540b3270 con 0x7fb8540d0a70 2024-05-27T10:52:05.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.548+0000 7fb85ac00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb8540af8f0 con 0x7fb8540b4ab0 2024-05-27T10:52:05.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.549+0000 7fb85a200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb85415c420 0x7fb8541463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:05.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.549+0000 7fb85a200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb85415c420 0x7fb8541463c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34942/0 (socket says 172.21.15.47:34942) 2024-05-27T10:52:05.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.549+0000 7fb85a200640 1 -- 172.21.15.47:0/2740926158 learned_addr learned my addr 172.21.15.47:0/2740926158 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:05.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.549+0000 7fb858e00640 1 --2- 172.21.15.47:0/2740926158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8540d0a70 0x7fb85415f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:05.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.549+0000 7fb859800640 1 --2- 172.21.15.47:0/2740926158 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb8540b4ab0 0x7fb85415de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:05.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.549+0000 7fb85a200640 1 -- 172.21.15.47:0/2740926158 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb8540b4ab0 msgr2=0x7fb85415de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:05.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.549+0000 7fb85a200640 1 --2- 172.21.15.47:0/2740926158 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb8540b4ab0 0x7fb85415de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:05.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.549+0000 7fb85a200640 1 -- 172.21.15.47:0/2740926158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8540d0a70 msgr2=0x7fb85415f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:05.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.549+0000 7fb85a200640 1 --2- 172.21.15.47:0/2740926158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8540d0a70 0x7fb85415f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:05.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.549+0000 7fb85a200640 1 -- 172.21.15.47:0/2740926158 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85415cdd0 con 0x7fb85415c420 2024-05-27T10:52:05.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.549+0000 7fb858e00640 1 --2- 172.21.15.47:0/2740926158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8540d0a70 0x7fb85415f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:52:05.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.550+0000 7fb85a200640 1 --2- 172.21.15.47:0/2740926158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb85415c420 0x7fb8541463c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb84c034040 tx=0x7fb84c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:05.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.550+0000 7fb851600640 1 -- 172.21.15.47:0/2740926158 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c036050 con 0x7fb85415c420 2024-05-27T10:52:05.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.550+0000 7fb851600640 1 -- 172.21.15.47:0/2740926158 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb84c042070 con 0x7fb85415c420 2024-05-27T10:52:05.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.550+0000 7fb85ac00640 1 -- 172.21.15.47:0/2740926158 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb85415d0b0 con 0x7fb85415c420 2024-05-27T10:52:05.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.550+0000 7fb851600640 1 -- 172.21.15.47:0/2740926158 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c009510 con 0x7fb85415c420 2024-05-27T10:52:05.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.550+0000 7fb85ac00640 1 -- 172.21.15.47:0/2740926158 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb85415d670 con 0x7fb85415c420 2024-05-27T10:52:05.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.551+0000 7fb85ac00640 1 -- 172.21.15.47:0/2740926158 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb85404fce0 con 0x7fb85415c420 2024-05-27T10:52:05.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.552+0000 7fb851600640 1 -- 172.21.15.47:0/2740926158 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb84c007bf0 con 0x7fb85415c420 2024-05-27T10:52:05.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.553+0000 7fb851600640 1 --2- 172.21.15.47:0/2740926158 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb83406c8f0 0x7fb83406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:05.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.553+0000 7fb851600640 1 -- 172.21.15.47:0/2740926158 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb84c0aca80 con 0x7fb85415c420 2024-05-27T10:52:05.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.554+0000 7fb859800640 1 --2- 172.21.15.47:0/2740926158 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb83406c8f0 0x7fb83406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:05.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.554+0000 7fb859800640 1 --2- 172.21.15.47:0/2740926158 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb83406c8f0 0x7fb83406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb848001640 tx=0x7fb848009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:05.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.557+0000 7fb851600640 1 -- 172.21.15.47:0/2740926158 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb84c0aee20 con 0x7fb85415c420 2024-05-27T10:52:05.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.803+0000 7fb85ac00640 1 -- 172.21.15.47:0/2740926158 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb854073a30 con 0x7fb85415c420 2024-05-27T10:52:05.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.804+0000 7fb851600640 1 -- 172.21.15.47:0/2740926158 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7fb84c07aea0 con 0x7fb85415c420 2024-05-27T10:52:05.802 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:05.802 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/4062514569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4062514569},{"type":"v1","addr":"172.21.15.47:6836","nonce":4062514569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/4113289884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":4113289884},{"type":"v1","addr":"172.21.15.53:6834","nonce":4113289884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3409529039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":3409529039},{"type":"v1","addr":"172.21.15.47:6837","nonce":3409529039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T10:52:01.683075+0000","modified":"2024-05-27T10:52:04.791891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6835/4292385883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":4292385883},{"type":"v1","addr":"172.21.15.53:6835","nonce":4292385883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-27T10:52:05.803 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-05-27T10:52:05.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.807+0000 7fb85ac00640 1 -- 172.21.15.47:0/2740926158 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb83406c8f0 msgr2=0x7fb83406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:05.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.807+0000 7fb85ac00640 1 --2- 172.21.15.47:0/2740926158 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb83406c8f0 0x7fb83406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb848001640 tx=0x7fb848009040 comp rx=0 tx=0).stop 2024-05-27T10:52:05.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.807+0000 7fb85ac00640 1 -- 172.21.15.47:0/2740926158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb85415c420 msgr2=0x7fb8541463c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:05.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.807+0000 7fb85ac00640 1 --2- 172.21.15.47:0/2740926158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb85415c420 0x7fb8541463c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb84c034040 tx=0x7fb84c004a40 comp rx=0 tx=0).stop 2024-05-27T10:52:05.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.807+0000 7fb85ac00640 1 -- 172.21.15.47:0/2740926158 shutdown_connections 2024-05-27T10:52:05.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.807+0000 7fb85ac00640 1 --2- 172.21.15.47:0/2740926158 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb83406c8f0 0x7fb83406edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:05.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.807+0000 7fb85ac00640 1 --2- 172.21.15.47:0/2740926158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb85415c420 0x7fb8541463c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:05.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.807+0000 7fb85ac00640 1 --2- 172.21.15.47:0/2740926158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8540d0a70 0x7fb85415f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:05.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.807+0000 7fb85ac00640 1 --2- 172.21.15.47:0/2740926158 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb8540b4ab0 0x7fb85415de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:05.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.807+0000 7fb85ac00640 1 -- 172.21.15.47:0/2740926158 >> 172.21.15.47:0/2740926158 conn(0x7fb85406bb20 msgr2=0x7fb854159a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:05.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.807+0000 7fb85ac00640 1 -- 172.21.15.47:0/2740926158 shutdown_connections 2024-05-27T10:52:05.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:05.808+0000 7fb85ac00640 1 -- 172.21.15.47:0/2740926158 wait complete. 2024-05-27T10:52:05.825 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:52:06.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.039+0000 7f69bbe00640 1 Processor -- start 2024-05-27T10:52:06.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.039+0000 7f69bbe00640 1 -- start start 2024-05-27T10:52:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.040+0000 7f69bbe00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f69bc15eaa0 0x7f69bc0d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.040+0000 7f69bbe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f69bc06ca40 0x7f69bc0d2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.040+0000 7f69bbe00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69bc0d0950 con 0x7f69bc06d240 2024-05-27T10:52:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.040+0000 7f69bbe00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f69bc0cf4b0 con 0x7f69bc06ca40 2024-05-27T10:52:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.040+0000 7f69bbe00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f69bc0cebc0 con 0x7f69bc15eaa0 2024-05-27T10:52:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.041+0000 7f69bb400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f69bc06ca40 0x7f69bc0d2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.041+0000 7f69bb400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f69bc06ca40 0x7f69bc0d2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34944/0 (socket says 172.21.15.47:34944) 2024-05-27T10:52:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.041+0000 7f69bb400640 1 -- 172.21.15.47:0/3192246721 learned_addr learned my addr 172.21.15.47:0/3192246721 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.041+0000 7f69bb400640 1 -- 172.21.15.47:0/3192246721 >> v2:172.21.15.53:3300/0 conn(0x7f69bc15eaa0 msgr2=0x7f69bc0d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:06.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.041+0000 7f69ba000640 1 --2- 172.21.15.47:0/3192246721 >> v2:172.21.15.53:3300/0 conn(0x7f69bc15eaa0 0x7f69bc0d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:06.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.041+0000 7f69bb400640 1 --2- 172.21.15.47:0/3192246721 >> v2:172.21.15.53:3300/0 conn(0x7f69bc15eaa0 0x7f69bc0d2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:06.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.041+0000 7f69bb400640 1 -- 172.21.15.47:0/3192246721 >> v1:172.21.15.53:6789/0 conn(0x7f69bc06d240 legacy=0x7f69bc06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:06.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.041+0000 7f69bb400640 1 -- 172.21.15.47:0/3192246721 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69bc0cee60 con 0x7f69bc06ca40 2024-05-27T10:52:06.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.041+0000 7f69ba000640 1 --2- 172.21.15.47:0/3192246721 >> v2:172.21.15.53:3300/0 conn(0x7f69bc15eaa0 0x7f69bc0d2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:06.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.042+0000 7f69bb400640 1 --2- 172.21.15.47:0/3192246721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69bc06ca40 0x7f69bc0d2bc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0c7e00 tx=0x7f69b402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c128b241a904480 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:06.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.043+0000 7f69b9600640 1 -- 172.21.15.47:0/3192246721 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4036070 con 0x7f69bc06ca40 2024-05-27T10:52:06.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.043+0000 7f69b9600640 1 -- 172.21.15.47:0/3192246721 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69b4031600 con 0x7f69bc06ca40 2024-05-27T10:52:06.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.043+0000 7f69b9600640 1 -- 172.21.15.47:0/3192246721 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b40319d0 con 0x7f69bc06ca40 2024-05-27T10:52:06.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.043+0000 7f69bbe00640 1 -- 172.21.15.47:0/3192246721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69bc06ca40 msgr2=0x7f69bc0d2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:06.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.043+0000 7f69bbe00640 1 --2- 172.21.15.47:0/3192246721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69bc06ca40 0x7f69bc0d2bc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0c7e00 tx=0x7f69b402a6f0 comp rx=0 tx=0).stop 2024-05-27T10:52:06.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.043+0000 7f69bbe00640 1 -- 172.21.15.47:0/3192246721 shutdown_connections 2024-05-27T10:52:06.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.043+0000 7f69bbe00640 1 --2- 172.21.15.47:0/3192246721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69bc06ca40 0x7f69bc0d2bc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:06.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.043+0000 7f69bbe00640 1 --2- 172.21.15.47:0/3192246721 >> v2:172.21.15.53:3300/0 conn(0x7f69bc15eaa0 0x7f69bc0d2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:06.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.043+0000 7f69bbe00640 1 -- 172.21.15.47:0/3192246721 >> 172.21.15.47:0/3192246721 conn(0x7f69bc08bfd0 msgr2=0x7f69bc0d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:06.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.043+0000 7f69bbe00640 1 -- 172.21.15.47:0/3192246721 shutdown_connections 2024-05-27T10:52:06.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.043+0000 7f69bbe00640 1 -- 172.21.15.47:0/3192246721 wait complete. 2024-05-27T10:52:06.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.045+0000 7f69bbe00640 1 Processor -- start 2024-05-27T10:52:06.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.045+0000 7f69bbe00640 1 -- start start 2024-05-27T10:52:06.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.046+0000 7f69bbe00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f69bc06ca40 0x7f69bc0a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:06.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.046+0000 7f69bbe00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69bc06d240 0x7f69bc0b9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:06.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.046+0000 7f69bbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69bc15eaa0 0x7f69bc09e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:06.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.046+0000 7f69bbe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc0b10a0 con 0x7f69bc15eaa0 2024-05-27T10:52:06.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.046+0000 7f69bbe00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc06cf40 con 0x7f69bc06d240 2024-05-27T10:52:06.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.046+0000 7f69bbe00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f69bc0b1220 con 0x7f69bc06ca40 2024-05-27T10:52:06.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.046+0000 7f69bb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69bc15eaa0 0x7f69bc09e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:06.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.047+0000 7f69bb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69bc15eaa0 0x7f69bc09e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34958/0 (socket says 172.21.15.47:34958) 2024-05-27T10:52:06.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.047+0000 7f69bb400640 1 -- 172.21.15.47:0/3893738992 learned_addr learned my addr 172.21.15.47:0/3893738992 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:06.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.047+0000 7f69ba000640 1 --2- 172.21.15.47:0/3893738992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69bc06d240 0x7f69bc0b9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:06.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.047+0000 7f69baa00640 1 --2- 172.21.15.47:0/3893738992 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f69bc06ca40 0x7f69bc0a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:06.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.047+0000 7f69bb400640 1 -- 172.21.15.47:0/3893738992 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f69bc06ca40 msgr2=0x7f69bc0a04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:06.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.047+0000 7f69bb400640 1 --2- 172.21.15.47:0/3893738992 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f69bc06ca40 0x7f69bc0a04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:06.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.047+0000 7f69bb400640 1 -- 172.21.15.47:0/3893738992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69bc06d240 msgr2=0x7f69bc0b9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:06.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.047+0000 7f69bb400640 1 --2- 172.21.15.47:0/3893738992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69bc06d240 0x7f69bc0b9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:06.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.047+0000 7f69bb400640 1 -- 172.21.15.47:0/3893738992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69bc0a09f0 con 0x7f69bc15eaa0 2024-05-27T10:52:06.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.047+0000 7f69baa00640 1 --2- 172.21.15.47:0/3893738992 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f69bc06ca40 0x7f69bc0a04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:06.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.047+0000 7f69bb400640 1 --2- 172.21.15.47:0/3893738992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69bc15eaa0 0x7f69bc09e420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f69b4034040 tx=0x7f69b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:06.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.048+0000 7f69b2a00640 1 -- 172.21.15.47:0/3893738992 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4041020 con 0x7f69bc15eaa0 2024-05-27T10:52:06.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.048+0000 7f69b2a00640 1 -- 172.21.15.47:0/3893738992 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69b40077a0 con 0x7f69bc15eaa0 2024-05-27T10:52:06.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.048+0000 7f69b2a00640 1 -- 172.21.15.47:0/3893738992 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4036040 con 0x7f69bc15eaa0 2024-05-27T10:52:06.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.048+0000 7f69bbe00640 1 -- 172.21.15.47:0/3893738992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69bc0b9950 con 0x7f69bc15eaa0 2024-05-27T10:52:06.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.048+0000 7f69bbe00640 1 -- 172.21.15.47:0/3893738992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69bc0ccb20 con 0x7f69bc15eaa0 2024-05-27T10:52:06.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.049+0000 7f69bbe00640 1 -- 172.21.15.47:0/3893738992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69bc0cc650 con 0x7f69bc15eaa0 2024-05-27T10:52:06.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.050+0000 7f69b2a00640 1 -- 172.21.15.47:0/3893738992 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f69b4044020 con 0x7f69bc15eaa0 2024-05-27T10:52:06.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.051+0000 7f69b2a00640 1 --2- 172.21.15.47:0/3893738992 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f699c06c8f0 0x7f699c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:06.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.051+0000 7f69b2a00640 1 -- 172.21.15.47:0/3893738992 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f69b40acaf0 con 0x7f69bc15eaa0 2024-05-27T10:52:06.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.051+0000 7f69baa00640 1 --2- 172.21.15.47:0/3893738992 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f699c06c8f0 0x7f699c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:06.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.052+0000 7f69baa00640 1 --2- 172.21.15.47:0/3893738992 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f699c06c8f0 0x7f699c06edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f69ac003eb0 tx=0x7f69ac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:06.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.055+0000 7f69b2a00640 1 -- 172.21.15.47:0/3893738992 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f69b404b030 con 0x7f69bc15eaa0 2024-05-27T10:52:06.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.260+0000 7f69bbe00640 1 -- 172.21.15.47:0/3893738992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69bc15d9e0 con 0x7f69bc15eaa0 2024-05-27T10:52:06.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.262+0000 7f69b2a00640 1 -- 172.21.15.47:0/3893738992 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16521 (secure 0 0 0) 0x7f69bc0a09f0 con 0x7f69bc15eaa0 2024-05-27T10:52:06.261 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:06.261 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:03.257638+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:52:06.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.265+0000 7f69bbe00640 1 -- 172.21.15.47:0/3893738992 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f699c06c8f0 msgr2=0x7f699c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:06.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.265+0000 7f69bbe00640 1 --2- 172.21.15.47:0/3893738992 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f699c06c8f0 0x7f699c06edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f69ac003eb0 tx=0x7f69ac009040 comp rx=0 tx=0).stop 2024-05-27T10:52:06.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.265+0000 7f69bbe00640 1 -- 172.21.15.47:0/3893738992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69bc15eaa0 msgr2=0x7f69bc09e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:06.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.265+0000 7f69bbe00640 1 --2- 172.21.15.47:0/3893738992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69bc15eaa0 0x7f69bc09e420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f69b4034040 tx=0x7f69b4004a40 comp rx=0 tx=0).stop 2024-05-27T10:52:06.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.265+0000 7f69bbe00640 1 -- 172.21.15.47:0/3893738992 shutdown_connections 2024-05-27T10:52:06.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.265+0000 7f69bbe00640 1 --2- 172.21.15.47:0/3893738992 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f699c06c8f0 0x7f699c06edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:06.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.265+0000 7f69bbe00640 1 --2- 172.21.15.47:0/3893738992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69bc15eaa0 0x7f69bc09e420 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:06.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.265+0000 7f69bbe00640 1 --2- 172.21.15.47:0/3893738992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69bc06d240 0x7f69bc0b9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:06.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.265+0000 7f69bbe00640 1 --2- 172.21.15.47:0/3893738992 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f69bc06ca40 0x7f69bc0a04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:06.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.265+0000 7f69bbe00640 1 -- 172.21.15.47:0/3893738992 >> 172.21.15.47:0/3893738992 conn(0x7f69bc08bfd0 msgr2=0x7f69bc15dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:06.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.265+0000 7f69bbe00640 1 -- 172.21.15.47:0/3893738992 shutdown_connections 2024-05-27T10:52:06.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.265+0000 7f69bbe00640 1 -- 172.21.15.47:0/3893738992 wait complete. 2024-05-27T10:52:06.282 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-27T10:52:06.282 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T10:52:06.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.491+0000 7fa0e7200640 1 Processor -- start 2024-05-27T10:52:06.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.492+0000 7fa0e7200640 1 -- start start 2024-05-27T10:52:06.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.493+0000 7fa0e7200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa0e815b380 0x7fa0e80d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:06.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.493+0000 7fa0e7200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0e806f3a0 con 0x7fa0e80d08a0 2024-05-27T10:52:06.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.493+0000 7fa0e7200640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0e806f680 con 0x7fa0e806eda0 2024-05-27T10:52:06.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.493+0000 7fa0e7200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa0e80d0d10 con 0x7fa0e815b380 2024-05-27T10:52:06.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.493+0000 7fa0e5e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa0e815b380 0x7fa0e80d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:06.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.494+0000 7fa0e5e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa0e815b380 0x7fa0e80d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34964/0 (socket says 172.21.15.47:34964) 2024-05-27T10:52:06.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.494+0000 7fa0e5e00640 1 -- 172.21.15.47:0/2086201657 learned_addr learned my addr 172.21.15.47:0/2086201657 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:06.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.494+0000 7fa0e5e00640 1 -- 172.21.15.47:0/2086201657 >> v1:172.21.15.53:6789/0 conn(0x7fa0e806eda0 legacy=0x7fa0e80ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:06.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.494+0000 7fa0e5e00640 1 -- 172.21.15.47:0/2086201657 >> v1:172.21.15.47:6789/0 conn(0x7fa0e80d08a0 legacy=0x7fa0e806e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:06.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.494+0000 7fa0e5e00640 1 -- 172.21.15.47:0/2086201657 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e806f960 con 0x7fa0e815b380 2024-05-27T10:52:06.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.495+0000 7fa0e5e00640 1 --2- 172.21.15.47:0/2086201657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e815b380 0x7fa0e80d0360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa0d800bb10 tx=0x7fa0d802c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767ef347b731ec9b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:06.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.496+0000 7fa0e4a00640 1 -- 172.21.15.47:0/2086201657 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8036020 con 0x7fa0e815b380 2024-05-27T10:52:06.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.496+0000 7fa0e4a00640 1 -- 172.21.15.47:0/2086201657 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d8032640 con 0x7fa0e815b380 2024-05-27T10:52:06.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.496+0000 7fa0e4a00640 1 -- 172.21.15.47:0/2086201657 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8032a10 con 0x7fa0e815b380 2024-05-27T10:52:06.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.496+0000 7fa0e7200640 1 -- 172.21.15.47:0/2086201657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e815b380 msgr2=0x7fa0e80d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:06.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.496+0000 7fa0e7200640 1 --2- 172.21.15.47:0/2086201657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e815b380 0x7fa0e80d0360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa0d800bb10 tx=0x7fa0d802c940 comp rx=0 tx=0).stop 2024-05-27T10:52:06.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.496+0000 7fa0e7200640 1 -- 172.21.15.47:0/2086201657 shutdown_connections 2024-05-27T10:52:06.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.496+0000 7fa0e7200640 1 --2- 172.21.15.47:0/2086201657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e815b380 0x7fa0e80d0360 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:06.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.496+0000 7fa0e7200640 1 -- 172.21.15.47:0/2086201657 >> 172.21.15.47:0/2086201657 conn(0x7fa0e806bb20 msgr2=0x7fa0e806bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:06.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.497+0000 7fa0e7200640 1 -- 172.21.15.47:0/2086201657 shutdown_connections 2024-05-27T10:52:06.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.497+0000 7fa0e7200640 1 -- 172.21.15.47:0/2086201657 wait complete. 2024-05-27T10:52:06.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.498+0000 7fa0e7200640 1 Processor -- start 2024-05-27T10:52:06.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.499+0000 7fa0e7200640 1 -- start start 2024-05-27T10:52:06.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.499+0000 7fa0e7200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e806eda0 0x7fa0e8147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:06.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.499+0000 7fa0e7200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa0e80d08a0 0x7fa0e80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:06.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.500+0000 7fa0e7200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0e815b380 0x7fa0e81497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:06.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.500+0000 7fa0e7200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e806ff20 con 0x7fa0e806eda0 2024-05-27T10:52:06.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.500+0000 7fa0e7200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e80ae840 con 0x7fa0e815b380 2024-05-27T10:52:06.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.500+0000 7fa0e7200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e80ae9c0 con 0x7fa0e80d08a0 2024-05-27T10:52:06.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.500+0000 7fa0e5e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e806eda0 0x7fa0e8147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:06.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.500+0000 7fa0e5e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e806eda0 0x7fa0e8147460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34974/0 (socket says 172.21.15.47:34974) 2024-05-27T10:52:06.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.500+0000 7fa0e5e00640 1 -- 172.21.15.47:0/1433800239 learned_addr learned my addr 172.21.15.47:0/1433800239 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:06.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.500+0000 7fa0e5e00640 1 -- 172.21.15.47:0/1433800239 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa0e80d08a0 msgr2=0x7fa0e80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:06.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.500+0000 7fa0e5400640 1 --2- 172.21.15.47:0/1433800239 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa0e80d08a0 0x7fa0e80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:06.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.500+0000 7fa0e6800640 1 --2- 172.21.15.47:0/1433800239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0e815b380 0x7fa0e81497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:06.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.500+0000 7fa0e5e00640 1 --2- 172.21.15.47:0/1433800239 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa0e80d08a0 0x7fa0e80ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:06.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.500+0000 7fa0e5e00640 1 -- 172.21.15.47:0/1433800239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0e815b380 msgr2=0x7fa0e81497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:06.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.500+0000 7fa0e5e00640 1 --2- 172.21.15.47:0/1433800239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0e815b380 0x7fa0e81497e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:06.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.500+0000 7fa0e5e00640 1 -- 172.21.15.47:0/1433800239 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e80cf0e0 con 0x7fa0e806eda0 2024-05-27T10:52:06.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.501+0000 7fa0e5e00640 1 --2- 172.21.15.47:0/1433800239 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e806eda0 0x7fa0e8147460 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa0d802c980 tx=0x7fa0d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:06.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.501+0000 7fa0de000640 1 -- 172.21.15.47:0/1433800239 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8042070 con 0x7fa0e806eda0 2024-05-27T10:52:06.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.501+0000 7fa0de000640 1 -- 172.21.15.47:0/1433800239 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d803b450 con 0x7fa0e806eda0 2024-05-27T10:52:06.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.501+0000 7fa0de000640 1 -- 172.21.15.47:0/1433800239 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8036040 con 0x7fa0e806eda0 2024-05-27T10:52:06.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.501+0000 7fa0e7200640 1 -- 172.21.15.47:0/1433800239 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e8149d20 con 0x7fa0e806eda0 2024-05-27T10:52:06.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.501+0000 7fa0e7200640 1 -- 172.21.15.47:0/1433800239 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e815c020 con 0x7fa0e806eda0 2024-05-27T10:52:06.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.502+0000 7fa0e7200640 1 -- 172.21.15.47:0/1433800239 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e804fce0 con 0x7fa0e806eda0 2024-05-27T10:52:06.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.503+0000 7fa0de000640 1 -- 172.21.15.47:0/1433800239 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa0d8045070 con 0x7fa0e806eda0 2024-05-27T10:52:06.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.504+0000 7fa0de000640 1 --2- 172.21.15.47:0/1433800239 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa0c806c8f0 0x7fa0c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:06.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.504+0000 7fa0de000640 1 -- 172.21.15.47:0/1433800239 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa0d80ac740 con 0x7fa0e806eda0 2024-05-27T10:52:06.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.504+0000 7fa0e5400640 1 --2- 172.21.15.47:0/1433800239 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa0c806c8f0 0x7fa0c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:06.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.505+0000 7fa0e5400640 1 --2- 172.21.15.47:0/1433800239 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa0c806c8f0 0x7fa0c806edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa0e815bb90 tx=0x7fa0d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:06.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.508+0000 7fa0de000640 1 -- 172.21.15.47:0/1433800239 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa0d807aad0 con 0x7fa0e806eda0 2024-05-27T10:52:06.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.712+0000 7fa0e7200640 1 -- 172.21.15.47:0/1433800239 --> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa0e814c830 con 0x7fa0c806c8f0 2024-05-27T10:52:06.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.729+0000 7fa0de000640 1 -- 172.21.15.47:0/1433800239 <== mgr.4108 v2:172.21.15.47:6832/3679485934 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251902 (secure 0 0 0) 0x7fa0e814c830 con 0x7fa0c806c8f0 2024-05-27T10:52:06.731 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:06.732 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-27T10:52:06.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.734+0000 7fa0e7200640 1 -- 172.21.15.47:0/1433800239 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa0c806c8f0 msgr2=0x7fa0c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:06.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.734+0000 7fa0e7200640 1 --2- 172.21.15.47:0/1433800239 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa0c806c8f0 0x7fa0c806edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa0e815bb90 tx=0x7fa0d4009040 comp rx=0 tx=0).stop 2024-05-27T10:52:06.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.734+0000 7fa0e7200640 1 -- 172.21.15.47:0/1433800239 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e806eda0 msgr2=0x7fa0e8147460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:06.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.734+0000 7fa0e7200640 1 --2- 172.21.15.47:0/1433800239 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e806eda0 0x7fa0e8147460 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa0d802c980 tx=0x7fa0d8004730 comp rx=0 tx=0).stop 2024-05-27T10:52:06.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.734+0000 7fa0e7200640 1 -- 172.21.15.47:0/1433800239 shutdown_connections 2024-05-27T10:52:06.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.734+0000 7fa0e7200640 1 --2- 172.21.15.47:0/1433800239 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa0c806c8f0 0x7fa0c806edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:06.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.734+0000 7fa0e7200640 1 --2- 172.21.15.47:0/1433800239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0e815b380 0x7fa0e81497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:06.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.734+0000 7fa0e7200640 1 --2- 172.21.15.47:0/1433800239 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa0e80d08a0 0x7fa0e80ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:06.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.734+0000 7fa0e7200640 1 --2- 172.21.15.47:0/1433800239 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e806eda0 0x7fa0e8147460 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:06.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.734+0000 7fa0e7200640 1 -- 172.21.15.47:0/1433800239 >> 172.21.15.47:0/1433800239 conn(0x7fa0e806bb20 msgr2=0x7fa0e80b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:06.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.734+0000 7fa0e7200640 1 -- 172.21.15.47:0/1433800239 shutdown_connections 2024-05-27T10:52:06.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:06.734+0000 7fa0e7200640 1 -- 172.21.15.47:0/1433800239 wait complete. 2024-05-27T10:52:06.752 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-05-27T10:52:05.039220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252240,"kb_used_data":2764,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722480,"statfs":{"total":773094113280,"available":772835819520,"internally_reserved":0,"allocated":2830336,"data_stored":1721528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.849681"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.293075+0000","last_change":"2024-05-27T10:52:02.284644+0000","last_active":"2024-05-27T10:52:02.293075+0000","last_peered":"2024-05-27T10:52:02.293075+0000","last_clean":"2024-05-27T10:52:02.293075+0000","last_became_active":"2024-05-27T10:52:02.284277+0000","last_became_peered":"2024-05-27T10:52:02.284277+0000","last_unstale":"2024-05-27T10:52:02.293075+0000","last_undegraded":"2024-05-27T10:52:02.293075+0000","last_fullsized":"2024-05-27T10:52:02.293075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:44:14.946437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.282491+0000","last_change":"2024-05-27T10:52:02.274156+0000","last_active":"2024-05-27T10:52:02.282491+0000","last_peered":"2024-05-27T10:52:02.282491+0000","last_clean":"2024-05-27T10:52:02.282491+0000","last_became_active":"2024-05-27T10:52:02.273895+0000","last_became_peered":"2024-05-27T10:52:02.273895+0000","last_unstale":"2024-05-27T10:52:02.282491+0000","last_undegraded":"2024-05-27T10:52:02.282491+0000","last_fullsized":"2024-05-27T10:52:02.282491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:53:57.446525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277856+0000","last_change":"2024-05-27T10:52:02.259214+0000","last_active":"2024-05-27T10:52:03.277856+0000","last_peered":"2024-05-27T10:52:03.277856+0000","last_clean":"2024-05-27T10:52:03.277856+0000","last_became_active":"2024-05-27T10:52:02.258890+0000","last_became_peered":"2024-05-27T10:52:02.258890+0000","last_unstale":"2024-05-27T10:52:03.277856+0000","last_undegraded":"2024-05-27T10:52:03.277856+0000","last_fullsized":"2024-05-27T10:52:03.277856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:44:14.946437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.286972+0000","last_change":"2024-05-27T10:52:02.280689+0000","last_active":"2024-05-27T10:52:02.286972+0000","last_peered":"2024-05-27T10:52:02.286972+0000","last_clean":"2024-05-27T10:52:02.286972+0000","last_became_active":"2024-05-27T10:52:02.279605+0000","last_became_peered":"2024-05-27T10:52:02.279605+0000","last_unstale":"2024-05-27T10:52:02.286972+0000","last_undegraded":"2024-05-27T10:52:02.286972+0000","last_fullsized":"2024-05-27T10:52:02.286972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:53:57.446525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.284954+0000","last_change":"2024-05-27T10:52:02.275103+0000","last_active":"2024-05-27T10:52:02.284954+0000","last_peered":"2024-05-27T10:52:02.284954+0000","last_clean":"2024-05-27T10:52:02.284954+0000","last_became_active":"2024-05-27T10:52:02.274768+0000","last_became_peered":"2024-05-27T10:52:02.274768+0000","last_unstale":"2024-05-27T10:52:02.284954+0000","last_undegraded":"2024-05-27T10:52:02.284954+0000","last_fullsized":"2024-05-27T10:52:02.284954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:09:36.642477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.285267+0000","last_change":"2024-05-27T10:52:02.275374+0000","last_active":"2024-05-27T10:52:02.285267+0000","last_peered":"2024-05-27T10:52:02.285267+0000","last_clean":"2024-05-27T10:52:02.285267+0000","last_became_active":"2024-05-27T10:52:02.270621+0000","last_became_peered":"2024-05-27T10:52:02.270621+0000","last_unstale":"2024-05-27T10:52:02.285267+0000","last_undegraded":"2024-05-27T10:52:02.285267+0000","last_fullsized":"2024-05-27T10:52:02.285267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:27:23.976804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.282363+0000","last_change":"2024-05-27T10:52:02.277391+0000","last_active":"2024-05-27T10:52:02.282363+0000","last_peered":"2024-05-27T10:52:02.282363+0000","last_clean":"2024-05-27T10:52:02.282363+0000","last_became_active":"2024-05-27T10:52:02.275623+0000","last_became_peered":"2024-05-27T10:52:02.275623+0000","last_unstale":"2024-05-27T10:52:02.282363+0000","last_undegraded":"2024-05-27T10:52:02.282363+0000","last_fullsized":"2024-05-27T10:52:02.282363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:25:10.287509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.278627+0000","last_change":"2024-05-27T10:52:02.278913+0000","last_active":"2024-05-27T10:52:03.278627+0000","last_peered":"2024-05-27T10:52:03.278627+0000","last_clean":"2024-05-27T10:52:03.278627+0000","last_became_active":"2024-05-27T10:52:02.278319+0000","last_became_peered":"2024-05-27T10:52:02.278319+0000","last_unstale":"2024-05-27T10:52:03.278627+0000","last_undegraded":"2024-05-27T10:52:03.278627+0000","last_fullsized":"2024-05-27T10:52:03.278627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:40:53.386645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.292744+0000","last_change":"2024-05-27T10:52:02.283688+0000","last_active":"2024-05-27T10:52:02.292744+0000","last_peered":"2024-05-27T10:52:02.292744+0000","last_clean":"2024-05-27T10:52:02.292744+0000","last_became_active":"2024-05-27T10:52:02.283284+0000","last_became_peered":"2024-05-27T10:52:02.283284+0000","last_unstale":"2024-05-27T10:52:02.292744+0000","last_undegraded":"2024-05-27T10:52:02.292744+0000","last_fullsized":"2024-05-27T10:52:02.292744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:40:53.386645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.282555+0000","last_change":"2024-05-27T10:52:02.272971+0000","last_active":"2024-05-27T10:52:02.282555+0000","last_peered":"2024-05-27T10:52:02.282555+0000","last_clean":"2024-05-27T10:52:02.282555+0000","last_became_active":"2024-05-27T10:52:02.272634+0000","last_became_peered":"2024-05-27T10:52:02.272634+0000","last_unstale":"2024-05-27T10:52:02.282555+0000","last_undegraded":"2024-05-27T10:52:02.282555+0000","last_fullsized":"2024-05-27T10:52:02.282555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:33:58.197155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.281542+0000","last_change":"2024-05-27T10:52:02.278290+0000","last_active":"2024-05-27T10:52:02.281542+0000","last_peered":"2024-05-27T10:52:02.281542+0000","last_clean":"2024-05-27T10:52:02.281542+0000","last_became_active":"2024-05-27T10:52:02.277971+0000","last_became_peered":"2024-05-27T10:52:02.277971+0000","last_unstale":"2024-05-27T10:52:02.281542+0000","last_undegraded":"2024-05-27T10:52:02.281542+0000","last_fullsized":"2024-05-27T10:52:02.281542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:53:57.446525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277196+0000","last_change":"2024-05-27T10:52:02.262321+0000","last_active":"2024-05-27T10:52:03.277196+0000","last_peered":"2024-05-27T10:52:03.277196+0000","last_clean":"2024-05-27T10:52:03.277196+0000","last_became_active":"2024-05-27T10:52:02.262012+0000","last_became_peered":"2024-05-27T10:52:02.262012+0000","last_unstale":"2024-05-27T10:52:03.277196+0000","last_undegraded":"2024-05-27T10:52:03.277196+0000","last_fullsized":"2024-05-27T10:52:03.277196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:27:26.831178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280146+0000","last_change":"2024-05-27T10:52:02.289470+0000","last_active":"2024-05-27T10:52:03.280146+0000","last_peered":"2024-05-27T10:52:03.280146+0000","last_clean":"2024-05-27T10:52:03.280146+0000","last_became_active":"2024-05-27T10:52:02.288616+0000","last_became_peered":"2024-05-27T10:52:02.288616+0000","last_unstale":"2024-05-27T10:52:03.280146+0000","last_undegraded":"2024-05-27T10:52:03.280146+0000","last_fullsized":"2024-05-27T10:52:03.280146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:42:51.939151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.276301+0000","last_change":"2024-05-27T10:52:02.282027+0000","last_active":"2024-05-27T10:52:03.276301+0000","last_peered":"2024-05-27T10:52:03.276301+0000","last_clean":"2024-05-27T10:52:03.276301+0000","last_became_active":"2024-05-27T10:52:02.281747+0000","last_became_peered":"2024-05-27T10:52:02.281747+0000","last_unstale":"2024-05-27T10:52:03.276301+0000","last_undegraded":"2024-05-27T10:52:03.276301+0000","last_fullsized":"2024-05-27T10:52:03.276301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:53:57.446525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.284895+0000","last_change":"2024-05-27T10:52:02.280351+0000","last_active":"2024-05-27T10:52:02.284895+0000","last_peered":"2024-05-27T10:52:02.284895+0000","last_clean":"2024-05-27T10:52:02.284895+0000","last_became_active":"2024-05-27T10:52:02.278207+0000","last_became_peered":"2024-05-27T10:52:02.278207+0000","last_unstale":"2024-05-27T10:52:02.284895+0000","last_undegraded":"2024-05-27T10:52:02.284895+0000","last_fullsized":"2024-05-27T10:52:02.284895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:25:10.287509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.287440+0000","last_change":"2024-05-27T10:52:02.280012+0000","last_active":"2024-05-27T10:52:02.287440+0000","last_peered":"2024-05-27T10:52:02.287440+0000","last_clean":"2024-05-27T10:52:02.287440+0000","last_became_active":"2024-05-27T10:52:02.279500+0000","last_became_peered":"2024-05-27T10:52:02.279500+0000","last_unstale":"2024-05-27T10:52:02.287440+0000","last_undegraded":"2024-05-27T10:52:02.287440+0000","last_fullsized":"2024-05-27T10:52:02.287440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:49:04.560234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.279818+0000","last_change":"2024-05-27T10:52:02.276006+0000","last_active":"2024-05-27T10:52:02.279818+0000","last_peered":"2024-05-27T10:52:02.279818+0000","last_clean":"2024-05-27T10:52:02.279818+0000","last_became_active":"2024-05-27T10:52:02.275602+0000","last_became_peered":"2024-05-27T10:52:02.275602+0000","last_unstale":"2024-05-27T10:52:02.279818+0000","last_undegraded":"2024-05-27T10:52:02.279818+0000","last_fullsized":"2024-05-27T10:52:02.279818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:27:26.831178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.290273+0000","last_change":"2024-05-27T10:52:02.287428+0000","last_active":"2024-05-27T10:52:02.290273+0000","last_peered":"2024-05-27T10:52:02.290273+0000","last_clean":"2024-05-27T10:52:02.290273+0000","last_became_active":"2024-05-27T10:52:02.285853+0000","last_became_peered":"2024-05-27T10:52:02.285853+0000","last_unstale":"2024-05-27T10:52:02.290273+0000","last_undegraded":"2024-05-27T10:52:02.290273+0000","last_fullsized":"2024-05-27T10:52:02.290273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:27:23.976804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.288122+0000","last_change":"2024-05-27T10:52:02.284355+0000","last_active":"2024-05-27T10:52:02.288122+0000","last_peered":"2024-05-27T10:52:02.288122+0000","last_clean":"2024-05-27T10:52:02.288122+0000","last_became_active":"2024-05-27T10:52:02.281949+0000","last_became_peered":"2024-05-27T10:52:02.281949+0000","last_unstale":"2024-05-27T10:52:02.288122+0000","last_undegraded":"2024-05-27T10:52:02.288122+0000","last_fullsized":"2024-05-27T10:52:02.288122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:49.993062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.282504+0000","last_change":"2024-05-27T10:52:02.274651+0000","last_active":"2024-05-27T10:52:02.282504+0000","last_peered":"2024-05-27T10:52:02.282504+0000","last_clean":"2024-05-27T10:52:02.282504+0000","last_became_active":"2024-05-27T10:52:02.273814+0000","last_became_peered":"2024-05-27T10:52:02.273814+0000","last_unstale":"2024-05-27T10:52:02.282504+0000","last_undegraded":"2024-05-27T10:52:02.282504+0000","last_fullsized":"2024-05-27T10:52:02.282504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:49:04.560234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.276941+0000","last_change":"2024-05-27T10:52:02.282039+0000","last_active":"2024-05-27T10:52:03.276941+0000","last_peered":"2024-05-27T10:52:03.276941+0000","last_clean":"2024-05-27T10:52:03.276941+0000","last_became_active":"2024-05-27T10:52:02.281761+0000","last_became_peered":"2024-05-27T10:52:02.281761+0000","last_unstale":"2024-05-27T10:52:03.276941+0000","last_undegraded":"2024-05-27T10:52:03.276941+0000","last_fullsized":"2024-05-27T10:52:03.276941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:45.783380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.282392+0000","last_change":"2024-05-27T10:52:02.276287+0000","last_active":"2024-05-27T10:52:02.282392+0000","last_peered":"2024-05-27T10:52:02.282392+0000","last_clean":"2024-05-27T10:52:02.282392+0000","last_became_active":"2024-05-27T10:52:02.275681+0000","last_became_peered":"2024-05-27T10:52:02.275681+0000","last_unstale":"2024-05-27T10:52:02.282392+0000","last_undegraded":"2024-05-27T10:52:02.282392+0000","last_fullsized":"2024-05-27T10:52:02.282392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:33:58.197155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.278852+0000","last_change":"2024-05-27T10:52:02.282775+0000","last_active":"2024-05-27T10:52:03.278852+0000","last_peered":"2024-05-27T10:52:03.278852+0000","last_clean":"2024-05-27T10:52:03.278852+0000","last_became_active":"2024-05-27T10:52:02.282279+0000","last_became_peered":"2024-05-27T10:52:02.282279+0000","last_unstale":"2024-05-27T10:52:03.278852+0000","last_undegraded":"2024-05-27T10:52:03.278852+0000","last_fullsized":"2024-05-27T10:52:03.278852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:44:14.946437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.287462+0000","last_change":"2024-05-27T10:52:02.281520+0000","last_active":"2024-05-27T10:52:02.287462+0000","last_peered":"2024-05-27T10:52:02.287462+0000","last_clean":"2024-05-27T10:52:02.287462+0000","last_became_active":"2024-05-27T10:52:02.281199+0000","last_became_peered":"2024-05-27T10:52:02.281199+0000","last_unstale":"2024-05-27T10:52:02.287462+0000","last_undegraded":"2024-05-27T10:52:02.287462+0000","last_fullsized":"2024-05-27T10:52:02.287462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:25:10.287509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280858+0000","last_change":"2024-05-27T10:52:02.280042+0000","last_active":"2024-05-27T10:52:03.280858+0000","last_peered":"2024-05-27T10:52:03.280858+0000","last_clean":"2024-05-27T10:52:03.280858+0000","last_became_active":"2024-05-27T10:52:02.279664+0000","last_became_peered":"2024-05-27T10:52:02.279664+0000","last_unstale":"2024-05-27T10:52:03.280858+0000","last_undegraded":"2024-05-27T10:52:03.280858+0000","last_fullsized":"2024-05-27T10:52:03.280858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:31.231464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.290913+0000","last_change":"2024-05-27T10:52:02.286086+0000","last_active":"2024-05-27T10:52:02.290913+0000","last_peered":"2024-05-27T10:52:02.290913+0000","last_clean":"2024-05-27T10:52:02.290913+0000","last_became_active":"2024-05-27T10:52:02.285764+0000","last_became_peered":"2024-05-27T10:52:02.285764+0000","last_unstale":"2024-05-27T10:52:02.290913+0000","last_undegraded":"2024-05-27T10:52:02.290913+0000","last_fullsized":"2024-05-27T10:52:02.290913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:45.783380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.293365+0000","last_change":"2024-05-27T10:52:02.291922+0000","last_active":"2024-05-27T10:52:02.293365+0000","last_peered":"2024-05-27T10:52:02.293365+0000","last_clean":"2024-05-27T10:52:02.293365+0000","last_became_active":"2024-05-27T10:52:02.291600+0000","last_became_peered":"2024-05-27T10:52:02.291600+0000","last_unstale":"2024-05-27T10:52:02.293365+0000","last_undegraded":"2024-05-27T10:52:02.293365+0000","last_fullsized":"2024-05-27T10:52:02.293365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:40:53.386645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280251+0000","last_change":"2024-05-27T10:52:02.283531+0000","last_active":"2024-05-27T10:52:03.280251+0000","last_peered":"2024-05-27T10:52:03.280251+0000","last_clean":"2024-05-27T10:52:03.280251+0000","last_became_active":"2024-05-27T10:52:02.283298+0000","last_became_peered":"2024-05-27T10:52:02.283298+0000","last_unstale":"2024-05-27T10:52:03.280251+0000","last_undegraded":"2024-05-27T10:52:03.280251+0000","last_fullsized":"2024-05-27T10:52:03.280251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:00.463147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277113+0000","last_change":"2024-05-27T10:52:02.290718+0000","last_active":"2024-05-27T10:52:03.277113+0000","last_peered":"2024-05-27T10:52:03.277113+0000","last_clean":"2024-05-27T10:52:03.277113+0000","last_became_active":"2024-05-27T10:52:02.290410+0000","last_became_peered":"2024-05-27T10:52:02.290410+0000","last_unstale":"2024-05-27T10:52:03.277113+0000","last_undegraded":"2024-05-27T10:52:03.277113+0000","last_fullsized":"2024-05-27T10:52:03.277113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:40:53.386645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.289233+0000","last_change":"2024-05-27T10:52:02.282494+0000","last_active":"2024-05-27T10:52:02.289233+0000","last_peered":"2024-05-27T10:52:02.289233+0000","last_clean":"2024-05-27T10:52:02.289233+0000","last_became_active":"2024-05-27T10:52:02.280254+0000","last_became_peered":"2024-05-27T10:52:02.280254+0000","last_unstale":"2024-05-27T10:52:02.289233+0000","last_undegraded":"2024-05-27T10:52:02.289233+0000","last_fullsized":"2024-05-27T10:52:02.289233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:49.993062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.268594+0000","last_change":"2024-05-27T10:52:02.267415+0000","last_active":"2024-05-27T10:52:02.268594+0000","last_peered":"2024-05-27T10:52:02.268594+0000","last_clean":"2024-05-27T10:52:02.268594+0000","last_became_active":"2024-05-27T10:52:02.266959+0000","last_became_peered":"2024-05-27T10:52:02.266959+0000","last_unstale":"2024-05-27T10:52:02.268594+0000","last_undegraded":"2024-05-27T10:52:02.268594+0000","last_fullsized":"2024-05-27T10:52:02.268594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:15.499873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.290810+0000","last_change":"2024-05-27T10:52:02.285006+0000","last_active":"2024-05-27T10:52:02.290810+0000","last_peered":"2024-05-27T10:52:02.290810+0000","last_clean":"2024-05-27T10:52:02.290810+0000","last_became_active":"2024-05-27T10:52:02.284596+0000","last_became_peered":"2024-05-27T10:52:02.284596+0000","last_unstale":"2024-05-27T10:52:02.290810+0000","last_undegraded":"2024-05-27T10:52:02.290810+0000","last_fullsized":"2024-05-27T10:52:02.290810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:25:10.287509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277028+0000","last_change":"2024-05-27T10:52:02.287164+0000","last_active":"2024-05-27T10:52:03.277028+0000","last_peered":"2024-05-27T10:52:03.277028+0000","last_clean":"2024-05-27T10:52:03.277028+0000","last_became_active":"2024-05-27T10:52:02.280960+0000","last_became_peered":"2024-05-27T10:52:02.280960+0000","last_unstale":"2024-05-27T10:52:03.277028+0000","last_undegraded":"2024-05-27T10:52:03.277028+0000","last_fullsized":"2024-05-27T10:52:03.277028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:27:23.976804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280920+0000","last_change":"2024-05-27T10:52:01.235575+0000","last_active":"2024-05-27T10:52:03.280920+0000","last_peered":"2024-05-27T10:52:03.280920+0000","last_clean":"2024-05-27T10:52:03.280920+0000","last_became_active":"2024-05-27T10:52:01.235262+0000","last_became_peered":"2024-05-27T10:52:01.235262+0000","last_unstale":"2024-05-27T10:52:03.280920+0000","last_undegraded":"2024-05-27T10:52:03.280920+0000","last_fullsized":"2024-05-27T10:52:03.280920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:48:32.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277302+0000","last_change":"2024-05-27T10:52:02.280538+0000","last_active":"2024-05-27T10:52:03.277302+0000","last_peered":"2024-05-27T10:52:03.277302+0000","last_clean":"2024-05-27T10:52:03.277302+0000","last_became_active":"2024-05-27T10:52:02.279400+0000","last_became_peered":"2024-05-27T10:52:02.279400+0000","last_unstale":"2024-05-27T10:52:03.277302+0000","last_undegraded":"2024-05-27T10:52:03.277302+0000","last_fullsized":"2024-05-27T10:52:03.277302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:49.993062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.281532+0000","last_change":"2024-05-27T10:52:01.237296+0000","last_active":"2024-05-27T10:52:02.281532+0000","last_peered":"2024-05-27T10:52:02.281532+0000","last_clean":"2024-05-27T10:52:02.281532+0000","last_became_active":"2024-05-27T10:52:01.236981+0000","last_became_peered":"2024-05-27T10:52:01.236981+0000","last_unstale":"2024-05-27T10:52:02.281532+0000","last_undegraded":"2024-05-27T10:52:02.281532+0000","last_fullsized":"2024-05-27T10:52:02.281532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:48:32.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279087+0000","last_change":"2024-05-27T10:52:01.228043+0000","last_active":"2024-05-27T10:52:03.279087+0000","last_peered":"2024-05-27T10:52:03.279087+0000","last_clean":"2024-05-27T10:52:03.279087+0000","last_became_active":"2024-05-27T10:52:01.227737+0000","last_became_peered":"2024-05-27T10:52:01.227737+0000","last_unstale":"2024-05-27T10:52:03.279087+0000","last_undegraded":"2024-05-27T10:52:03.279087+0000","last_fullsized":"2024-05-27T10:52:03.279087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:48:09.492465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.278823+0000","last_change":"2024-05-27T10:52:02.281578+0000","last_active":"2024-05-27T10:52:03.278823+0000","last_peered":"2024-05-27T10:52:03.278823+0000","last_clean":"2024-05-27T10:52:03.278823+0000","last_became_active":"2024-05-27T10:52:02.280978+0000","last_became_peered":"2024-05-27T10:52:02.280978+0000","last_unstale":"2024-05-27T10:52:03.278823+0000","last_undegraded":"2024-05-27T10:52:03.278823+0000","last_fullsized":"2024-05-27T10:52:03.278823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:49.993062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.258155+0000","last_change":"2024-05-27T10:52:01.248022+0000","last_active":"2024-05-27T10:52:02.258155+0000","last_peered":"2024-05-27T10:52:02.258155+0000","last_clean":"2024-05-27T10:52:02.258155+0000","last_became_active":"2024-05-27T10:52:01.244891+0000","last_became_peered":"2024-05-27T10:52:01.244891+0000","last_unstale":"2024-05-27T10:52:02.258155+0000","last_undegraded":"2024-05-27T10:52:02.258155+0000","last_fullsized":"2024-05-27T10:52:02.258155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:48:09.492465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.284910+0000","last_change":"2024-05-27T10:52:02.281087+0000","last_active":"2024-05-27T10:52:02.284910+0000","last_peered":"2024-05-27T10:52:02.284910+0000","last_clean":"2024-05-27T10:52:02.284910+0000","last_became_active":"2024-05-27T10:52:02.280786+0000","last_became_peered":"2024-05-27T10:52:02.280786+0000","last_unstale":"2024-05-27T10:52:02.284910+0000","last_undegraded":"2024-05-27T10:52:02.284910+0000","last_fullsized":"2024-05-27T10:52:02.284910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:45.783380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.261390+0000","last_change":"2024-05-27T10:52:01.245539+0000","last_active":"2024-05-27T10:52:02.261390+0000","last_peered":"2024-05-27T10:52:02.261390+0000","last_clean":"2024-05-27T10:52:02.261390+0000","last_became_active":"2024-05-27T10:52:01.245210+0000","last_became_peered":"2024-05-27T10:52:01.245210+0000","last_unstale":"2024-05-27T10:52:02.261390+0000","last_undegraded":"2024-05-27T10:52:02.261390+0000","last_fullsized":"2024-05-27T10:52:02.261390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:05.650946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.289196+0000","last_change":"2024-05-27T10:52:02.282228+0000","last_active":"2024-05-27T10:52:02.289196+0000","last_peered":"2024-05-27T10:52:02.289196+0000","last_clean":"2024-05-27T10:52:02.289196+0000","last_became_active":"2024-05-27T10:52:02.281907+0000","last_became_peered":"2024-05-27T10:52:02.281907+0000","last_unstale":"2024-05-27T10:52:02.289196+0000","last_undegraded":"2024-05-27T10:52:02.289196+0000","last_fullsized":"2024-05-27T10:52:02.289196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:40:53.386645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.261748+0000","last_change":"2024-05-27T10:52:01.243305+0000","last_active":"2024-05-27T10:52:02.261748+0000","last_peered":"2024-05-27T10:52:02.261748+0000","last_clean":"2024-05-27T10:52:02.261748+0000","last_became_active":"2024-05-27T10:52:01.242940+0000","last_became_peered":"2024-05-27T10:52:01.242940+0000","last_unstale":"2024-05-27T10:52:02.261748+0000","last_undegraded":"2024-05-27T10:52:02.261748+0000","last_fullsized":"2024-05-27T10:52:02.261748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:14.495142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279248+0000","last_change":"2024-05-27T10:52:02.267283+0000","last_active":"2024-05-27T10:52:03.279248+0000","last_peered":"2024-05-27T10:52:03.279248+0000","last_clean":"2024-05-27T10:52:03.279248+0000","last_became_active":"2024-05-27T10:52:02.266747+0000","last_became_peered":"2024-05-27T10:52:02.266747+0000","last_unstale":"2024-05-27T10:52:03.279248+0000","last_undegraded":"2024-05-27T10:52:03.279248+0000","last_fullsized":"2024-05-27T10:52:03.279248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:16.695502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.288020+0000","last_change":"2024-05-27T10:52:01.233507+0000","last_active":"2024-05-27T10:52:02.288020+0000","last_peered":"2024-05-27T10:52:02.288020+0000","last_clean":"2024-05-27T10:52:02.288020+0000","last_became_active":"2024-05-27T10:52:01.233204+0000","last_became_peered":"2024-05-27T10:52:01.233204+0000","last_unstale":"2024-05-27T10:52:02.288020+0000","last_undegraded":"2024-05-27T10:52:02.288020+0000","last_fullsized":"2024-05-27T10:52:02.288020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:27:25.826446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277331+0000","last_change":"2024-05-27T10:52:02.279589+0000","last_active":"2024-05-27T10:52:03.277331+0000","last_peered":"2024-05-27T10:52:03.277331+0000","last_clean":"2024-05-27T10:52:03.277331+0000","last_became_active":"2024-05-27T10:52:02.276985+0000","last_became_peered":"2024-05-27T10:52:02.276985+0000","last_unstale":"2024-05-27T10:52:03.277331+0000","last_undegraded":"2024-05-27T10:52:03.277331+0000","last_fullsized":"2024-05-27T10:52:03.277331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:33:58.197155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.297600+0000","last_change":"2024-05-27T10:52:01.235144+0000","last_active":"2024-05-27T10:52:02.297600+0000","last_peered":"2024-05-27T10:52:02.297600+0000","last_clean":"2024-05-27T10:52:02.297600+0000","last_became_active":"2024-05-27T10:52:01.234380+0000","last_became_peered":"2024-05-27T10:52:01.234380+0000","last_unstale":"2024-05-27T10:52:02.297600+0000","last_undegraded":"2024-05-27T10:52:02.297600+0000","last_fullsized":"2024-05-27T10:52:02.297600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:14.495142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.295321+0000","last_change":"2024-05-27T10:52:02.293987+0000","last_active":"2024-05-27T10:52:02.295321+0000","last_peered":"2024-05-27T10:52:02.295321+0000","last_clean":"2024-05-27T10:52:02.295321+0000","last_became_active":"2024-05-27T10:52:02.293646+0000","last_became_peered":"2024-05-27T10:52:02.293646+0000","last_unstale":"2024-05-27T10:52:02.295321+0000","last_undegraded":"2024-05-27T10:52:02.295321+0000","last_fullsized":"2024-05-27T10:52:02.295321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:21:45.050385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277453+0000","last_change":"2024-05-27T10:52:01.231147+0000","last_active":"2024-05-27T10:52:03.277453+0000","last_peered":"2024-05-27T10:52:03.277453+0000","last_clean":"2024-05-27T10:52:03.277453+0000","last_became_active":"2024-05-27T10:52:01.230902+0000","last_became_peered":"2024-05-27T10:52:01.230902+0000","last_unstale":"2024-05-27T10:52:03.277453+0000","last_undegraded":"2024-05-27T10:52:03.277453+0000","last_fullsized":"2024-05-27T10:52:03.277453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:29:30.495775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.276473+0000","last_change":"2024-05-27T10:52:02.260644+0000","last_active":"2024-05-27T10:52:03.276473+0000","last_peered":"2024-05-27T10:52:03.276473+0000","last_clean":"2024-05-27T10:52:03.276473+0000","last_became_active":"2024-05-27T10:52:02.260329+0000","last_became_peered":"2024-05-27T10:52:02.260329+0000","last_unstale":"2024-05-27T10:52:03.276473+0000","last_undegraded":"2024-05-27T10:52:03.276473+0000","last_fullsized":"2024-05-27T10:52:03.276473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:25:10.287509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.258317+0000","last_change":"2024-05-27T10:52:01.239325+0000","last_active":"2024-05-27T10:52:02.258317+0000","last_peered":"2024-05-27T10:52:02.258317+0000","last_clean":"2024-05-27T10:52:02.258317+0000","last_became_active":"2024-05-27T10:52:01.239049+0000","last_became_peered":"2024-05-27T10:52:01.239049+0000","last_unstale":"2024-05-27T10:52:02.258317+0000","last_undegraded":"2024-05-27T10:52:02.258317+0000","last_fullsized":"2024-05-27T10:52:02.258317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:23:24.648014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.295082+0000","last_change":"2024-05-27T10:52:02.292008+0000","last_active":"2024-05-27T10:52:02.295082+0000","last_peered":"2024-05-27T10:52:02.295082+0000","last_clean":"2024-05-27T10:52:02.295082+0000","last_became_active":"2024-05-27T10:52:02.289668+0000","last_became_peered":"2024-05-27T10:52:02.289668+0000","last_unstale":"2024-05-27T10:52:02.295082+0000","last_undegraded":"2024-05-27T10:52:02.295082+0000","last_fullsized":"2024-05-27T10:52:02.295082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:42:51.939151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.261380+0000","last_change":"2024-05-27T10:52:01.241305+0000","last_active":"2024-05-27T10:52:02.261380+0000","last_peered":"2024-05-27T10:52:02.261380+0000","last_clean":"2024-05-27T10:52:02.261380+0000","last_became_active":"2024-05-27T10:52:01.240944+0000","last_became_peered":"2024-05-27T10:52:01.240944+0000","last_unstale":"2024-05-27T10:52:02.261380+0000","last_undegraded":"2024-05-27T10:52:02.261380+0000","last_fullsized":"2024-05-27T10:52:02.261380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:23:24.648014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.287303+0000","last_change":"2024-05-27T10:52:02.283944+0000","last_active":"2024-05-27T10:52:02.287303+0000","last_peered":"2024-05-27T10:52:02.287303+0000","last_clean":"2024-05-27T10:52:02.287303+0000","last_became_active":"2024-05-27T10:52:02.283395+0000","last_became_peered":"2024-05-27T10:52:02.283395+0000","last_unstale":"2024-05-27T10:52:02.287303+0000","last_undegraded":"2024-05-27T10:52:02.287303+0000","last_fullsized":"2024-05-27T10:52:02.287303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:09:36.642477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.285433+0000","last_change":"2024-05-27T10:52:01.219153+0000","last_active":"2024-05-27T10:52:02.285433+0000","last_peered":"2024-05-27T10:52:02.285433+0000","last_clean":"2024-05-27T10:52:02.285433+0000","last_became_active":"2024-05-27T10:52:01.218818+0000","last_became_peered":"2024-05-27T10:52:01.218818+0000","last_unstale":"2024-05-27T10:52:02.285433+0000","last_undegraded":"2024-05-27T10:52:02.285433+0000","last_fullsized":"2024-05-27T10:52:02.285433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:48:09.492465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.295702+0000","last_change":"2024-05-27T10:52:02.292446+0000","last_active":"2024-05-27T10:52:02.295702+0000","last_peered":"2024-05-27T10:52:02.295702+0000","last_clean":"2024-05-27T10:52:02.295702+0000","last_became_active":"2024-05-27T10:52:02.289784+0000","last_became_peered":"2024-05-27T10:52:02.289784+0000","last_unstale":"2024-05-27T10:52:02.295702+0000","last_undegraded":"2024-05-27T10:52:02.295702+0000","last_fullsized":"2024-05-27T10:52:02.295702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:00.463147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277731+0000","last_change":"2024-05-27T10:52:01.222520+0000","last_active":"2024-05-27T10:52:03.277731+0000","last_peered":"2024-05-27T10:52:03.277731+0000","last_clean":"2024-05-27T10:52:03.277731+0000","last_became_active":"2024-05-27T10:52:01.220852+0000","last_became_peered":"2024-05-27T10:52:01.220852+0000","last_unstale":"2024-05-27T10:52:03.277731+0000","last_undegraded":"2024-05-27T10:52:03.277731+0000","last_fullsized":"2024-05-27T10:52:03.277731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:29:30.495775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.291314+0000","last_change":"2024-05-27T10:52:02.288608+0000","last_active":"2024-05-27T10:52:02.291314+0000","last_peered":"2024-05-27T10:52:02.291314+0000","last_clean":"2024-05-27T10:52:02.291314+0000","last_became_active":"2024-05-27T10:52:02.288214+0000","last_became_peered":"2024-05-27T10:52:02.288214+0000","last_unstale":"2024-05-27T10:52:02.291314+0000","last_undegraded":"2024-05-27T10:52:02.291314+0000","last_fullsized":"2024-05-27T10:52:02.291314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:16:52.089775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.276226+0000","last_change":"2024-05-27T10:52:01.225974+0000","last_active":"2024-05-27T10:52:02.276226+0000","last_peered":"2024-05-27T10:52:02.276226+0000","last_clean":"2024-05-27T10:52:02.276226+0000","last_became_active":"2024-05-27T10:52:01.225654+0000","last_became_peered":"2024-05-27T10:52:01.225654+0000","last_unstale":"2024-05-27T10:52:02.276226+0000","last_undegraded":"2024-05-27T10:52:02.276226+0000","last_fullsized":"2024-05-27T10:52:02.276226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:05.650946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.294894+0000","last_change":"2024-05-27T10:52:02.290951+0000","last_active":"2024-05-27T10:52:02.294894+0000","last_peered":"2024-05-27T10:52:02.294894+0000","last_clean":"2024-05-27T10:52:02.294894+0000","last_became_active":"2024-05-27T10:52:02.290085+0000","last_became_peered":"2024-05-27T10:52:02.290085+0000","last_unstale":"2024-05-27T10:52:02.294894+0000","last_undegraded":"2024-05-27T10:52:02.294894+0000","last_fullsized":"2024-05-27T10:52:02.294894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:16.695502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.290152+0000","last_change":"2024-05-27T10:52:01.225320+0000","last_active":"2024-05-27T10:52:02.290152+0000","last_peered":"2024-05-27T10:52:02.290152+0000","last_clean":"2024-05-27T10:52:02.290152+0000","last_became_active":"2024-05-27T10:52:01.224972+0000","last_became_peered":"2024-05-27T10:52:01.224972+0000","last_unstale":"2024-05-27T10:52:02.290152+0000","last_undegraded":"2024-05-27T10:52:02.290152+0000","last_fullsized":"2024-05-27T10:52:02.290152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:33:57.192424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.290790+0000","last_change":"2024-05-27T10:52:02.287807+0000","last_active":"2024-05-27T10:52:02.290790+0000","last_peered":"2024-05-27T10:52:02.290790+0000","last_clean":"2024-05-27T10:52:02.290790+0000","last_became_active":"2024-05-27T10:52:02.279989+0000","last_became_peered":"2024-05-27T10:52:02.279989+0000","last_unstale":"2024-05-27T10:52:02.290790+0000","last_undegraded":"2024-05-27T10:52:02.290790+0000","last_fullsized":"2024-05-27T10:52:02.290790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:44:14.946437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.250693+0000","last_change":"2024-05-27T10:52:01.232798+0000","last_active":"2024-05-27T10:52:02.250693+0000","last_peered":"2024-05-27T10:52:02.250693+0000","last_clean":"2024-05-27T10:52:02.250693+0000","last_became_active":"2024-05-27T10:52:01.232491+0000","last_became_peered":"2024-05-27T10:52:01.232491+0000","last_unstale":"2024-05-27T10:52:02.250693+0000","last_undegraded":"2024-05-27T10:52:02.250693+0000","last_fullsized":"2024-05-27T10:52:02.250693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:23:24.648014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.287169+0000","last_change":"2024-05-27T10:52:02.282343+0000","last_active":"2024-05-27T10:52:02.287169+0000","last_peered":"2024-05-27T10:52:02.287169+0000","last_clean":"2024-05-27T10:52:02.287169+0000","last_became_active":"2024-05-27T10:52:02.276307+0000","last_became_peered":"2024-05-27T10:52:02.276307+0000","last_unstale":"2024-05-27T10:52:02.287169+0000","last_undegraded":"2024-05-27T10:52:02.287169+0000","last_fullsized":"2024-05-27T10:52:02.287169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:45.783380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.262979+0000","last_change":"2024-05-27T10:51:56.473671+0000","last_active":"2024-05-27T10:52:02.262979+0000","last_peered":"2024-05-27T10:52:02.262979+0000","last_clean":"2024-05-27T10:52:02.262979+0000","last_became_active":"2024-05-27T10:51:56.470561+0000","last_became_peered":"2024-05-27T10:51:56.470561+0000","last_unstale":"2024-05-27T10:52:02.262979+0000","last_undegraded":"2024-05-27T10:52:02.262979+0000","last_fullsized":"2024-05-27T10:52:02.262979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:51:55.105404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:51:55.105404+0000","last_clean_scrub_stamp":"2024-05-27T10:51:55.105404+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:20:59.737450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.258169+0000","last_change":"2024-05-27T10:52:01.233385+0000","last_active":"2024-05-27T10:52:02.258169+0000","last_peered":"2024-05-27T10:52:02.258169+0000","last_clean":"2024-05-27T10:52:02.258169+0000","last_became_active":"2024-05-27T10:52:01.233015+0000","last_became_peered":"2024-05-27T10:52:01.233015+0000","last_unstale":"2024-05-27T10:52:02.258169+0000","last_undegraded":"2024-05-27T10:52:02.258169+0000","last_fullsized":"2024-05-27T10:52:02.258169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:48:32.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279697+0000","last_change":"2024-05-27T10:52:02.280478+0000","last_active":"2024-05-27T10:52:03.279697+0000","last_peered":"2024-05-27T10:52:03.279697+0000","last_clean":"2024-05-27T10:52:03.279697+0000","last_became_active":"2024-05-27T10:52:02.280072+0000","last_became_peered":"2024-05-27T10:52:02.280072+0000","last_unstale":"2024-05-27T10:52:03.279697+0000","last_undegraded":"2024-05-27T10:52:03.279697+0000","last_fullsized":"2024-05-27T10:52:03.279697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:16.695502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.262929+0000","last_change":"2024-05-27T10:52:01.236067+0000","last_active":"2024-05-27T10:52:02.262929+0000","last_peered":"2024-05-27T10:52:02.262929+0000","last_clean":"2024-05-27T10:52:02.262929+0000","last_became_active":"2024-05-27T10:52:01.235753+0000","last_became_peered":"2024-05-27T10:52:01.235753+0000","last_unstale":"2024-05-27T10:52:02.262929+0000","last_undegraded":"2024-05-27T10:52:02.262929+0000","last_fullsized":"2024-05-27T10:52:02.262929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:27:22.972073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.276349+0000","last_change":"2024-05-27T10:52:02.273061+0000","last_active":"2024-05-27T10:52:03.276349+0000","last_peered":"2024-05-27T10:52:03.276349+0000","last_clean":"2024-05-27T10:52:03.276349+0000","last_became_active":"2024-05-27T10:52:02.272736+0000","last_became_peered":"2024-05-27T10:52:02.272736+0000","last_unstale":"2024-05-27T10:52:03.276349+0000","last_undegraded":"2024-05-27T10:52:03.276349+0000","last_fullsized":"2024-05-27T10:52:03.276349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:09:36.642477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.250159+0000","last_change":"2024-05-27T10:52:01.226812+0000","last_active":"2024-05-27T10:52:02.250159+0000","last_peered":"2024-05-27T10:52:02.250159+0000","last_clean":"2024-05-27T10:52:02.250159+0000","last_became_active":"2024-05-27T10:52:01.226522+0000","last_became_peered":"2024-05-27T10:52:01.226522+0000","last_unstale":"2024-05-27T10:52:02.250159+0000","last_undegraded":"2024-05-27T10:52:02.250159+0000","last_fullsized":"2024-05-27T10:52:02.250159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:48:32.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.284609+0000","last_change":"2024-05-27T10:52:02.276340+0000","last_active":"2024-05-27T10:52:02.284609+0000","last_peered":"2024-05-27T10:52:02.284609+0000","last_clean":"2024-05-27T10:52:02.284609+0000","last_became_active":"2024-05-27T10:52:02.271466+0000","last_became_peered":"2024-05-27T10:52:02.271466+0000","last_unstale":"2024-05-27T10:52:02.284609+0000","last_undegraded":"2024-05-27T10:52:02.284609+0000","last_fullsized":"2024-05-27T10:52:02.284609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:09:36.642477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.258522+0000","last_change":"2024-05-27T10:52:01.235283+0000","last_active":"2024-05-27T10:52:02.258522+0000","last_peered":"2024-05-27T10:52:02.258522+0000","last_clean":"2024-05-27T10:52:02.258522+0000","last_became_active":"2024-05-27T10:52:01.233138+0000","last_became_peered":"2024-05-27T10:52:01.233138+0000","last_unstale":"2024-05-27T10:52:02.258522+0000","last_undegraded":"2024-05-27T10:52:02.258522+0000","last_fullsized":"2024-05-27T10:52:02.258522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:05.650946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.276992+0000","last_change":"2024-05-27T10:52:02.264256+0000","last_active":"2024-05-27T10:52:03.276992+0000","last_peered":"2024-05-27T10:52:03.276992+0000","last_clean":"2024-05-27T10:52:03.276992+0000","last_became_active":"2024-05-27T10:52:02.263953+0000","last_became_peered":"2024-05-27T10:52:02.263953+0000","last_unstale":"2024-05-27T10:52:03.276992+0000","last_undegraded":"2024-05-27T10:52:03.276992+0000","last_fullsized":"2024-05-27T10:52:03.276992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:15.499873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.266097+0000","last_change":"2024-05-27T10:52:01.222208+0000","last_active":"2024-05-27T10:52:02.266097+0000","last_peered":"2024-05-27T10:52:02.266097+0000","last_clean":"2024-05-27T10:52:02.266097+0000","last_became_active":"2024-05-27T10:52:01.221874+0000","last_became_peered":"2024-05-27T10:52:01.221874+0000","last_unstale":"2024-05-27T10:52:02.266097+0000","last_undegraded":"2024-05-27T10:52:02.266097+0000","last_fullsized":"2024-05-27T10:52:02.266097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:05.650946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.296003+0000","last_change":"2024-05-27T10:52:02.295182+0000","last_active":"2024-05-27T10:52:02.296003+0000","last_peered":"2024-05-27T10:52:02.296003+0000","last_clean":"2024-05-27T10:52:02.296003+0000","last_became_active":"2024-05-27T10:52:02.294854+0000","last_became_peered":"2024-05-27T10:52:02.294854+0000","last_unstale":"2024-05-27T10:52:02.296003+0000","last_undegraded":"2024-05-27T10:52:02.296003+0000","last_fullsized":"2024-05-27T10:52:02.296003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:16:52.089775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.266997+0000","last_change":"2024-05-27T10:52:01.239554+0000","last_active":"2024-05-27T10:52:02.266997+0000","last_peered":"2024-05-27T10:52:02.266997+0000","last_clean":"2024-05-27T10:52:02.266997+0000","last_became_active":"2024-05-27T10:52:01.239267+0000","last_became_peered":"2024-05-27T10:52:01.239267+0000","last_unstale":"2024-05-27T10:52:02.266997+0000","last_undegraded":"2024-05-27T10:52:02.266997+0000","last_fullsized":"2024-05-27T10:52:02.266997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:53:56.441794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.276869+0000","last_change":"2024-05-27T10:52:02.262458+0000","last_active":"2024-05-27T10:52:02.276869+0000","last_peered":"2024-05-27T10:52:02.276869+0000","last_clean":"2024-05-27T10:52:02.276869+0000","last_became_active":"2024-05-27T10:52:02.262132+0000","last_became_peered":"2024-05-27T10:52:02.262132+0000","last_unstale":"2024-05-27T10:52:02.276869+0000","last_undegraded":"2024-05-27T10:52:02.276869+0000","last_fullsized":"2024-05-27T10:52:02.276869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:23:25.652745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.268966+0000","last_change":"2024-05-27T10:52:01.236168+0000","last_active":"2024-05-27T10:52:02.268966+0000","last_peered":"2024-05-27T10:52:02.268966+0000","last_clean":"2024-05-27T10:52:02.268966+0000","last_became_active":"2024-05-27T10:52:01.235905+0000","last_became_peered":"2024-05-27T10:52:01.235905+0000","last_unstale":"2024-05-27T10:52:02.268966+0000","last_undegraded":"2024-05-27T10:52:02.268966+0000","last_fullsized":"2024-05-27T10:52:02.268966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:49:03.555502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.281064+0000","last_change":"2024-05-27T10:52:02.293533+0000","last_active":"2024-05-27T10:52:03.281064+0000","last_peered":"2024-05-27T10:52:03.281064+0000","last_clean":"2024-05-27T10:52:03.281064+0000","last_became_active":"2024-05-27T10:52:02.293231+0000","last_became_peered":"2024-05-27T10:52:02.293231+0000","last_unstale":"2024-05-27T10:52:03.281064+0000","last_undegraded":"2024-05-27T10:52:03.281064+0000","last_fullsized":"2024-05-27T10:52:03.281064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:28:35.769753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.285993+0000","last_change":"2024-05-27T10:52:01.246200+0000","last_active":"2024-05-27T10:52:02.285993+0000","last_peered":"2024-05-27T10:52:02.285993+0000","last_clean":"2024-05-27T10:52:02.285993+0000","last_became_active":"2024-05-27T10:52:01.245916+0000","last_became_peered":"2024-05-27T10:52:01.245916+0000","last_unstale":"2024-05-27T10:52:02.285993+0000","last_undegraded":"2024-05-27T10:52:02.285993+0000","last_fullsized":"2024-05-27T10:52:02.285993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:27:22.972073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.278458+0000","last_change":"2024-05-27T10:52:02.265328+0000","last_active":"2024-05-27T10:52:03.278458+0000","last_peered":"2024-05-27T10:52:03.278458+0000","last_clean":"2024-05-27T10:52:03.278458+0000","last_became_active":"2024-05-27T10:52:02.264120+0000","last_became_peered":"2024-05-27T10:52:02.264120+0000","last_unstale":"2024-05-27T10:52:03.278458+0000","last_undegraded":"2024-05-27T10:52:03.278458+0000","last_fullsized":"2024-05-27T10:52:03.278458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:16:52.089775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.258477+0000","last_change":"2024-05-27T10:52:01.238998+0000","last_active":"2024-05-27T10:52:02.258477+0000","last_peered":"2024-05-27T10:52:02.258477+0000","last_clean":"2024-05-27T10:52:02.258477+0000","last_became_active":"2024-05-27T10:52:01.238680+0000","last_became_peered":"2024-05-27T10:52:01.238680+0000","last_unstale":"2024-05-27T10:52:02.258477+0000","last_undegraded":"2024-05-27T10:52:02.258477+0000","last_fullsized":"2024-05-27T10:52:02.258477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:14.495142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277000+0000","last_change":"2024-05-27T10:52:02.269095+0000","last_active":"2024-05-27T10:52:03.277000+0000","last_peered":"2024-05-27T10:52:03.277000+0000","last_clean":"2024-05-27T10:52:03.277000+0000","last_became_active":"2024-05-27T10:52:02.267910+0000","last_became_peered":"2024-05-27T10:52:02.267910+0000","last_unstale":"2024-05-27T10:52:03.277000+0000","last_undegraded":"2024-05-27T10:52:03.277000+0000","last_fullsized":"2024-05-27T10:52:03.277000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:06.655677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.268117+0000","last_change":"2024-05-27T10:52:01.234993+0000","last_active":"2024-05-27T10:52:02.268117+0000","last_peered":"2024-05-27T10:52:02.268117+0000","last_clean":"2024-05-27T10:52:02.268117+0000","last_became_active":"2024-05-27T10:52:01.234648+0000","last_became_peered":"2024-05-27T10:52:01.234648+0000","last_unstale":"2024-05-27T10:52:02.268117+0000","last_undegraded":"2024-05-27T10:52:02.268117+0000","last_fullsized":"2024-05-27T10:52:02.268117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:27:22.972073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279043+0000","last_change":"2024-05-27T10:52:02.288778+0000","last_active":"2024-05-27T10:52:03.279043+0000","last_peered":"2024-05-27T10:52:03.279043+0000","last_clean":"2024-05-27T10:52:03.279043+0000","last_became_active":"2024-05-27T10:52:02.288403+0000","last_became_peered":"2024-05-27T10:52:02.288403+0000","last_unstale":"2024-05-27T10:52:03.279043+0000","last_undegraded":"2024-05-27T10:52:03.279043+0000","last_fullsized":"2024-05-27T10:52:03.279043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:16:52.089775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.267924+0000","last_change":"2024-05-27T10:52:01.206886+0000","last_active":"2024-05-27T10:52:02.267924+0000","last_peered":"2024-05-27T10:52:02.267924+0000","last_clean":"2024-05-27T10:52:02.267924+0000","last_became_active":"2024-05-27T10:52:01.206548+0000","last_became_peered":"2024-05-27T10:52:01.206548+0000","last_unstale":"2024-05-27T10:52:02.267924+0000","last_undegraded":"2024-05-27T10:52:02.267924+0000","last_fullsized":"2024-05-27T10:52:02.267924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:14.495142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280627+0000","last_change":"2024-05-27T10:52:02.288202+0000","last_active":"2024-05-27T10:52:03.280627+0000","last_peered":"2024-05-27T10:52:03.280627+0000","last_clean":"2024-05-27T10:52:03.280627+0000","last_became_active":"2024-05-27T10:52:02.287844+0000","last_became_peered":"2024-05-27T10:52:02.287844+0000","last_unstale":"2024-05-27T10:52:03.280627+0000","last_undegraded":"2024-05-27T10:52:03.280627+0000","last_fullsized":"2024-05-27T10:52:03.280627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:54:56.167515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.293861+0000","last_change":"2024-05-27T10:52:01.243732+0000","last_active":"2024-05-27T10:52:02.293861+0000","last_peered":"2024-05-27T10:52:02.293861+0000","last_clean":"2024-05-27T10:52:02.293861+0000","last_became_active":"2024-05-27T10:52:01.243444+0000","last_became_peered":"2024-05-27T10:52:01.243444+0000","last_unstale":"2024-05-27T10:52:02.293861+0000","last_undegraded":"2024-05-27T10:52:02.293861+0000","last_fullsized":"2024-05-27T10:52:02.293861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:33:57.192424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.281625+0000","last_change":"2024-05-27T10:52:02.270369+0000","last_active":"2024-05-27T10:52:02.281625+0000","last_peered":"2024-05-27T10:52:02.281625+0000","last_clean":"2024-05-27T10:52:02.281625+0000","last_became_active":"2024-05-27T10:52:02.270046+0000","last_became_peered":"2024-05-27T10:52:02.270046+0000","last_unstale":"2024-05-27T10:52:02.281625+0000","last_undegraded":"2024-05-27T10:52:02.281625+0000","last_fullsized":"2024-05-27T10:52:02.281625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:27:26.831178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.288288+0000","last_change":"2024-05-27T10:52:02.282074+0000","last_active":"2024-05-27T10:52:02.288288+0000","last_peered":"2024-05-27T10:52:02.288288+0000","last_clean":"2024-05-27T10:52:02.288288+0000","last_became_active":"2024-05-27T10:52:02.281820+0000","last_became_peered":"2024-05-27T10:52:02.281820+0000","last_unstale":"2024-05-27T10:52:02.288288+0000","last_undegraded":"2024-05-27T10:52:02.288288+0000","last_fullsized":"2024-05-27T10:52:02.288288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:45.783380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.291437+0000","last_change":"2024-05-27T10:52:01.246155+0000","last_active":"2024-05-27T10:52:02.291437+0000","last_peered":"2024-05-27T10:52:02.291437+0000","last_clean":"2024-05-27T10:52:02.291437+0000","last_became_active":"2024-05-27T10:52:01.245811+0000","last_became_peered":"2024-05-27T10:52:01.245811+0000","last_unstale":"2024-05-27T10:52:02.291437+0000","last_undegraded":"2024-05-27T10:52:02.291437+0000","last_fullsized":"2024-05-27T10:52:02.291437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:27:25.826446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.286994+0000","last_change":"2024-05-27T10:52:02.280894+0000","last_active":"2024-05-27T10:52:02.286994+0000","last_peered":"2024-05-27T10:52:02.286994+0000","last_clean":"2024-05-27T10:52:02.286994+0000","last_became_active":"2024-05-27T10:52:02.280424+0000","last_became_peered":"2024-05-27T10:52:02.280424+0000","last_unstale":"2024-05-27T10:52:02.286994+0000","last_undegraded":"2024-05-27T10:52:02.286994+0000","last_fullsized":"2024-05-27T10:52:02.286994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:09:36.642477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.284512+0000","last_change":"2024-05-27T10:52:01.245511+0000","last_active":"2024-05-27T10:52:02.284512+0000","last_peered":"2024-05-27T10:52:02.284512+0000","last_clean":"2024-05-27T10:52:02.284512+0000","last_became_active":"2024-05-27T10:52:01.244152+0000","last_became_peered":"2024-05-27T10:52:01.244152+0000","last_unstale":"2024-05-27T10:52:02.284512+0000","last_undegraded":"2024-05-27T10:52:02.284512+0000","last_fullsized":"2024-05-27T10:52:02.284512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:49:03.555502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279831+0000","last_change":"2024-05-27T10:52:02.267004+0000","last_active":"2024-05-27T10:52:03.279831+0000","last_peered":"2024-05-27T10:52:03.279831+0000","last_clean":"2024-05-27T10:52:03.279831+0000","last_became_active":"2024-05-27T10:52:02.266389+0000","last_became_peered":"2024-05-27T10:52:02.266389+0000","last_unstale":"2024-05-27T10:52:03.279831+0000","last_undegraded":"2024-05-27T10:52:03.279831+0000","last_fullsized":"2024-05-27T10:52:03.279831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:42:51.939151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280652+0000","last_change":"2024-05-27T10:52:01.223850+0000","last_active":"2024-05-27T10:52:03.280652+0000","last_peered":"2024-05-27T10:52:03.280652+0000","last_clean":"2024-05-27T10:52:03.280652+0000","last_became_active":"2024-05-27T10:52:01.223551+0000","last_became_peered":"2024-05-27T10:52:01.223551+0000","last_unstale":"2024-05-27T10:52:03.280652+0000","last_undegraded":"2024-05-27T10:52:03.280652+0000","last_fullsized":"2024-05-27T10:52:03.280652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:06:19.471570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280502+0000","last_change":"2024-05-27T10:52:02.291956+0000","last_active":"2024-05-27T10:52:03.280502+0000","last_peered":"2024-05-27T10:52:03.280502+0000","last_clean":"2024-05-27T10:52:03.280502+0000","last_became_active":"2024-05-27T10:52:02.291647+0000","last_became_peered":"2024-05-27T10:52:02.291647+0000","last_unstale":"2024-05-27T10:52:03.280502+0000","last_undegraded":"2024-05-27T10:52:03.280502+0000","last_fullsized":"2024-05-27T10:52:03.280502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:21:45.050385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279431+0000","last_change":"2024-05-27T10:52:01.241871+0000","last_active":"2024-05-27T10:52:03.279431+0000","last_peered":"2024-05-27T10:52:03.279431+0000","last_clean":"2024-05-27T10:52:03.279431+0000","last_became_active":"2024-05-27T10:52:01.241577+0000","last_became_peered":"2024-05-27T10:52:01.241577+0000","last_unstale":"2024-05-27T10:52:03.279431+0000","last_undegraded":"2024-05-27T10:52:03.279431+0000","last_fullsized":"2024-05-27T10:52:03.279431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:17:08.180814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":196608,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":200704,"data_stored":64794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T10:52:06.758 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T10:52:07.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.010+0000 7f2bb3e00640 1 Processor -- start 2024-05-27T10:52:07.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.010+0000 7f2bb3e00640 1 -- start start 2024-05-27T10:52:07.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.012+0000 7f2bb3e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bac06f6c0 0x7f2bac15f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:07.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.012+0000 7f2bb3e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bac06dd50 con 0x7f2bac072d40 2024-05-27T10:52:07.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.012+0000 7f2bb3e00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bac06e030 con 0x7f2bac0d0700 2024-05-27T10:52:07.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.012+0000 7f2bb3e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f2bac06e310 con 0x7f2bac06f6c0 2024-05-27T10:52:07.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.012+0000 7f2bb0a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f2bac072d40 0x7f2bac0738f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43854/0 (socket says 172.21.15.47:43854) 2024-05-27T10:52:07.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.012+0000 7f2bb0a00640 1 -- 172.21.15.47:0/2415252059 learned_addr learned my addr 172.21.15.47:0/2415252059 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:07.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.013+0000 7f2bb1400640 1 --2- 172.21.15.47:0/2415252059 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bac06f6c0 0x7f2bac15f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:07.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.013+0000 7f2babe00640 1 -- 172.21.15.47:0/2415252059 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 634860550 0 0) 0x7f2bac06dd50 con 0x7f2bac072d40 2024-05-27T10:52:07.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.013+0000 7f2babe00640 1 -- 172.21.15.47:0/2415252059 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b94003520 con 0x7f2bac072d40 2024-05-27T10:52:07.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.013+0000 7f2babe00640 1 -- 172.21.15.47:0/2415252059 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1586892496 0 0) 0x7f2b94003520 con 0x7f2bac072d40 2024-05-27T10:52:07.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.013+0000 7f2babe00640 1 -- 172.21.15.47:0/2415252059 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bac06f6c0 msgr2=0x7f2bac15f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:07.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.013+0000 7f2babe00640 1 --2- 172.21.15.47:0/2415252059 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bac06f6c0 0x7f2bac15f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.013+0000 7f2babe00640 1 -- 172.21.15.47:0/2415252059 >> v1:172.21.15.53:6789/0 conn(0x7f2bac0d0700 legacy=0x7f2bac15bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:07.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.013+0000 7f2babe00640 1 -- 172.21.15.47:0/2415252059 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bac06e5f0 con 0x7f2bac072d40 2024-05-27T10:52:07.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.013+0000 7f2babe00640 1 -- 172.21.15.47:0/2415252059 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f2b98001670 con 0x7f2bac072d40 2024-05-27T10:52:07.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.013+0000 7f2babe00640 1 -- 172.21.15.47:0/2415252059 >> v1:172.21.15.47:6789/0 conn(0x7f2bac072d40 legacy=0x7f2bac0738f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:07.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.013+0000 7f2babe00640 1 --2- 172.21.15.47:0/2415252059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b940039e0 0x7f2b94003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:07.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.013+0000 7f2babe00640 1 --2- 172.21.15.47:0/2415252059 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bac06f6c0 0x7f2b94004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:07.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.013+0000 7f2babe00640 1 --2- 172.21.15.47:0/2415252059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b94004d40 0x7f2b940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:07.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.013+0000 7f2babe00640 1 -- 172.21.15.47:0/2415252059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2bac06e310 con 0x7f2b94004d40 2024-05-27T10:52:07.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.013+0000 7f2babe00640 1 -- 172.21.15.47:0/2415252059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9400ba70 con 0x7f2b940039e0 2024-05-27T10:52:07.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.013+0000 7f2babe00640 1 -- 172.21.15.47:0/2415252059 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f2b9400de80 con 0x7f2bac06f6c0 2024-05-27T10:52:07.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.014+0000 7f2bb1e00640 1 --2- 172.21.15.47:0/2415252059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b94004d40 0x7f2b940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:07.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.014+0000 7f2bb1400640 1 --2- 172.21.15.47:0/2415252059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b940039e0 0x7f2b94003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:07.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.014+0000 7f2bb0a00640 1 --2- 172.21.15.47:0/2415252059 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bac06f6c0 0x7f2b94004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:07.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.014+0000 7f2bb1e00640 1 -- 172.21.15.47:0/2415252059 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bac06f6c0 msgr2=0x7f2b94004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:07.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.014+0000 7f2bb1e00640 1 --2- 172.21.15.47:0/2415252059 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bac06f6c0 0x7f2b94004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.014+0000 7f2bb1e00640 1 -- 172.21.15.47:0/2415252059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b940039e0 msgr2=0x7f2b94003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:07.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.014+0000 7f2bb1e00640 1 --2- 172.21.15.47:0/2415252059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b940039e0 0x7f2b94003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.014+0000 7f2bb1e00640 1 -- 172.21.15.47:0/2415252059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b94003520 con 0x7f2b94004d40 2024-05-27T10:52:07.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.014+0000 7f2bb0a00640 1 --2- 172.21.15.47:0/2415252059 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bac06f6c0 0x7f2b94004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:07.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.015+0000 7f2bb1e00640 1 --2- 172.21.15.47:0/2415252059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b94004d40 0x7f2b940051c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4001e20 tx=0x7f2b94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afbb7425b8a184c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:07.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.016+0000 7f2babe00640 1 -- 172.21.15.47:0/2415252059 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4001a70 con 0x7f2b94004d40 2024-05-27T10:52:07.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.016+0000 7f2babe00640 1 -- 172.21.15.47:0/2415252059 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba402ae40 con 0x7f2b94004d40 2024-05-27T10:52:07.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.016+0000 7f2babe00640 1 -- 172.21.15.47:0/2415252059 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4003bb0 con 0x7f2b94004d40 2024-05-27T10:52:07.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.016+0000 7f2bb3e00640 1 -- 172.21.15.47:0/2415252059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b94004d40 msgr2=0x7f2b940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:07.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.016+0000 7f2bb3e00640 1 --2- 172.21.15.47:0/2415252059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b94004d40 0x7f2b940051c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4001e20 tx=0x7f2b94005830 comp rx=0 tx=0).stop 2024-05-27T10:52:07.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.016+0000 7f2bb1e00640 1 -- 172.21.15.47:0/2415252059 reap_dead start 2024-05-27T10:52:07.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.016+0000 7f2bb3e00640 1 -- 172.21.15.47:0/2415252059 shutdown_connections 2024-05-27T10:52:07.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.016+0000 7f2bb3e00640 1 -- 172.21.15.47:0/2415252059 >> 172.21.15.47:0/2415252059 conn(0x7f2bac06bd60 msgr2=0x7f2bac06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:07.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.016+0000 7f2bb3e00640 1 -- 172.21.15.47:0/2415252059 shutdown_connections 2024-05-27T10:52:07.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.016+0000 7f2bb3e00640 1 -- 172.21.15.47:0/2415252059 wait complete. 2024-05-27T10:52:07.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.018+0000 7f2bb3e00640 1 Processor -- start 2024-05-27T10:52:07.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.018+0000 7f2bb3e00640 1 -- start start 2024-05-27T10:52:07.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.019+0000 7f2bb3e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b94004d40 0x7f2bac0cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:07.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.019+0000 7f2bb3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bac0ae3f0 0x7f2bac157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:07.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.019+0000 7f2bb3e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bac0ae870 0x7f2bac1f7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:07.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.019+0000 7f2bb3e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2bac15f1e0 con 0x7f2bac0ae3f0 2024-05-27T10:52:07.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.019+0000 7f2bb3e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2bac15f060 con 0x7f2b94004d40 2024-05-27T10:52:07.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.019+0000 7f2bb3e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f2bac15f360 con 0x7f2bac0ae870 2024-05-27T10:52:07.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.019+0000 7f2bb0a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bac0ae3f0 0x7f2bac157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:07.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.019+0000 7f2bb0a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bac0ae3f0 0x7f2bac157270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34990/0 (socket says 172.21.15.47:34990) 2024-05-27T10:52:07.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.019+0000 7f2bb0a00640 1 -- 172.21.15.47:0/4200685122 learned_addr learned my addr 172.21.15.47:0/4200685122 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:07.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.020+0000 7f2bb1400640 1 --2- 172.21.15.47:0/4200685122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b94004d40 0x7f2bac0cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:07.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.020+0000 7f2bb0a00640 1 -- 172.21.15.47:0/4200685122 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bac0ae870 msgr2=0x7f2bac1f7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:07.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.020+0000 7f2bb1e00640 1 --2- 172.21.15.47:0/4200685122 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bac0ae870 0x7f2bac1f7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:07.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.020+0000 7f2bb0a00640 1 --2- 172.21.15.47:0/4200685122 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bac0ae870 0x7f2bac1f7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.020+0000 7f2bb0a00640 1 -- 172.21.15.47:0/4200685122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b94004d40 msgr2=0x7f2bac0cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:07.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.020+0000 7f2bb0a00640 1 --2- 172.21.15.47:0/4200685122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b94004d40 0x7f2bac0cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.020+0000 7f2bb0a00640 1 -- 172.21.15.47:0/4200685122 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bac0caad0 con 0x7f2bac0ae3f0 2024-05-27T10:52:07.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.020+0000 7f2bb1400640 1 --2- 172.21.15.47:0/4200685122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b94004d40 0x7f2bac0cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:07.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.020+0000 7f2bb0a00640 1 --2- 172.21.15.47:0/4200685122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bac0ae3f0 0x7f2bac157270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2b9800d8e0 tx=0x7f2b9800dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:07.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.021+0000 7f2ba9600640 1 -- 172.21.15.47:0/4200685122 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b98019070 con 0x7f2bac0ae3f0 2024-05-27T10:52:07.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.021+0000 7f2ba9600640 1 -- 172.21.15.47:0/4200685122 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b980074e0 con 0x7f2bac0ae3f0 2024-05-27T10:52:07.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.021+0000 7f2ba9600640 1 -- 172.21.15.47:0/4200685122 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b980049e0 con 0x7f2bac0ae3f0 2024-05-27T10:52:07.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.021+0000 7f2bb3e00640 1 -- 172.21.15.47:0/4200685122 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bac0cadb0 con 0x7f2bac0ae3f0 2024-05-27T10:52:07.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.021+0000 7f2bb3e00640 1 -- 172.21.15.47:0/4200685122 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bac0cb370 con 0x7f2bac0ae3f0 2024-05-27T10:52:07.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.022+0000 7f2bb3e00640 1 -- 172.21.15.47:0/4200685122 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bac0cb7a0 con 0x7f2bac0ae3f0 2024-05-27T10:52:07.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.023+0000 7f2ba9600640 1 -- 172.21.15.47:0/4200685122 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2b98004b80 con 0x7f2bac0ae3f0 2024-05-27T10:52:07.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.024+0000 7f2ba9600640 1 --2- 172.21.15.47:0/4200685122 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2b8c06c920 0x7f2b8c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:07.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.024+0000 7f2ba9600640 1 -- 172.21.15.47:0/4200685122 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2b9808b5d0 con 0x7f2bac0ae3f0 2024-05-27T10:52:07.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.025+0000 7f2bb1400640 1 --2- 172.21.15.47:0/4200685122 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2b8c06c920 0x7f2b8c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:07.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.025+0000 7f2bb1400640 1 --2- 172.21.15.47:0/4200685122 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2b8c06c920 0x7f2b8c06ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0009a00 tx=0x7f2ba0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:07.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.029+0000 7f2ba9600640 1 -- 172.21.15.47:0/4200685122 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2b980599f0 con 0x7f2bac0ae3f0 2024-05-27T10:52:07.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.230+0000 7f2bb3e00640 1 -- 172.21.15.47:0/4200685122 --> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2bac0689e0 con 0x7f2b8c06c920 2024-05-27T10:52:07.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.237+0000 7f2ba9600640 1 -- 172.21.15.47:0/4200685122 <== mgr.4108 v2:172.21.15.47:6832/3679485934 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251902 (secure 0 0 0) 0x7f2bac0689e0 con 0x7f2b8c06c920 2024-05-27T10:52:07.238 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:07.240 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-27T10:52:07.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.243+0000 7f2bb3e00640 1 -- 172.21.15.47:0/4200685122 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2b8c06c920 msgr2=0x7f2b8c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:07.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.243+0000 7f2bb3e00640 1 --2- 172.21.15.47:0/4200685122 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2b8c06c920 0x7f2b8c06ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0009a00 tx=0x7f2ba0008040 comp rx=0 tx=0).stop 2024-05-27T10:52:07.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.243+0000 7f2bb3e00640 1 -- 172.21.15.47:0/4200685122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bac0ae3f0 msgr2=0x7f2bac157270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:07.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.243+0000 7f2bb3e00640 1 --2- 172.21.15.47:0/4200685122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bac0ae3f0 0x7f2bac157270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2b9800d8e0 tx=0x7f2b9800dda0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.244+0000 7f2bb3e00640 1 -- 172.21.15.47:0/4200685122 shutdown_connections 2024-05-27T10:52:07.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.244+0000 7f2bb3e00640 1 --2- 172.21.15.47:0/4200685122 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2b8c06c920 0x7f2b8c06ede0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.244+0000 7f2bb3e00640 1 --2- 172.21.15.47:0/4200685122 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bac0ae870 0x7f2bac1f7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.244+0000 7f2bb3e00640 1 --2- 172.21.15.47:0/4200685122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bac0ae3f0 0x7f2bac157270 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.244+0000 7f2bb3e00640 1 --2- 172.21.15.47:0/4200685122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b94004d40 0x7f2bac0cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.244+0000 7f2bb3e00640 1 -- 172.21.15.47:0/4200685122 >> 172.21.15.47:0/4200685122 conn(0x7f2bac06bd60 msgr2=0x7f2bac159490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:07.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.244+0000 7f2bb3e00640 1 -- 172.21.15.47:0/4200685122 shutdown_connections 2024-05-27T10:52:07.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.244+0000 7f2bb3e00640 1 -- 172.21.15.47:0/4200685122 wait complete. 2024-05-27T10:52:07.262 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-05-27T10:52:07.040090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252240,"kb_used_data":2764,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722480,"statfs":{"total":773094113280,"available":772835819520,"internally_reserved":0,"allocated":2830336,"data_stored":1721528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001932"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.293075+0000","last_change":"2024-05-27T10:52:02.284644+0000","last_active":"2024-05-27T10:52:02.293075+0000","last_peered":"2024-05-27T10:52:02.293075+0000","last_clean":"2024-05-27T10:52:02.293075+0000","last_became_active":"2024-05-27T10:52:02.284277+0000","last_became_peered":"2024-05-27T10:52:02.284277+0000","last_unstale":"2024-05-27T10:52:02.293075+0000","last_undegraded":"2024-05-27T10:52:02.293075+0000","last_fullsized":"2024-05-27T10:52:02.293075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:44:14.946437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.282491+0000","last_change":"2024-05-27T10:52:02.274156+0000","last_active":"2024-05-27T10:52:02.282491+0000","last_peered":"2024-05-27T10:52:02.282491+0000","last_clean":"2024-05-27T10:52:02.282491+0000","last_became_active":"2024-05-27T10:52:02.273895+0000","last_became_peered":"2024-05-27T10:52:02.273895+0000","last_unstale":"2024-05-27T10:52:02.282491+0000","last_undegraded":"2024-05-27T10:52:02.282491+0000","last_fullsized":"2024-05-27T10:52:02.282491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:53:57.446525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277856+0000","last_change":"2024-05-27T10:52:02.259214+0000","last_active":"2024-05-27T10:52:03.277856+0000","last_peered":"2024-05-27T10:52:03.277856+0000","last_clean":"2024-05-27T10:52:03.277856+0000","last_became_active":"2024-05-27T10:52:02.258890+0000","last_became_peered":"2024-05-27T10:52:02.258890+0000","last_unstale":"2024-05-27T10:52:03.277856+0000","last_undegraded":"2024-05-27T10:52:03.277856+0000","last_fullsized":"2024-05-27T10:52:03.277856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:44:14.946437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.286972+0000","last_change":"2024-05-27T10:52:02.280689+0000","last_active":"2024-05-27T10:52:02.286972+0000","last_peered":"2024-05-27T10:52:02.286972+0000","last_clean":"2024-05-27T10:52:02.286972+0000","last_became_active":"2024-05-27T10:52:02.279605+0000","last_became_peered":"2024-05-27T10:52:02.279605+0000","last_unstale":"2024-05-27T10:52:02.286972+0000","last_undegraded":"2024-05-27T10:52:02.286972+0000","last_fullsized":"2024-05-27T10:52:02.286972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:53:57.446525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.284954+0000","last_change":"2024-05-27T10:52:02.275103+0000","last_active":"2024-05-27T10:52:02.284954+0000","last_peered":"2024-05-27T10:52:02.284954+0000","last_clean":"2024-05-27T10:52:02.284954+0000","last_became_active":"2024-05-27T10:52:02.274768+0000","last_became_peered":"2024-05-27T10:52:02.274768+0000","last_unstale":"2024-05-27T10:52:02.284954+0000","last_undegraded":"2024-05-27T10:52:02.284954+0000","last_fullsized":"2024-05-27T10:52:02.284954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:09:36.642477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.285267+0000","last_change":"2024-05-27T10:52:02.275374+0000","last_active":"2024-05-27T10:52:02.285267+0000","last_peered":"2024-05-27T10:52:02.285267+0000","last_clean":"2024-05-27T10:52:02.285267+0000","last_became_active":"2024-05-27T10:52:02.270621+0000","last_became_peered":"2024-05-27T10:52:02.270621+0000","last_unstale":"2024-05-27T10:52:02.285267+0000","last_undegraded":"2024-05-27T10:52:02.285267+0000","last_fullsized":"2024-05-27T10:52:02.285267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:27:23.976804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.282363+0000","last_change":"2024-05-27T10:52:02.277391+0000","last_active":"2024-05-27T10:52:02.282363+0000","last_peered":"2024-05-27T10:52:02.282363+0000","last_clean":"2024-05-27T10:52:02.282363+0000","last_became_active":"2024-05-27T10:52:02.275623+0000","last_became_peered":"2024-05-27T10:52:02.275623+0000","last_unstale":"2024-05-27T10:52:02.282363+0000","last_undegraded":"2024-05-27T10:52:02.282363+0000","last_fullsized":"2024-05-27T10:52:02.282363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:25:10.287509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.278627+0000","last_change":"2024-05-27T10:52:02.278913+0000","last_active":"2024-05-27T10:52:03.278627+0000","last_peered":"2024-05-27T10:52:03.278627+0000","last_clean":"2024-05-27T10:52:03.278627+0000","last_became_active":"2024-05-27T10:52:02.278319+0000","last_became_peered":"2024-05-27T10:52:02.278319+0000","last_unstale":"2024-05-27T10:52:03.278627+0000","last_undegraded":"2024-05-27T10:52:03.278627+0000","last_fullsized":"2024-05-27T10:52:03.278627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:40:53.386645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.292744+0000","last_change":"2024-05-27T10:52:02.283688+0000","last_active":"2024-05-27T10:52:02.292744+0000","last_peered":"2024-05-27T10:52:02.292744+0000","last_clean":"2024-05-27T10:52:02.292744+0000","last_became_active":"2024-05-27T10:52:02.283284+0000","last_became_peered":"2024-05-27T10:52:02.283284+0000","last_unstale":"2024-05-27T10:52:02.292744+0000","last_undegraded":"2024-05-27T10:52:02.292744+0000","last_fullsized":"2024-05-27T10:52:02.292744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:40:53.386645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.282555+0000","last_change":"2024-05-27T10:52:02.272971+0000","last_active":"2024-05-27T10:52:02.282555+0000","last_peered":"2024-05-27T10:52:02.282555+0000","last_clean":"2024-05-27T10:52:02.282555+0000","last_became_active":"2024-05-27T10:52:02.272634+0000","last_became_peered":"2024-05-27T10:52:02.272634+0000","last_unstale":"2024-05-27T10:52:02.282555+0000","last_undegraded":"2024-05-27T10:52:02.282555+0000","last_fullsized":"2024-05-27T10:52:02.282555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:33:58.197155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.281542+0000","last_change":"2024-05-27T10:52:02.278290+0000","last_active":"2024-05-27T10:52:02.281542+0000","last_peered":"2024-05-27T10:52:02.281542+0000","last_clean":"2024-05-27T10:52:02.281542+0000","last_became_active":"2024-05-27T10:52:02.277971+0000","last_became_peered":"2024-05-27T10:52:02.277971+0000","last_unstale":"2024-05-27T10:52:02.281542+0000","last_undegraded":"2024-05-27T10:52:02.281542+0000","last_fullsized":"2024-05-27T10:52:02.281542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:53:57.446525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277196+0000","last_change":"2024-05-27T10:52:02.262321+0000","last_active":"2024-05-27T10:52:03.277196+0000","last_peered":"2024-05-27T10:52:03.277196+0000","last_clean":"2024-05-27T10:52:03.277196+0000","last_became_active":"2024-05-27T10:52:02.262012+0000","last_became_peered":"2024-05-27T10:52:02.262012+0000","last_unstale":"2024-05-27T10:52:03.277196+0000","last_undegraded":"2024-05-27T10:52:03.277196+0000","last_fullsized":"2024-05-27T10:52:03.277196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:27:26.831178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280146+0000","last_change":"2024-05-27T10:52:02.289470+0000","last_active":"2024-05-27T10:52:03.280146+0000","last_peered":"2024-05-27T10:52:03.280146+0000","last_clean":"2024-05-27T10:52:03.280146+0000","last_became_active":"2024-05-27T10:52:02.288616+0000","last_became_peered":"2024-05-27T10:52:02.288616+0000","last_unstale":"2024-05-27T10:52:03.280146+0000","last_undegraded":"2024-05-27T10:52:03.280146+0000","last_fullsized":"2024-05-27T10:52:03.280146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:42:51.939151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.276301+0000","last_change":"2024-05-27T10:52:02.282027+0000","last_active":"2024-05-27T10:52:03.276301+0000","last_peered":"2024-05-27T10:52:03.276301+0000","last_clean":"2024-05-27T10:52:03.276301+0000","last_became_active":"2024-05-27T10:52:02.281747+0000","last_became_peered":"2024-05-27T10:52:02.281747+0000","last_unstale":"2024-05-27T10:52:03.276301+0000","last_undegraded":"2024-05-27T10:52:03.276301+0000","last_fullsized":"2024-05-27T10:52:03.276301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:53:57.446525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.284895+0000","last_change":"2024-05-27T10:52:02.280351+0000","last_active":"2024-05-27T10:52:02.284895+0000","last_peered":"2024-05-27T10:52:02.284895+0000","last_clean":"2024-05-27T10:52:02.284895+0000","last_became_active":"2024-05-27T10:52:02.278207+0000","last_became_peered":"2024-05-27T10:52:02.278207+0000","last_unstale":"2024-05-27T10:52:02.284895+0000","last_undegraded":"2024-05-27T10:52:02.284895+0000","last_fullsized":"2024-05-27T10:52:02.284895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:25:10.287509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.287440+0000","last_change":"2024-05-27T10:52:02.280012+0000","last_active":"2024-05-27T10:52:02.287440+0000","last_peered":"2024-05-27T10:52:02.287440+0000","last_clean":"2024-05-27T10:52:02.287440+0000","last_became_active":"2024-05-27T10:52:02.279500+0000","last_became_peered":"2024-05-27T10:52:02.279500+0000","last_unstale":"2024-05-27T10:52:02.287440+0000","last_undegraded":"2024-05-27T10:52:02.287440+0000","last_fullsized":"2024-05-27T10:52:02.287440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:49:04.560234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.279818+0000","last_change":"2024-05-27T10:52:02.276006+0000","last_active":"2024-05-27T10:52:02.279818+0000","last_peered":"2024-05-27T10:52:02.279818+0000","last_clean":"2024-05-27T10:52:02.279818+0000","last_became_active":"2024-05-27T10:52:02.275602+0000","last_became_peered":"2024-05-27T10:52:02.275602+0000","last_unstale":"2024-05-27T10:52:02.279818+0000","last_undegraded":"2024-05-27T10:52:02.279818+0000","last_fullsized":"2024-05-27T10:52:02.279818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:27:26.831178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.290273+0000","last_change":"2024-05-27T10:52:02.287428+0000","last_active":"2024-05-27T10:52:02.290273+0000","last_peered":"2024-05-27T10:52:02.290273+0000","last_clean":"2024-05-27T10:52:02.290273+0000","last_became_active":"2024-05-27T10:52:02.285853+0000","last_became_peered":"2024-05-27T10:52:02.285853+0000","last_unstale":"2024-05-27T10:52:02.290273+0000","last_undegraded":"2024-05-27T10:52:02.290273+0000","last_fullsized":"2024-05-27T10:52:02.290273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:27:23.976804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.288122+0000","last_change":"2024-05-27T10:52:02.284355+0000","last_active":"2024-05-27T10:52:02.288122+0000","last_peered":"2024-05-27T10:52:02.288122+0000","last_clean":"2024-05-27T10:52:02.288122+0000","last_became_active":"2024-05-27T10:52:02.281949+0000","last_became_peered":"2024-05-27T10:52:02.281949+0000","last_unstale":"2024-05-27T10:52:02.288122+0000","last_undegraded":"2024-05-27T10:52:02.288122+0000","last_fullsized":"2024-05-27T10:52:02.288122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:49.993062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.282504+0000","last_change":"2024-05-27T10:52:02.274651+0000","last_active":"2024-05-27T10:52:02.282504+0000","last_peered":"2024-05-27T10:52:02.282504+0000","last_clean":"2024-05-27T10:52:02.282504+0000","last_became_active":"2024-05-27T10:52:02.273814+0000","last_became_peered":"2024-05-27T10:52:02.273814+0000","last_unstale":"2024-05-27T10:52:02.282504+0000","last_undegraded":"2024-05-27T10:52:02.282504+0000","last_fullsized":"2024-05-27T10:52:02.282504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:49:04.560234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.276941+0000","last_change":"2024-05-27T10:52:02.282039+0000","last_active":"2024-05-27T10:52:03.276941+0000","last_peered":"2024-05-27T10:52:03.276941+0000","last_clean":"2024-05-27T10:52:03.276941+0000","last_became_active":"2024-05-27T10:52:02.281761+0000","last_became_peered":"2024-05-27T10:52:02.281761+0000","last_unstale":"2024-05-27T10:52:03.276941+0000","last_undegraded":"2024-05-27T10:52:03.276941+0000","last_fullsized":"2024-05-27T10:52:03.276941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:45.783380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.282392+0000","last_change":"2024-05-27T10:52:02.276287+0000","last_active":"2024-05-27T10:52:02.282392+0000","last_peered":"2024-05-27T10:52:02.282392+0000","last_clean":"2024-05-27T10:52:02.282392+0000","last_became_active":"2024-05-27T10:52:02.275681+0000","last_became_peered":"2024-05-27T10:52:02.275681+0000","last_unstale":"2024-05-27T10:52:02.282392+0000","last_undegraded":"2024-05-27T10:52:02.282392+0000","last_fullsized":"2024-05-27T10:52:02.282392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:33:58.197155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.278852+0000","last_change":"2024-05-27T10:52:02.282775+0000","last_active":"2024-05-27T10:52:03.278852+0000","last_peered":"2024-05-27T10:52:03.278852+0000","last_clean":"2024-05-27T10:52:03.278852+0000","last_became_active":"2024-05-27T10:52:02.282279+0000","last_became_peered":"2024-05-27T10:52:02.282279+0000","last_unstale":"2024-05-27T10:52:03.278852+0000","last_undegraded":"2024-05-27T10:52:03.278852+0000","last_fullsized":"2024-05-27T10:52:03.278852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:44:14.946437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.287462+0000","last_change":"2024-05-27T10:52:02.281520+0000","last_active":"2024-05-27T10:52:02.287462+0000","last_peered":"2024-05-27T10:52:02.287462+0000","last_clean":"2024-05-27T10:52:02.287462+0000","last_became_active":"2024-05-27T10:52:02.281199+0000","last_became_peered":"2024-05-27T10:52:02.281199+0000","last_unstale":"2024-05-27T10:52:02.287462+0000","last_undegraded":"2024-05-27T10:52:02.287462+0000","last_fullsized":"2024-05-27T10:52:02.287462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:25:10.287509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280858+0000","last_change":"2024-05-27T10:52:02.280042+0000","last_active":"2024-05-27T10:52:03.280858+0000","last_peered":"2024-05-27T10:52:03.280858+0000","last_clean":"2024-05-27T10:52:03.280858+0000","last_became_active":"2024-05-27T10:52:02.279664+0000","last_became_peered":"2024-05-27T10:52:02.279664+0000","last_unstale":"2024-05-27T10:52:03.280858+0000","last_undegraded":"2024-05-27T10:52:03.280858+0000","last_fullsized":"2024-05-27T10:52:03.280858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:31.231464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.290913+0000","last_change":"2024-05-27T10:52:02.286086+0000","last_active":"2024-05-27T10:52:02.290913+0000","last_peered":"2024-05-27T10:52:02.290913+0000","last_clean":"2024-05-27T10:52:02.290913+0000","last_became_active":"2024-05-27T10:52:02.285764+0000","last_became_peered":"2024-05-27T10:52:02.285764+0000","last_unstale":"2024-05-27T10:52:02.290913+0000","last_undegraded":"2024-05-27T10:52:02.290913+0000","last_fullsized":"2024-05-27T10:52:02.290913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:45.783380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.293365+0000","last_change":"2024-05-27T10:52:02.291922+0000","last_active":"2024-05-27T10:52:02.293365+0000","last_peered":"2024-05-27T10:52:02.293365+0000","last_clean":"2024-05-27T10:52:02.293365+0000","last_became_active":"2024-05-27T10:52:02.291600+0000","last_became_peered":"2024-05-27T10:52:02.291600+0000","last_unstale":"2024-05-27T10:52:02.293365+0000","last_undegraded":"2024-05-27T10:52:02.293365+0000","last_fullsized":"2024-05-27T10:52:02.293365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:40:53.386645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280251+0000","last_change":"2024-05-27T10:52:02.283531+0000","last_active":"2024-05-27T10:52:03.280251+0000","last_peered":"2024-05-27T10:52:03.280251+0000","last_clean":"2024-05-27T10:52:03.280251+0000","last_became_active":"2024-05-27T10:52:02.283298+0000","last_became_peered":"2024-05-27T10:52:02.283298+0000","last_unstale":"2024-05-27T10:52:03.280251+0000","last_undegraded":"2024-05-27T10:52:03.280251+0000","last_fullsized":"2024-05-27T10:52:03.280251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:00.463147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277113+0000","last_change":"2024-05-27T10:52:02.290718+0000","last_active":"2024-05-27T10:52:03.277113+0000","last_peered":"2024-05-27T10:52:03.277113+0000","last_clean":"2024-05-27T10:52:03.277113+0000","last_became_active":"2024-05-27T10:52:02.290410+0000","last_became_peered":"2024-05-27T10:52:02.290410+0000","last_unstale":"2024-05-27T10:52:03.277113+0000","last_undegraded":"2024-05-27T10:52:03.277113+0000","last_fullsized":"2024-05-27T10:52:03.277113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:40:53.386645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.289233+0000","last_change":"2024-05-27T10:52:02.282494+0000","last_active":"2024-05-27T10:52:02.289233+0000","last_peered":"2024-05-27T10:52:02.289233+0000","last_clean":"2024-05-27T10:52:02.289233+0000","last_became_active":"2024-05-27T10:52:02.280254+0000","last_became_peered":"2024-05-27T10:52:02.280254+0000","last_unstale":"2024-05-27T10:52:02.289233+0000","last_undegraded":"2024-05-27T10:52:02.289233+0000","last_fullsized":"2024-05-27T10:52:02.289233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:49.993062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.268594+0000","last_change":"2024-05-27T10:52:02.267415+0000","last_active":"2024-05-27T10:52:02.268594+0000","last_peered":"2024-05-27T10:52:02.268594+0000","last_clean":"2024-05-27T10:52:02.268594+0000","last_became_active":"2024-05-27T10:52:02.266959+0000","last_became_peered":"2024-05-27T10:52:02.266959+0000","last_unstale":"2024-05-27T10:52:02.268594+0000","last_undegraded":"2024-05-27T10:52:02.268594+0000","last_fullsized":"2024-05-27T10:52:02.268594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:15.499873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.290810+0000","last_change":"2024-05-27T10:52:02.285006+0000","last_active":"2024-05-27T10:52:02.290810+0000","last_peered":"2024-05-27T10:52:02.290810+0000","last_clean":"2024-05-27T10:52:02.290810+0000","last_became_active":"2024-05-27T10:52:02.284596+0000","last_became_peered":"2024-05-27T10:52:02.284596+0000","last_unstale":"2024-05-27T10:52:02.290810+0000","last_undegraded":"2024-05-27T10:52:02.290810+0000","last_fullsized":"2024-05-27T10:52:02.290810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:25:10.287509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277028+0000","last_change":"2024-05-27T10:52:02.287164+0000","last_active":"2024-05-27T10:52:03.277028+0000","last_peered":"2024-05-27T10:52:03.277028+0000","last_clean":"2024-05-27T10:52:03.277028+0000","last_became_active":"2024-05-27T10:52:02.280960+0000","last_became_peered":"2024-05-27T10:52:02.280960+0000","last_unstale":"2024-05-27T10:52:03.277028+0000","last_undegraded":"2024-05-27T10:52:03.277028+0000","last_fullsized":"2024-05-27T10:52:03.277028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:27:23.976804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280920+0000","last_change":"2024-05-27T10:52:01.235575+0000","last_active":"2024-05-27T10:52:03.280920+0000","last_peered":"2024-05-27T10:52:03.280920+0000","last_clean":"2024-05-27T10:52:03.280920+0000","last_became_active":"2024-05-27T10:52:01.235262+0000","last_became_peered":"2024-05-27T10:52:01.235262+0000","last_unstale":"2024-05-27T10:52:03.280920+0000","last_undegraded":"2024-05-27T10:52:03.280920+0000","last_fullsized":"2024-05-27T10:52:03.280920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:48:32.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277302+0000","last_change":"2024-05-27T10:52:02.280538+0000","last_active":"2024-05-27T10:52:03.277302+0000","last_peered":"2024-05-27T10:52:03.277302+0000","last_clean":"2024-05-27T10:52:03.277302+0000","last_became_active":"2024-05-27T10:52:02.279400+0000","last_became_peered":"2024-05-27T10:52:02.279400+0000","last_unstale":"2024-05-27T10:52:03.277302+0000","last_undegraded":"2024-05-27T10:52:03.277302+0000","last_fullsized":"2024-05-27T10:52:03.277302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:49.993062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.281532+0000","last_change":"2024-05-27T10:52:01.237296+0000","last_active":"2024-05-27T10:52:02.281532+0000","last_peered":"2024-05-27T10:52:02.281532+0000","last_clean":"2024-05-27T10:52:02.281532+0000","last_became_active":"2024-05-27T10:52:01.236981+0000","last_became_peered":"2024-05-27T10:52:01.236981+0000","last_unstale":"2024-05-27T10:52:02.281532+0000","last_undegraded":"2024-05-27T10:52:02.281532+0000","last_fullsized":"2024-05-27T10:52:02.281532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:48:32.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279087+0000","last_change":"2024-05-27T10:52:01.228043+0000","last_active":"2024-05-27T10:52:03.279087+0000","last_peered":"2024-05-27T10:52:03.279087+0000","last_clean":"2024-05-27T10:52:03.279087+0000","last_became_active":"2024-05-27T10:52:01.227737+0000","last_became_peered":"2024-05-27T10:52:01.227737+0000","last_unstale":"2024-05-27T10:52:03.279087+0000","last_undegraded":"2024-05-27T10:52:03.279087+0000","last_fullsized":"2024-05-27T10:52:03.279087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:48:09.492465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.278823+0000","last_change":"2024-05-27T10:52:02.281578+0000","last_active":"2024-05-27T10:52:03.278823+0000","last_peered":"2024-05-27T10:52:03.278823+0000","last_clean":"2024-05-27T10:52:03.278823+0000","last_became_active":"2024-05-27T10:52:02.280978+0000","last_became_peered":"2024-05-27T10:52:02.280978+0000","last_unstale":"2024-05-27T10:52:03.278823+0000","last_undegraded":"2024-05-27T10:52:03.278823+0000","last_fullsized":"2024-05-27T10:52:03.278823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:49.993062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.258155+0000","last_change":"2024-05-27T10:52:01.248022+0000","last_active":"2024-05-27T10:52:02.258155+0000","last_peered":"2024-05-27T10:52:02.258155+0000","last_clean":"2024-05-27T10:52:02.258155+0000","last_became_active":"2024-05-27T10:52:01.244891+0000","last_became_peered":"2024-05-27T10:52:01.244891+0000","last_unstale":"2024-05-27T10:52:02.258155+0000","last_undegraded":"2024-05-27T10:52:02.258155+0000","last_fullsized":"2024-05-27T10:52:02.258155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:48:09.492465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.284910+0000","last_change":"2024-05-27T10:52:02.281087+0000","last_active":"2024-05-27T10:52:02.284910+0000","last_peered":"2024-05-27T10:52:02.284910+0000","last_clean":"2024-05-27T10:52:02.284910+0000","last_became_active":"2024-05-27T10:52:02.280786+0000","last_became_peered":"2024-05-27T10:52:02.280786+0000","last_unstale":"2024-05-27T10:52:02.284910+0000","last_undegraded":"2024-05-27T10:52:02.284910+0000","last_fullsized":"2024-05-27T10:52:02.284910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:45.783380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.261390+0000","last_change":"2024-05-27T10:52:01.245539+0000","last_active":"2024-05-27T10:52:02.261390+0000","last_peered":"2024-05-27T10:52:02.261390+0000","last_clean":"2024-05-27T10:52:02.261390+0000","last_became_active":"2024-05-27T10:52:01.245210+0000","last_became_peered":"2024-05-27T10:52:01.245210+0000","last_unstale":"2024-05-27T10:52:02.261390+0000","last_undegraded":"2024-05-27T10:52:02.261390+0000","last_fullsized":"2024-05-27T10:52:02.261390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:05.650946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.289196+0000","last_change":"2024-05-27T10:52:02.282228+0000","last_active":"2024-05-27T10:52:02.289196+0000","last_peered":"2024-05-27T10:52:02.289196+0000","last_clean":"2024-05-27T10:52:02.289196+0000","last_became_active":"2024-05-27T10:52:02.281907+0000","last_became_peered":"2024-05-27T10:52:02.281907+0000","last_unstale":"2024-05-27T10:52:02.289196+0000","last_undegraded":"2024-05-27T10:52:02.289196+0000","last_fullsized":"2024-05-27T10:52:02.289196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:40:53.386645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.261748+0000","last_change":"2024-05-27T10:52:01.243305+0000","last_active":"2024-05-27T10:52:02.261748+0000","last_peered":"2024-05-27T10:52:02.261748+0000","last_clean":"2024-05-27T10:52:02.261748+0000","last_became_active":"2024-05-27T10:52:01.242940+0000","last_became_peered":"2024-05-27T10:52:01.242940+0000","last_unstale":"2024-05-27T10:52:02.261748+0000","last_undegraded":"2024-05-27T10:52:02.261748+0000","last_fullsized":"2024-05-27T10:52:02.261748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:14.495142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279248+0000","last_change":"2024-05-27T10:52:02.267283+0000","last_active":"2024-05-27T10:52:03.279248+0000","last_peered":"2024-05-27T10:52:03.279248+0000","last_clean":"2024-05-27T10:52:03.279248+0000","last_became_active":"2024-05-27T10:52:02.266747+0000","last_became_peered":"2024-05-27T10:52:02.266747+0000","last_unstale":"2024-05-27T10:52:03.279248+0000","last_undegraded":"2024-05-27T10:52:03.279248+0000","last_fullsized":"2024-05-27T10:52:03.279248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:16.695502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.288020+0000","last_change":"2024-05-27T10:52:01.233507+0000","last_active":"2024-05-27T10:52:02.288020+0000","last_peered":"2024-05-27T10:52:02.288020+0000","last_clean":"2024-05-27T10:52:02.288020+0000","last_became_active":"2024-05-27T10:52:01.233204+0000","last_became_peered":"2024-05-27T10:52:01.233204+0000","last_unstale":"2024-05-27T10:52:02.288020+0000","last_undegraded":"2024-05-27T10:52:02.288020+0000","last_fullsized":"2024-05-27T10:52:02.288020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:27:25.826446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277331+0000","last_change":"2024-05-27T10:52:02.279589+0000","last_active":"2024-05-27T10:52:03.277331+0000","last_peered":"2024-05-27T10:52:03.277331+0000","last_clean":"2024-05-27T10:52:03.277331+0000","last_became_active":"2024-05-27T10:52:02.276985+0000","last_became_peered":"2024-05-27T10:52:02.276985+0000","last_unstale":"2024-05-27T10:52:03.277331+0000","last_undegraded":"2024-05-27T10:52:03.277331+0000","last_fullsized":"2024-05-27T10:52:03.277331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:33:58.197155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.297600+0000","last_change":"2024-05-27T10:52:01.235144+0000","last_active":"2024-05-27T10:52:02.297600+0000","last_peered":"2024-05-27T10:52:02.297600+0000","last_clean":"2024-05-27T10:52:02.297600+0000","last_became_active":"2024-05-27T10:52:01.234380+0000","last_became_peered":"2024-05-27T10:52:01.234380+0000","last_unstale":"2024-05-27T10:52:02.297600+0000","last_undegraded":"2024-05-27T10:52:02.297600+0000","last_fullsized":"2024-05-27T10:52:02.297600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:14.495142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.295321+0000","last_change":"2024-05-27T10:52:02.293987+0000","last_active":"2024-05-27T10:52:02.295321+0000","last_peered":"2024-05-27T10:52:02.295321+0000","last_clean":"2024-05-27T10:52:02.295321+0000","last_became_active":"2024-05-27T10:52:02.293646+0000","last_became_peered":"2024-05-27T10:52:02.293646+0000","last_unstale":"2024-05-27T10:52:02.295321+0000","last_undegraded":"2024-05-27T10:52:02.295321+0000","last_fullsized":"2024-05-27T10:52:02.295321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:21:45.050385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277453+0000","last_change":"2024-05-27T10:52:01.231147+0000","last_active":"2024-05-27T10:52:03.277453+0000","last_peered":"2024-05-27T10:52:03.277453+0000","last_clean":"2024-05-27T10:52:03.277453+0000","last_became_active":"2024-05-27T10:52:01.230902+0000","last_became_peered":"2024-05-27T10:52:01.230902+0000","last_unstale":"2024-05-27T10:52:03.277453+0000","last_undegraded":"2024-05-27T10:52:03.277453+0000","last_fullsized":"2024-05-27T10:52:03.277453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:29:30.495775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.276473+0000","last_change":"2024-05-27T10:52:02.260644+0000","last_active":"2024-05-27T10:52:03.276473+0000","last_peered":"2024-05-27T10:52:03.276473+0000","last_clean":"2024-05-27T10:52:03.276473+0000","last_became_active":"2024-05-27T10:52:02.260329+0000","last_became_peered":"2024-05-27T10:52:02.260329+0000","last_unstale":"2024-05-27T10:52:03.276473+0000","last_undegraded":"2024-05-27T10:52:03.276473+0000","last_fullsized":"2024-05-27T10:52:03.276473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:25:10.287509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.258317+0000","last_change":"2024-05-27T10:52:01.239325+0000","last_active":"2024-05-27T10:52:02.258317+0000","last_peered":"2024-05-27T10:52:02.258317+0000","last_clean":"2024-05-27T10:52:02.258317+0000","last_became_active":"2024-05-27T10:52:01.239049+0000","last_became_peered":"2024-05-27T10:52:01.239049+0000","last_unstale":"2024-05-27T10:52:02.258317+0000","last_undegraded":"2024-05-27T10:52:02.258317+0000","last_fullsized":"2024-05-27T10:52:02.258317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:23:24.648014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.295082+0000","last_change":"2024-05-27T10:52:02.292008+0000","last_active":"2024-05-27T10:52:02.295082+0000","last_peered":"2024-05-27T10:52:02.295082+0000","last_clean":"2024-05-27T10:52:02.295082+0000","last_became_active":"2024-05-27T10:52:02.289668+0000","last_became_peered":"2024-05-27T10:52:02.289668+0000","last_unstale":"2024-05-27T10:52:02.295082+0000","last_undegraded":"2024-05-27T10:52:02.295082+0000","last_fullsized":"2024-05-27T10:52:02.295082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:42:51.939151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.261380+0000","last_change":"2024-05-27T10:52:01.241305+0000","last_active":"2024-05-27T10:52:02.261380+0000","last_peered":"2024-05-27T10:52:02.261380+0000","last_clean":"2024-05-27T10:52:02.261380+0000","last_became_active":"2024-05-27T10:52:01.240944+0000","last_became_peered":"2024-05-27T10:52:01.240944+0000","last_unstale":"2024-05-27T10:52:02.261380+0000","last_undegraded":"2024-05-27T10:52:02.261380+0000","last_fullsized":"2024-05-27T10:52:02.261380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:23:24.648014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.287303+0000","last_change":"2024-05-27T10:52:02.283944+0000","last_active":"2024-05-27T10:52:02.287303+0000","last_peered":"2024-05-27T10:52:02.287303+0000","last_clean":"2024-05-27T10:52:02.287303+0000","last_became_active":"2024-05-27T10:52:02.283395+0000","last_became_peered":"2024-05-27T10:52:02.283395+0000","last_unstale":"2024-05-27T10:52:02.287303+0000","last_undegraded":"2024-05-27T10:52:02.287303+0000","last_fullsized":"2024-05-27T10:52:02.287303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:09:36.642477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.285433+0000","last_change":"2024-05-27T10:52:01.219153+0000","last_active":"2024-05-27T10:52:02.285433+0000","last_peered":"2024-05-27T10:52:02.285433+0000","last_clean":"2024-05-27T10:52:02.285433+0000","last_became_active":"2024-05-27T10:52:01.218818+0000","last_became_peered":"2024-05-27T10:52:01.218818+0000","last_unstale":"2024-05-27T10:52:02.285433+0000","last_undegraded":"2024-05-27T10:52:02.285433+0000","last_fullsized":"2024-05-27T10:52:02.285433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:48:09.492465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.295702+0000","last_change":"2024-05-27T10:52:02.292446+0000","last_active":"2024-05-27T10:52:02.295702+0000","last_peered":"2024-05-27T10:52:02.295702+0000","last_clean":"2024-05-27T10:52:02.295702+0000","last_became_active":"2024-05-27T10:52:02.289784+0000","last_became_peered":"2024-05-27T10:52:02.289784+0000","last_unstale":"2024-05-27T10:52:02.295702+0000","last_undegraded":"2024-05-27T10:52:02.295702+0000","last_fullsized":"2024-05-27T10:52:02.295702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:00.463147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277731+0000","last_change":"2024-05-27T10:52:01.222520+0000","last_active":"2024-05-27T10:52:03.277731+0000","last_peered":"2024-05-27T10:52:03.277731+0000","last_clean":"2024-05-27T10:52:03.277731+0000","last_became_active":"2024-05-27T10:52:01.220852+0000","last_became_peered":"2024-05-27T10:52:01.220852+0000","last_unstale":"2024-05-27T10:52:03.277731+0000","last_undegraded":"2024-05-27T10:52:03.277731+0000","last_fullsized":"2024-05-27T10:52:03.277731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:29:30.495775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.291314+0000","last_change":"2024-05-27T10:52:02.288608+0000","last_active":"2024-05-27T10:52:02.291314+0000","last_peered":"2024-05-27T10:52:02.291314+0000","last_clean":"2024-05-27T10:52:02.291314+0000","last_became_active":"2024-05-27T10:52:02.288214+0000","last_became_peered":"2024-05-27T10:52:02.288214+0000","last_unstale":"2024-05-27T10:52:02.291314+0000","last_undegraded":"2024-05-27T10:52:02.291314+0000","last_fullsized":"2024-05-27T10:52:02.291314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:16:52.089775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.276226+0000","last_change":"2024-05-27T10:52:01.225974+0000","last_active":"2024-05-27T10:52:02.276226+0000","last_peered":"2024-05-27T10:52:02.276226+0000","last_clean":"2024-05-27T10:52:02.276226+0000","last_became_active":"2024-05-27T10:52:01.225654+0000","last_became_peered":"2024-05-27T10:52:01.225654+0000","last_unstale":"2024-05-27T10:52:02.276226+0000","last_undegraded":"2024-05-27T10:52:02.276226+0000","last_fullsized":"2024-05-27T10:52:02.276226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:05.650946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.294894+0000","last_change":"2024-05-27T10:52:02.290951+0000","last_active":"2024-05-27T10:52:02.294894+0000","last_peered":"2024-05-27T10:52:02.294894+0000","last_clean":"2024-05-27T10:52:02.294894+0000","last_became_active":"2024-05-27T10:52:02.290085+0000","last_became_peered":"2024-05-27T10:52:02.290085+0000","last_unstale":"2024-05-27T10:52:02.294894+0000","last_undegraded":"2024-05-27T10:52:02.294894+0000","last_fullsized":"2024-05-27T10:52:02.294894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:16.695502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.290152+0000","last_change":"2024-05-27T10:52:01.225320+0000","last_active":"2024-05-27T10:52:02.290152+0000","last_peered":"2024-05-27T10:52:02.290152+0000","last_clean":"2024-05-27T10:52:02.290152+0000","last_became_active":"2024-05-27T10:52:01.224972+0000","last_became_peered":"2024-05-27T10:52:01.224972+0000","last_unstale":"2024-05-27T10:52:02.290152+0000","last_undegraded":"2024-05-27T10:52:02.290152+0000","last_fullsized":"2024-05-27T10:52:02.290152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:33:57.192424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.290790+0000","last_change":"2024-05-27T10:52:02.287807+0000","last_active":"2024-05-27T10:52:02.290790+0000","last_peered":"2024-05-27T10:52:02.290790+0000","last_clean":"2024-05-27T10:52:02.290790+0000","last_became_active":"2024-05-27T10:52:02.279989+0000","last_became_peered":"2024-05-27T10:52:02.279989+0000","last_unstale":"2024-05-27T10:52:02.290790+0000","last_undegraded":"2024-05-27T10:52:02.290790+0000","last_fullsized":"2024-05-27T10:52:02.290790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:44:14.946437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.250693+0000","last_change":"2024-05-27T10:52:01.232798+0000","last_active":"2024-05-27T10:52:02.250693+0000","last_peered":"2024-05-27T10:52:02.250693+0000","last_clean":"2024-05-27T10:52:02.250693+0000","last_became_active":"2024-05-27T10:52:01.232491+0000","last_became_peered":"2024-05-27T10:52:01.232491+0000","last_unstale":"2024-05-27T10:52:02.250693+0000","last_undegraded":"2024-05-27T10:52:02.250693+0000","last_fullsized":"2024-05-27T10:52:02.250693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:23:24.648014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.287169+0000","last_change":"2024-05-27T10:52:02.282343+0000","last_active":"2024-05-27T10:52:02.287169+0000","last_peered":"2024-05-27T10:52:02.287169+0000","last_clean":"2024-05-27T10:52:02.287169+0000","last_became_active":"2024-05-27T10:52:02.276307+0000","last_became_peered":"2024-05-27T10:52:02.276307+0000","last_unstale":"2024-05-27T10:52:02.287169+0000","last_undegraded":"2024-05-27T10:52:02.287169+0000","last_fullsized":"2024-05-27T10:52:02.287169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:45.783380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.262979+0000","last_change":"2024-05-27T10:51:56.473671+0000","last_active":"2024-05-27T10:52:02.262979+0000","last_peered":"2024-05-27T10:52:02.262979+0000","last_clean":"2024-05-27T10:52:02.262979+0000","last_became_active":"2024-05-27T10:51:56.470561+0000","last_became_peered":"2024-05-27T10:51:56.470561+0000","last_unstale":"2024-05-27T10:52:02.262979+0000","last_undegraded":"2024-05-27T10:52:02.262979+0000","last_fullsized":"2024-05-27T10:52:02.262979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:51:55.105404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:51:55.105404+0000","last_clean_scrub_stamp":"2024-05-27T10:51:55.105404+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:20:59.737450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.258169+0000","last_change":"2024-05-27T10:52:01.233385+0000","last_active":"2024-05-27T10:52:02.258169+0000","last_peered":"2024-05-27T10:52:02.258169+0000","last_clean":"2024-05-27T10:52:02.258169+0000","last_became_active":"2024-05-27T10:52:01.233015+0000","last_became_peered":"2024-05-27T10:52:01.233015+0000","last_unstale":"2024-05-27T10:52:02.258169+0000","last_undegraded":"2024-05-27T10:52:02.258169+0000","last_fullsized":"2024-05-27T10:52:02.258169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:48:32.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279697+0000","last_change":"2024-05-27T10:52:02.280478+0000","last_active":"2024-05-27T10:52:03.279697+0000","last_peered":"2024-05-27T10:52:03.279697+0000","last_clean":"2024-05-27T10:52:03.279697+0000","last_became_active":"2024-05-27T10:52:02.280072+0000","last_became_peered":"2024-05-27T10:52:02.280072+0000","last_unstale":"2024-05-27T10:52:03.279697+0000","last_undegraded":"2024-05-27T10:52:03.279697+0000","last_fullsized":"2024-05-27T10:52:03.279697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:16.695502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.262929+0000","last_change":"2024-05-27T10:52:01.236067+0000","last_active":"2024-05-27T10:52:02.262929+0000","last_peered":"2024-05-27T10:52:02.262929+0000","last_clean":"2024-05-27T10:52:02.262929+0000","last_became_active":"2024-05-27T10:52:01.235753+0000","last_became_peered":"2024-05-27T10:52:01.235753+0000","last_unstale":"2024-05-27T10:52:02.262929+0000","last_undegraded":"2024-05-27T10:52:02.262929+0000","last_fullsized":"2024-05-27T10:52:02.262929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:27:22.972073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.276349+0000","last_change":"2024-05-27T10:52:02.273061+0000","last_active":"2024-05-27T10:52:03.276349+0000","last_peered":"2024-05-27T10:52:03.276349+0000","last_clean":"2024-05-27T10:52:03.276349+0000","last_became_active":"2024-05-27T10:52:02.272736+0000","last_became_peered":"2024-05-27T10:52:02.272736+0000","last_unstale":"2024-05-27T10:52:03.276349+0000","last_undegraded":"2024-05-27T10:52:03.276349+0000","last_fullsized":"2024-05-27T10:52:03.276349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:09:36.642477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.250159+0000","last_change":"2024-05-27T10:52:01.226812+0000","last_active":"2024-05-27T10:52:02.250159+0000","last_peered":"2024-05-27T10:52:02.250159+0000","last_clean":"2024-05-27T10:52:02.250159+0000","last_became_active":"2024-05-27T10:52:01.226522+0000","last_became_peered":"2024-05-27T10:52:01.226522+0000","last_unstale":"2024-05-27T10:52:02.250159+0000","last_undegraded":"2024-05-27T10:52:02.250159+0000","last_fullsized":"2024-05-27T10:52:02.250159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:48:32.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.284609+0000","last_change":"2024-05-27T10:52:02.276340+0000","last_active":"2024-05-27T10:52:02.284609+0000","last_peered":"2024-05-27T10:52:02.284609+0000","last_clean":"2024-05-27T10:52:02.284609+0000","last_became_active":"2024-05-27T10:52:02.271466+0000","last_became_peered":"2024-05-27T10:52:02.271466+0000","last_unstale":"2024-05-27T10:52:02.284609+0000","last_undegraded":"2024-05-27T10:52:02.284609+0000","last_fullsized":"2024-05-27T10:52:02.284609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:09:36.642477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.258522+0000","last_change":"2024-05-27T10:52:01.235283+0000","last_active":"2024-05-27T10:52:02.258522+0000","last_peered":"2024-05-27T10:52:02.258522+0000","last_clean":"2024-05-27T10:52:02.258522+0000","last_became_active":"2024-05-27T10:52:01.233138+0000","last_became_peered":"2024-05-27T10:52:01.233138+0000","last_unstale":"2024-05-27T10:52:02.258522+0000","last_undegraded":"2024-05-27T10:52:02.258522+0000","last_fullsized":"2024-05-27T10:52:02.258522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:05.650946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.276992+0000","last_change":"2024-05-27T10:52:02.264256+0000","last_active":"2024-05-27T10:52:03.276992+0000","last_peered":"2024-05-27T10:52:03.276992+0000","last_clean":"2024-05-27T10:52:03.276992+0000","last_became_active":"2024-05-27T10:52:02.263953+0000","last_became_peered":"2024-05-27T10:52:02.263953+0000","last_unstale":"2024-05-27T10:52:03.276992+0000","last_undegraded":"2024-05-27T10:52:03.276992+0000","last_fullsized":"2024-05-27T10:52:03.276992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:15.499873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.266097+0000","last_change":"2024-05-27T10:52:01.222208+0000","last_active":"2024-05-27T10:52:02.266097+0000","last_peered":"2024-05-27T10:52:02.266097+0000","last_clean":"2024-05-27T10:52:02.266097+0000","last_became_active":"2024-05-27T10:52:01.221874+0000","last_became_peered":"2024-05-27T10:52:01.221874+0000","last_unstale":"2024-05-27T10:52:02.266097+0000","last_undegraded":"2024-05-27T10:52:02.266097+0000","last_fullsized":"2024-05-27T10:52:02.266097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:05.650946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.296003+0000","last_change":"2024-05-27T10:52:02.295182+0000","last_active":"2024-05-27T10:52:02.296003+0000","last_peered":"2024-05-27T10:52:02.296003+0000","last_clean":"2024-05-27T10:52:02.296003+0000","last_became_active":"2024-05-27T10:52:02.294854+0000","last_became_peered":"2024-05-27T10:52:02.294854+0000","last_unstale":"2024-05-27T10:52:02.296003+0000","last_undegraded":"2024-05-27T10:52:02.296003+0000","last_fullsized":"2024-05-27T10:52:02.296003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:16:52.089775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.266997+0000","last_change":"2024-05-27T10:52:01.239554+0000","last_active":"2024-05-27T10:52:02.266997+0000","last_peered":"2024-05-27T10:52:02.266997+0000","last_clean":"2024-05-27T10:52:02.266997+0000","last_became_active":"2024-05-27T10:52:01.239267+0000","last_became_peered":"2024-05-27T10:52:01.239267+0000","last_unstale":"2024-05-27T10:52:02.266997+0000","last_undegraded":"2024-05-27T10:52:02.266997+0000","last_fullsized":"2024-05-27T10:52:02.266997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:53:56.441794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.276869+0000","last_change":"2024-05-27T10:52:02.262458+0000","last_active":"2024-05-27T10:52:02.276869+0000","last_peered":"2024-05-27T10:52:02.276869+0000","last_clean":"2024-05-27T10:52:02.276869+0000","last_became_active":"2024-05-27T10:52:02.262132+0000","last_became_peered":"2024-05-27T10:52:02.262132+0000","last_unstale":"2024-05-27T10:52:02.276869+0000","last_undegraded":"2024-05-27T10:52:02.276869+0000","last_fullsized":"2024-05-27T10:52:02.276869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:23:25.652745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.268966+0000","last_change":"2024-05-27T10:52:01.236168+0000","last_active":"2024-05-27T10:52:02.268966+0000","last_peered":"2024-05-27T10:52:02.268966+0000","last_clean":"2024-05-27T10:52:02.268966+0000","last_became_active":"2024-05-27T10:52:01.235905+0000","last_became_peered":"2024-05-27T10:52:01.235905+0000","last_unstale":"2024-05-27T10:52:02.268966+0000","last_undegraded":"2024-05-27T10:52:02.268966+0000","last_fullsized":"2024-05-27T10:52:02.268966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:49:03.555502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.281064+0000","last_change":"2024-05-27T10:52:02.293533+0000","last_active":"2024-05-27T10:52:03.281064+0000","last_peered":"2024-05-27T10:52:03.281064+0000","last_clean":"2024-05-27T10:52:03.281064+0000","last_became_active":"2024-05-27T10:52:02.293231+0000","last_became_peered":"2024-05-27T10:52:02.293231+0000","last_unstale":"2024-05-27T10:52:03.281064+0000","last_undegraded":"2024-05-27T10:52:03.281064+0000","last_fullsized":"2024-05-27T10:52:03.281064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:28:35.769753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.285993+0000","last_change":"2024-05-27T10:52:01.246200+0000","last_active":"2024-05-27T10:52:02.285993+0000","last_peered":"2024-05-27T10:52:02.285993+0000","last_clean":"2024-05-27T10:52:02.285993+0000","last_became_active":"2024-05-27T10:52:01.245916+0000","last_became_peered":"2024-05-27T10:52:01.245916+0000","last_unstale":"2024-05-27T10:52:02.285993+0000","last_undegraded":"2024-05-27T10:52:02.285993+0000","last_fullsized":"2024-05-27T10:52:02.285993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:27:22.972073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.278458+0000","last_change":"2024-05-27T10:52:02.265328+0000","last_active":"2024-05-27T10:52:03.278458+0000","last_peered":"2024-05-27T10:52:03.278458+0000","last_clean":"2024-05-27T10:52:03.278458+0000","last_became_active":"2024-05-27T10:52:02.264120+0000","last_became_peered":"2024-05-27T10:52:02.264120+0000","last_unstale":"2024-05-27T10:52:03.278458+0000","last_undegraded":"2024-05-27T10:52:03.278458+0000","last_fullsized":"2024-05-27T10:52:03.278458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:16:52.089775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.258477+0000","last_change":"2024-05-27T10:52:01.238998+0000","last_active":"2024-05-27T10:52:02.258477+0000","last_peered":"2024-05-27T10:52:02.258477+0000","last_clean":"2024-05-27T10:52:02.258477+0000","last_became_active":"2024-05-27T10:52:01.238680+0000","last_became_peered":"2024-05-27T10:52:01.238680+0000","last_unstale":"2024-05-27T10:52:02.258477+0000","last_undegraded":"2024-05-27T10:52:02.258477+0000","last_fullsized":"2024-05-27T10:52:02.258477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:14.495142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277000+0000","last_change":"2024-05-27T10:52:02.269095+0000","last_active":"2024-05-27T10:52:03.277000+0000","last_peered":"2024-05-27T10:52:03.277000+0000","last_clean":"2024-05-27T10:52:03.277000+0000","last_became_active":"2024-05-27T10:52:02.267910+0000","last_became_peered":"2024-05-27T10:52:02.267910+0000","last_unstale":"2024-05-27T10:52:03.277000+0000","last_undegraded":"2024-05-27T10:52:03.277000+0000","last_fullsized":"2024-05-27T10:52:03.277000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:06.655677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.268117+0000","last_change":"2024-05-27T10:52:01.234993+0000","last_active":"2024-05-27T10:52:02.268117+0000","last_peered":"2024-05-27T10:52:02.268117+0000","last_clean":"2024-05-27T10:52:02.268117+0000","last_became_active":"2024-05-27T10:52:01.234648+0000","last_became_peered":"2024-05-27T10:52:01.234648+0000","last_unstale":"2024-05-27T10:52:02.268117+0000","last_undegraded":"2024-05-27T10:52:02.268117+0000","last_fullsized":"2024-05-27T10:52:02.268117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:27:22.972073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279043+0000","last_change":"2024-05-27T10:52:02.288778+0000","last_active":"2024-05-27T10:52:03.279043+0000","last_peered":"2024-05-27T10:52:03.279043+0000","last_clean":"2024-05-27T10:52:03.279043+0000","last_became_active":"2024-05-27T10:52:02.288403+0000","last_became_peered":"2024-05-27T10:52:02.288403+0000","last_unstale":"2024-05-27T10:52:03.279043+0000","last_undegraded":"2024-05-27T10:52:03.279043+0000","last_fullsized":"2024-05-27T10:52:03.279043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:16:52.089775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.267924+0000","last_change":"2024-05-27T10:52:01.206886+0000","last_active":"2024-05-27T10:52:02.267924+0000","last_peered":"2024-05-27T10:52:02.267924+0000","last_clean":"2024-05-27T10:52:02.267924+0000","last_became_active":"2024-05-27T10:52:01.206548+0000","last_became_peered":"2024-05-27T10:52:01.206548+0000","last_unstale":"2024-05-27T10:52:02.267924+0000","last_undegraded":"2024-05-27T10:52:02.267924+0000","last_fullsized":"2024-05-27T10:52:02.267924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:14.495142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280627+0000","last_change":"2024-05-27T10:52:02.288202+0000","last_active":"2024-05-27T10:52:03.280627+0000","last_peered":"2024-05-27T10:52:03.280627+0000","last_clean":"2024-05-27T10:52:03.280627+0000","last_became_active":"2024-05-27T10:52:02.287844+0000","last_became_peered":"2024-05-27T10:52:02.287844+0000","last_unstale":"2024-05-27T10:52:03.280627+0000","last_undegraded":"2024-05-27T10:52:03.280627+0000","last_fullsized":"2024-05-27T10:52:03.280627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:54:56.167515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.293861+0000","last_change":"2024-05-27T10:52:01.243732+0000","last_active":"2024-05-27T10:52:02.293861+0000","last_peered":"2024-05-27T10:52:02.293861+0000","last_clean":"2024-05-27T10:52:02.293861+0000","last_became_active":"2024-05-27T10:52:01.243444+0000","last_became_peered":"2024-05-27T10:52:01.243444+0000","last_unstale":"2024-05-27T10:52:02.293861+0000","last_undegraded":"2024-05-27T10:52:02.293861+0000","last_fullsized":"2024-05-27T10:52:02.293861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:33:57.192424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.281625+0000","last_change":"2024-05-27T10:52:02.270369+0000","last_active":"2024-05-27T10:52:02.281625+0000","last_peered":"2024-05-27T10:52:02.281625+0000","last_clean":"2024-05-27T10:52:02.281625+0000","last_became_active":"2024-05-27T10:52:02.270046+0000","last_became_peered":"2024-05-27T10:52:02.270046+0000","last_unstale":"2024-05-27T10:52:02.281625+0000","last_undegraded":"2024-05-27T10:52:02.281625+0000","last_fullsized":"2024-05-27T10:52:02.281625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:27:26.831178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.288288+0000","last_change":"2024-05-27T10:52:02.282074+0000","last_active":"2024-05-27T10:52:02.288288+0000","last_peered":"2024-05-27T10:52:02.288288+0000","last_clean":"2024-05-27T10:52:02.288288+0000","last_became_active":"2024-05-27T10:52:02.281820+0000","last_became_peered":"2024-05-27T10:52:02.281820+0000","last_unstale":"2024-05-27T10:52:02.288288+0000","last_undegraded":"2024-05-27T10:52:02.288288+0000","last_fullsized":"2024-05-27T10:52:02.288288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:45.783380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.291437+0000","last_change":"2024-05-27T10:52:01.246155+0000","last_active":"2024-05-27T10:52:02.291437+0000","last_peered":"2024-05-27T10:52:02.291437+0000","last_clean":"2024-05-27T10:52:02.291437+0000","last_became_active":"2024-05-27T10:52:01.245811+0000","last_became_peered":"2024-05-27T10:52:01.245811+0000","last_unstale":"2024-05-27T10:52:02.291437+0000","last_undegraded":"2024-05-27T10:52:02.291437+0000","last_fullsized":"2024-05-27T10:52:02.291437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:27:25.826446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.286994+0000","last_change":"2024-05-27T10:52:02.280894+0000","last_active":"2024-05-27T10:52:02.286994+0000","last_peered":"2024-05-27T10:52:02.286994+0000","last_clean":"2024-05-27T10:52:02.286994+0000","last_became_active":"2024-05-27T10:52:02.280424+0000","last_became_peered":"2024-05-27T10:52:02.280424+0000","last_unstale":"2024-05-27T10:52:02.286994+0000","last_undegraded":"2024-05-27T10:52:02.286994+0000","last_fullsized":"2024-05-27T10:52:02.286994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:09:36.642477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-27T10:52:02.284512+0000","last_change":"2024-05-27T10:52:01.245511+0000","last_active":"2024-05-27T10:52:02.284512+0000","last_peered":"2024-05-27T10:52:02.284512+0000","last_clean":"2024-05-27T10:52:02.284512+0000","last_became_active":"2024-05-27T10:52:01.244152+0000","last_became_peered":"2024-05-27T10:52:01.244152+0000","last_unstale":"2024-05-27T10:52:02.284512+0000","last_undegraded":"2024-05-27T10:52:02.284512+0000","last_fullsized":"2024-05-27T10:52:02.284512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:49:03.555502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279831+0000","last_change":"2024-05-27T10:52:02.267004+0000","last_active":"2024-05-27T10:52:03.279831+0000","last_peered":"2024-05-27T10:52:03.279831+0000","last_clean":"2024-05-27T10:52:03.279831+0000","last_became_active":"2024-05-27T10:52:02.266389+0000","last_became_peered":"2024-05-27T10:52:02.266389+0000","last_unstale":"2024-05-27T10:52:03.279831+0000","last_undegraded":"2024-05-27T10:52:03.279831+0000","last_fullsized":"2024-05-27T10:52:03.279831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:42:51.939151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280652+0000","last_change":"2024-05-27T10:52:01.223850+0000","last_active":"2024-05-27T10:52:03.280652+0000","last_peered":"2024-05-27T10:52:03.280652+0000","last_clean":"2024-05-27T10:52:03.280652+0000","last_became_active":"2024-05-27T10:52:01.223551+0000","last_became_peered":"2024-05-27T10:52:01.223551+0000","last_unstale":"2024-05-27T10:52:03.280652+0000","last_undegraded":"2024-05-27T10:52:03.280652+0000","last_fullsized":"2024-05-27T10:52:03.280652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:06:19.471570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280502+0000","last_change":"2024-05-27T10:52:02.291956+0000","last_active":"2024-05-27T10:52:03.280502+0000","last_peered":"2024-05-27T10:52:03.280502+0000","last_clean":"2024-05-27T10:52:03.280502+0000","last_became_active":"2024-05-27T10:52:02.291647+0000","last_became_peered":"2024-05-27T10:52:02.291647+0000","last_unstale":"2024-05-27T10:52:03.280502+0000","last_undegraded":"2024-05-27T10:52:03.280502+0000","last_fullsized":"2024-05-27T10:52:03.280502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:21:45.050385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279431+0000","last_change":"2024-05-27T10:52:01.241871+0000","last_active":"2024-05-27T10:52:03.279431+0000","last_peered":"2024-05-27T10:52:03.279431+0000","last_clean":"2024-05-27T10:52:03.279431+0000","last_became_active":"2024-05-27T10:52:01.241577+0000","last_became_peered":"2024-05-27T10:52:01.241577+0000","last_unstale":"2024-05-27T10:52:03.279431+0000","last_undegraded":"2024-05-27T10:52:03.279431+0000","last_fullsized":"2024-05-27T10:52:03.279431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:17:08.180814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":196608,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":200704,"data_stored":64794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T10:52:07.266 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-27T10:52:07.267 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-27T10:52:07.267 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-27T10:52:07.267 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-27T10:52:07.268 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-27T10:52:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.519+0000 7fddaa400640 1 Processor -- start 2024-05-27T10:52:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.519+0000 7fddaa400640 1 -- start start 2024-05-27T10:52:07.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.520+0000 7fddaa400640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdda40af7b0 0x7fdda41670e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:07.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.520+0000 7fddaa400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda415cde0 con 0x7fdda4156c00 2024-05-27T10:52:07.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.521+0000 7fddaa400640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda415d0c0 con 0x7fdda40d0e10 2024-05-27T10:52:07.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.521+0000 7fddaa400640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fdda40afbf0 con 0x7fdda40af7b0 2024-05-27T10:52:07.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.521+0000 7fdda3400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fdda4156c00 0x7fdda40d0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43866/0 (socket says 172.21.15.47:43866) 2024-05-27T10:52:07.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.521+0000 7fdda3400640 1 -- 172.21.15.47:0/4168969076 learned_addr learned my addr 172.21.15.47:0/4168969076 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.521+0000 7fdda3e00640 1 --2- 172.21.15.47:0/4168969076 >> v2:172.21.15.53:3300/0 conn(0x7fdda40af7b0 0x7fdda41670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.521+0000 7fdda2000640 1 -- 172.21.15.47:0/4168969076 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 734162758 0 0) 0x7fdda415cde0 con 0x7fdda4156c00 2024-05-27T10:52:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.521+0000 7fdda2000640 1 -- 172.21.15.47:0/4168969076 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd88003520 con 0x7fdda4156c00 2024-05-27T10:52:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.522+0000 7fdda2000640 1 -- 172.21.15.47:0/4168969076 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2676759970 0 0) 0x7fdd88003520 con 0x7fdda4156c00 2024-05-27T10:52:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.522+0000 7fdda2000640 1 -- 172.21.15.47:0/4168969076 >> v2:172.21.15.53:3300/0 conn(0x7fdda40af7b0 msgr2=0x7fdda41670e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.522+0000 7fdda2000640 1 --2- 172.21.15.47:0/4168969076 >> v2:172.21.15.53:3300/0 conn(0x7fdda40af7b0 0x7fdda41670e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.522+0000 7fdda2000640 1 -- 172.21.15.47:0/4168969076 >> v1:172.21.15.53:6789/0 conn(0x7fdda40d0e10 legacy=0x7fdda40af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.522+0000 7fdda2000640 1 -- 172.21.15.47:0/4168969076 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda415d3a0 con 0x7fdda4156c00 2024-05-27T10:52:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.522+0000 7fdda2000640 1 -- 172.21.15.47:0/4168969076 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7fdd940019f0 con 0x7fdda4156c00 2024-05-27T10:52:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.522+0000 7fdda2000640 1 -- 172.21.15.47:0/4168969076 >> v1:172.21.15.47:6789/0 conn(0x7fdda4156c00 legacy=0x7fdda40d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.522+0000 7fdda2000640 1 --2- 172.21.15.47:0/4168969076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd88003a00 0x7fdd88003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.522+0000 7fdda2000640 1 --2- 172.21.15.47:0/4168969076 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdd88004800 0x7fdd88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.522+0000 7fdda2000640 1 --2- 172.21.15.47:0/4168969076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd88005210 0x7fdd8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.522+0000 7fdda2000640 1 -- 172.21.15.47:0/4168969076 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8800c130 con 0x7fdd88005210 2024-05-27T10:52:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.522+0000 7fdda2000640 1 -- 172.21.15.47:0/4168969076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8800c2e0 con 0x7fdd88003a00 2024-05-27T10:52:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.522+0000 7fdda2000640 1 -- 172.21.15.47:0/4168969076 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fdd8800c4e0 con 0x7fdd88004800 2024-05-27T10:52:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.522+0000 7fdda3e00640 1 --2- 172.21.15.47:0/4168969076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd88005210 0x7fdd8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.522+0000 7fdda2a00640 1 --2- 172.21.15.47:0/4168969076 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdd88004800 0x7fdd88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.523+0000 7fdda3400640 1 --2- 172.21.15.47:0/4168969076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd88003a00 0x7fdd88003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.523+0000 7fdda3e00640 1 -- 172.21.15.47:0/4168969076 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdd88004800 msgr2=0x7fdd88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.523+0000 7fdda3e00640 1 --2- 172.21.15.47:0/4168969076 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdd88004800 0x7fdd88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.523+0000 7fdda3e00640 1 -- 172.21.15.47:0/4168969076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd88003a00 msgr2=0x7fdd88003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.523+0000 7fdda3e00640 1 --2- 172.21.15.47:0/4168969076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd88003a00 0x7fdd88003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.523+0000 7fdda3e00640 1 -- 172.21.15.47:0/4168969076 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd88003520 con 0x7fdd88005210 2024-05-27T10:52:07.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.524+0000 7fdda3e00640 1 -- 172.21.15.47:0/4168969076 reap_dead start 2024-05-27T10:52:07.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.524+0000 7fdda3e00640 1 --2- 172.21.15.47:0/4168969076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd88005210 0x7fdd8800b9c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00ba30 tx=0x7fdd88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6d4d8e724bb6d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:07.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.524+0000 7fdda2000640 1 -- 172.21.15.47:0/4168969076 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c030070 con 0x7fdd88005210 2024-05-27T10:52:07.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.525+0000 7fdda2000640 1 -- 172.21.15.47:0/4168969076 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd9c02ae50 con 0x7fdd88005210 2024-05-27T10:52:07.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.525+0000 7fdda2000640 1 -- 172.21.15.47:0/4168969076 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c00b600 con 0x7fdd88005210 2024-05-27T10:52:07.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.525+0000 7fddaa400640 1 -- 172.21.15.47:0/4168969076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd88005210 msgr2=0x7fdd8800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:07.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.525+0000 7fddaa400640 1 --2- 172.21.15.47:0/4168969076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd88005210 0x7fdd8800b9c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00ba30 tx=0x7fdd88005830 comp rx=0 tx=0).stop 2024-05-27T10:52:07.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.525+0000 7fddaa400640 1 -- 172.21.15.47:0/4168969076 shutdown_connections 2024-05-27T10:52:07.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.525+0000 7fddaa400640 1 --2- 172.21.15.47:0/4168969076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd88005210 0x7fdd8800b9c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.525+0000 7fddaa400640 1 -- 172.21.15.47:0/4168969076 >> 172.21.15.47:0/4168969076 conn(0x7fdda406bd60 msgr2=0x7fdda406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:07.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.525+0000 7fddaa400640 1 -- 172.21.15.47:0/4168969076 shutdown_connections 2024-05-27T10:52:07.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.525+0000 7fddaa400640 1 -- 172.21.15.47:0/4168969076 wait complete. 2024-05-27T10:52:07.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.527+0000 7fddaa400640 1 Processor -- start 2024-05-27T10:52:07.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.527+0000 7fddaa400640 1 -- start start 2024-05-27T10:52:07.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.528+0000 7fddaa400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdd88005210 0x7fdda414cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:07.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.528+0000 7fddaa400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdda409c1d0 0x7fdda409c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:07.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.528+0000 7fddaa400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda4072ce0 0x7fdda4073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:07.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.528+0000 7fddaa400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdda406dcb0 con 0x7fdda409c1d0 2024-05-27T10:52:07.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.528+0000 7fddaa400640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdda415d710 con 0x7fdda4072ce0 2024-05-27T10:52:07.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.528+0000 7fddaa400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fdda406de30 con 0x7fdd88005210 2024-05-27T10:52:07.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.528+0000 7fdda2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdda409c1d0 0x7fdda409c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:07.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.529+0000 7fdda2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdda409c1d0 0x7fdda409c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35014/0 (socket says 172.21.15.47:35014) 2024-05-27T10:52:07.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.529+0000 7fdda2a00640 1 -- 172.21.15.47:0/1198360589 learned_addr learned my addr 172.21.15.47:0/1198360589 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:07.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.529+0000 7fdda3400640 1 --2- 172.21.15.47:0/1198360589 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdd88005210 0x7fdda414cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:07.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.529+0000 7fdda3e00640 1 --2- 172.21.15.47:0/1198360589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda4072ce0 0x7fdda4073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:07.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.529+0000 7fdda2a00640 1 -- 172.21.15.47:0/1198360589 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdd88005210 msgr2=0x7fdda414cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:07.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.529+0000 7fdda2a00640 1 --2- 172.21.15.47:0/1198360589 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdd88005210 0x7fdda414cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.529+0000 7fdda2a00640 1 -- 172.21.15.47:0/1198360589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda4072ce0 msgr2=0x7fdda4073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:07.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.529+0000 7fdda2a00640 1 --2- 172.21.15.47:0/1198360589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda4072ce0 0x7fdda4073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.529+0000 7fdda2a00640 1 -- 172.21.15.47:0/1198360589 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda409a660 con 0x7fdda409c1d0 2024-05-27T10:52:07.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.529+0000 7fdda2a00640 1 --2- 172.21.15.47:0/1198360589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdda409c1d0 0x7fdda409c650 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00e530 tx=0x7fdd8c00e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:07.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.529+0000 7fdd9b400640 1 -- 172.21.15.47:0/1198360589 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0052e0 con 0x7fdda409c1d0 2024-05-27T10:52:07.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.530+0000 7fdd9b400640 1 -- 172.21.15.47:0/1198360589 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd8c018070 con 0x7fdda409c1d0 2024-05-27T10:52:07.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.530+0000 7fdd9b400640 1 -- 172.21.15.47:0/1198360589 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c003810 con 0x7fdda409c1d0 2024-05-27T10:52:07.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.530+0000 7fddaa400640 1 -- 172.21.15.47:0/1198360589 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda409a940 con 0x7fdda409c1d0 2024-05-27T10:52:07.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.530+0000 7fddaa400640 1 -- 172.21.15.47:0/1198360589 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda409af00 con 0x7fdda409c1d0 2024-05-27T10:52:07.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.531+0000 7fddaa400640 1 -- 172.21.15.47:0/1198360589 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda40689e0 con 0x7fdda409c1d0 2024-05-27T10:52:07.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.532+0000 7fdd9b400640 1 -- 172.21.15.47:0/1198360589 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdd8c0039b0 con 0x7fdda409c1d0 2024-05-27T10:52:07.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.533+0000 7fdd9b400640 1 --2- 172.21.15.47:0/1198360589 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdd8006c8f0 0x7fdd8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:07.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.533+0000 7fdd9b400640 1 -- 172.21.15.47:0/1198360589 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdd8c08b810 con 0x7fdda409c1d0 2024-05-27T10:52:07.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.533+0000 7fdda3400640 1 --2- 172.21.15.47:0/1198360589 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdd8006c8f0 0x7fdd8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:07.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.534+0000 7fdda3400640 1 --2- 172.21.15.47:0/1198360589 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdd8006c8f0 0x7fdd8006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdd940013d0 tx=0x7fdd94009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:07.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.537+0000 7fdd9b400640 1 -- 172.21.15.47:0/1198360589 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdd8c059ba0 con 0x7fdda409c1d0 2024-05-27T10:52:07.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.812+0000 7fddaa400640 1 -- 172.21.15.47:0/1198360589 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fdda406cc70 con 0x7fdda409c1d0 2024-05-27T10:52:07.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.822+0000 7fdd9b400640 1 -- 172.21.15.47:0/1198360589 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174137 (secure 0 0 0) 0x7fdd8c0594a0 con 0x7fdda409c1d0 2024-05-27T10:52:07.822 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:07.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.826+0000 7fddaa400640 1 -- 172.21.15.47:0/1198360589 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdd8006c8f0 msgr2=0x7fdd8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:07.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.826+0000 7fddaa400640 1 --2- 172.21.15.47:0/1198360589 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdd8006c8f0 0x7fdd8006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdd940013d0 tx=0x7fdd94009040 comp rx=0 tx=0).stop 2024-05-27T10:52:07.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.826+0000 7fddaa400640 1 -- 172.21.15.47:0/1198360589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdda409c1d0 msgr2=0x7fdda409c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:07.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.826+0000 7fddaa400640 1 --2- 172.21.15.47:0/1198360589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdda409c1d0 0x7fdda409c650 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00e530 tx=0x7fdd8c00e9f0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.827+0000 7fddaa400640 1 -- 172.21.15.47:0/1198360589 shutdown_connections 2024-05-27T10:52:07.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.827+0000 7fddaa400640 1 --2- 172.21.15.47:0/1198360589 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdd8006c8f0 0x7fdd8006edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.827+0000 7fddaa400640 1 --2- 172.21.15.47:0/1198360589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda4072ce0 0x7fdda4073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.827+0000 7fddaa400640 1 --2- 172.21.15.47:0/1198360589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdda409c1d0 0x7fdda409c650 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.827+0000 7fddaa400640 1 --2- 172.21.15.47:0/1198360589 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdd88005210 0x7fdda414cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:07.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.827+0000 7fddaa400640 1 -- 172.21.15.47:0/1198360589 >> 172.21.15.47:0/1198360589 conn(0x7fdda406bd60 msgr2=0x7fdda406f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:07.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.827+0000 7fddaa400640 1 -- 172.21.15.47:0/1198360589 shutdown_connections 2024-05-27T10:52:07.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:07.827+0000 7fddaa400640 1 -- 172.21.15.47:0/1198360589 wait complete. 2024-05-27T10:52:07.844 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3679485934},{"type":"v1","addr":"172.21.15.47:6833","nonce":3679485934}]},"active_addr":"172.21.15.47:6833/3679485934","active_change":"2024-05-27T10:51:47.014284+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4114,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":1220551339}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":1652011843}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":2771910446}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":3320237839}]}]} 2024-05-27T10:52:07.847 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-27T10:52:07.848 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-27T10:52:07.848 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:52:08.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.059+0000 7f6577e00640 1 Processor -- start 2024-05-27T10:52:08.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.060+0000 7f6577e00640 1 -- start start 2024-05-27T10:52:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.061+0000 7f6577e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f657815c420 0x7f6578071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.061+0000 7f6577e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f65780d0a70 0x7f65780b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.061+0000 7f6577e00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f657815c800 con 0x7f65780b4ab0 2024-05-27T10:52:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.062+0000 7f6577e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f65780afc90 con 0x7f65780d0a70 2024-05-27T10:52:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.062+0000 7f6577e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f65780ad2e0 con 0x7f657815c420 2024-05-27T10:52:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.062+0000 7f6577400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f65780d0a70 0x7f65780b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.062+0000 7f6577400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f65780d0a70 0x7f65780b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35026/0 (socket says 172.21.15.47:35026) 2024-05-27T10:52:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.062+0000 7f6577400640 1 -- 172.21.15.47:0/1596397329 learned_addr learned my addr 172.21.15.47:0/1596397329 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.062+0000 7f6576a00640 1 --2- 172.21.15.47:0/1596397329 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f657815c420 0x7f6578071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:08.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.062+0000 7f6577400640 1 -- 172.21.15.47:0/1596397329 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f657815c420 msgr2=0x7f6578071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:08.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.062+0000 7f6577400640 1 --2- 172.21.15.47:0/1596397329 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f657815c420 0x7f6578071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.062+0000 7f6577400640 1 -- 172.21.15.47:0/1596397329 >> v1:172.21.15.53:6789/0 conn(0x7f65780b4ab0 legacy=0x7f65780d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:08.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.062+0000 7f6577400640 1 -- 172.21.15.47:0/1596397329 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65780ad5c0 con 0x7f65780d0a70 2024-05-27T10:52:08.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.063+0000 7f6577400640 1 --2- 172.21.15.47:0/1596397329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65780d0a70 0x7f65780b3790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6570009870 tx=0x7f657002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981eef4ecd69016b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:08.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.064+0000 7f6576000640 1 -- 172.21.15.47:0/1596397329 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570037070 con 0x7f65780d0a70 2024-05-27T10:52:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.064+0000 7f6576000640 1 -- 172.21.15.47:0/1596397329 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6570032440 con 0x7f65780d0a70 2024-05-27T10:52:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.064+0000 7f6576000640 1 -- 172.21.15.47:0/1596397329 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570032810 con 0x7f65780d0a70 2024-05-27T10:52:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.064+0000 7f6577e00640 1 -- 172.21.15.47:0/1596397329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65780d0a70 msgr2=0x7f65780b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.064+0000 7f6577e00640 1 --2- 172.21.15.47:0/1596397329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65780d0a70 0x7f65780b3790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6570009870 tx=0x7f657002a1c0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.064+0000 7f6577e00640 1 -- 172.21.15.47:0/1596397329 shutdown_connections 2024-05-27T10:52:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.064+0000 7f6577e00640 1 --2- 172.21.15.47:0/1596397329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65780d0a70 0x7f65780b3790 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.064+0000 7f6577e00640 1 --2- 172.21.15.47:0/1596397329 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f657815c420 0x7f6578071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.064+0000 7f6577e00640 1 -- 172.21.15.47:0/1596397329 >> 172.21.15.47:0/1596397329 conn(0x7f657806bb20 msgr2=0x7f657806bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.064+0000 7f6577e00640 1 -- 172.21.15.47:0/1596397329 shutdown_connections 2024-05-27T10:52:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.065+0000 7f6577e00640 1 -- 172.21.15.47:0/1596397329 wait complete. 2024-05-27T10:52:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.066+0000 7f6577e00640 1 Processor -- start 2024-05-27T10:52:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.066+0000 7f6577e00640 1 -- start start 2024-05-27T10:52:08.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.067+0000 7f6577e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65780b4ab0 0x7f6578148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.067+0000 7f6577e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f65780d0a70 0x7f657814def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.067+0000 7f6577e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f657815c420 0x7f6578159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.067+0000 7f6577e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f65780af8f0 con 0x7f657815c420 2024-05-27T10:52:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.067+0000 7f6577e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f65780ad8a0 con 0x7f65780b4ab0 2024-05-27T10:52:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.067+0000 7f6577e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f65780afa70 con 0x7f65780d0a70 2024-05-27T10:52:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.068+0000 7f6577400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f657815c420 0x7f6578159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.068+0000 7f6577400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f657815c420 0x7f6578159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35036/0 (socket says 172.21.15.47:35036) 2024-05-27T10:52:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.068+0000 7f6577400640 1 -- 172.21.15.47:0/1854394000 learned_addr learned my addr 172.21.15.47:0/1854394000 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.068+0000 7f6576a00640 1 --2- 172.21.15.47:0/1854394000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65780b4ab0 0x7f6578148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.068+0000 7f656e000640 1 --2- 172.21.15.47:0/1854394000 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f65780d0a70 0x7f657814def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.068+0000 7f6577400640 1 -- 172.21.15.47:0/1854394000 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f65780d0a70 msgr2=0x7f657814def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.068+0000 7f6577400640 1 --2- 172.21.15.47:0/1854394000 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f65780d0a70 0x7f657814def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.068+0000 7f6577400640 1 -- 172.21.15.47:0/1854394000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65780b4ab0 msgr2=0x7f6578148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.068+0000 7f6577400640 1 --2- 172.21.15.47:0/1854394000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65780b4ab0 0x7f6578148030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.068+0000 7f6577400640 1 -- 172.21.15.47:0/1854394000 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65781f5b40 con 0x7f657815c420 2024-05-27T10:52:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.068+0000 7f6577400640 1 --2- 172.21.15.47:0/1854394000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f657815c420 0x7f6578159cf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f657002a200 tx=0x7f65700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.069+0000 7f656f400640 1 -- 172.21.15.47:0/1854394000 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570041020 con 0x7f657815c420 2024-05-27T10:52:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.069+0000 7f656f400640 1 -- 172.21.15.47:0/1854394000 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f657003d640 con 0x7f657815c420 2024-05-27T10:52:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.069+0000 7f656f400640 1 -- 172.21.15.47:0/1854394000 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570037040 con 0x7f657815c420 2024-05-27T10:52:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.069+0000 7f6577e00640 1 -- 172.21.15.47:0/1854394000 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65781f5e20 con 0x7f657815c420 2024-05-27T10:52:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.069+0000 7f6577e00640 1 -- 172.21.15.47:0/1854394000 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65781f63e0 con 0x7f657815c420 2024-05-27T10:52:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.070+0000 7f6577e00640 1 -- 172.21.15.47:0/1854394000 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f657804fce0 con 0x7f657815c420 2024-05-27T10:52:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.071+0000 7f656f400640 1 -- 172.21.15.47:0/1854394000 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6570044020 con 0x7f657815c420 2024-05-27T10:52:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.072+0000 7f656f400640 1 --2- 172.21.15.47:0/1854394000 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f655406c8f0 0x7f655406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.072+0000 7f656f400640 1 -- 172.21.15.47:0/1854394000 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f65700ac310 con 0x7f657815c420 2024-05-27T10:52:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.072+0000 7f6576a00640 1 --2- 172.21.15.47:0/1854394000 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f655406c8f0 0x7f655406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.073+0000 7f6576a00640 1 --2- 172.21.15.47:0/1854394000 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f655406c8f0 0x7f655406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f65680073f0 tx=0x7f656800b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:08.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.076+0000 7f656f400640 1 -- 172.21.15.47:0/1854394000 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f657004b030 con 0x7f657815c420 2024-05-27T10:52:08.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.280+0000 7f6577e00640 1 -- 172.21.15.47:0/1854394000 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6578073a30 con 0x7f657815c420 2024-05-27T10:52:08.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.282+0000 7f656f400640 1 -- 172.21.15.47:0/1854394000 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16521 (secure 0 0 0) 0x7f657007a6b0 con 0x7f657815c420 2024-05-27T10:52:08.281 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:08.281 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:03.257638+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:52:08.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.285+0000 7f6577e00640 1 -- 172.21.15.47:0/1854394000 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f655406c8f0 msgr2=0x7f655406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:08.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.285+0000 7f6577e00640 1 --2- 172.21.15.47:0/1854394000 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f655406c8f0 0x7f655406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f65680073f0 tx=0x7f656800b040 comp rx=0 tx=0).stop 2024-05-27T10:52:08.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.285+0000 7f6577e00640 1 -- 172.21.15.47:0/1854394000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f657815c420 msgr2=0x7f6578159cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:08.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.285+0000 7f6577e00640 1 --2- 172.21.15.47:0/1854394000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f657815c420 0x7f6578159cf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f657002a200 tx=0x7f65700046c0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.285+0000 7f6577e00640 1 -- 172.21.15.47:0/1854394000 shutdown_connections 2024-05-27T10:52:08.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.285+0000 7f6577e00640 1 --2- 172.21.15.47:0/1854394000 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f655406c8f0 0x7f655406edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.285+0000 7f6577e00640 1 --2- 172.21.15.47:0/1854394000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f657815c420 0x7f6578159cf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.285+0000 7f6577e00640 1 --2- 172.21.15.47:0/1854394000 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f65780d0a70 0x7f657814def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.285+0000 7f6577e00640 1 --2- 172.21.15.47:0/1854394000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65780b4ab0 0x7f6578148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.285+0000 7f6577e00640 1 -- 172.21.15.47:0/1854394000 >> 172.21.15.47:0/1854394000 conn(0x7f657806bb20 msgr2=0x7f65781605e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:08.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.286+0000 7f6577e00640 1 -- 172.21.15.47:0/1854394000 shutdown_connections 2024-05-27T10:52:08.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.286+0000 7f6577e00640 1 -- 172.21.15.47:0/1854394000 wait complete. 2024-05-27T10:52:08.303 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-27T10:52:08.303 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:52:08.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.517+0000 7fc519e00640 1 Processor -- start 2024-05-27T10:52:08.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.518+0000 7fc519e00640 1 -- start start 2024-05-27T10:52:08.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.519+0000 7fc519e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc51406d240 0x7fc51406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:08.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.520+0000 7fc519e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc51406ca40 0x7fc5140d3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:08.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.520+0000 7fc519e00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5140cebc0 con 0x7fc51415eaa0 2024-05-27T10:52:08.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.520+0000 7fc519e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc5140cf4b0 con 0x7fc51406ca40 2024-05-27T10:52:08.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.520+0000 7fc519e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc51406db60 con 0x7fc51406d240 2024-05-27T10:52:08.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.520+0000 7fc519400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc51406ca40 0x7fc5140d3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:08.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.520+0000 7fc519400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc51406ca40 0x7fc5140d3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35048/0 (socket says 172.21.15.47:35048) 2024-05-27T10:52:08.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.520+0000 7fc519400640 1 -- 172.21.15.47:0/1801852319 learned_addr learned my addr 172.21.15.47:0/1801852319 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:08.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.520+0000 7fc518a00640 1 --2- 172.21.15.47:0/1801852319 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc51406d240 0x7fc51406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:08.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.521+0000 7fc519400640 1 -- 172.21.15.47:0/1801852319 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc51406d240 msgr2=0x7fc51406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:08.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.521+0000 7fc519400640 1 --2- 172.21.15.47:0/1801852319 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc51406d240 0x7fc51406d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.521+0000 7fc519400640 1 -- 172.21.15.47:0/1801852319 >> v1:172.21.15.53:6789/0 conn(0x7fc51415eaa0 legacy=0x7fc5140cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:08.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.521+0000 7fc519400640 1 -- 172.21.15.47:0/1801852319 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5140cee60 con 0x7fc51406ca40 2024-05-27T10:52:08.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.522+0000 7fc519400640 1 --2- 172.21.15.47:0/1801852319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc51406ca40 0x7fc5140d3690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc50c009870 tx=0x7fc50c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc092c8d0c91049 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:08.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.522+0000 7fc513400640 1 -- 172.21.15.47:0/1801852319 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c037070 con 0x7fc51406ca40 2024-05-27T10:52:08.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.522+0000 7fc513400640 1 -- 172.21.15.47:0/1801852319 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc50c032440 con 0x7fc51406ca40 2024-05-27T10:52:08.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.522+0000 7fc513400640 1 -- 172.21.15.47:0/1801852319 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c032810 con 0x7fc51406ca40 2024-05-27T10:52:08.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.523+0000 7fc519e00640 1 -- 172.21.15.47:0/1801852319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc51406ca40 msgr2=0x7fc5140d3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:08.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.523+0000 7fc519e00640 1 --2- 172.21.15.47:0/1801852319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc51406ca40 0x7fc5140d3690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc50c009870 tx=0x7fc50c02a270 comp rx=0 tx=0).stop 2024-05-27T10:52:08.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.523+0000 7fc519e00640 1 -- 172.21.15.47:0/1801852319 shutdown_connections 2024-05-27T10:52:08.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.523+0000 7fc519e00640 1 --2- 172.21.15.47:0/1801852319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc51406ca40 0x7fc5140d3690 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.523+0000 7fc519e00640 1 --2- 172.21.15.47:0/1801852319 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc51406d240 0x7fc51406d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.523+0000 7fc519e00640 1 -- 172.21.15.47:0/1801852319 >> 172.21.15.47:0/1801852319 conn(0x7fc51408bfd0 msgr2=0x7fc5140d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:08.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.523+0000 7fc519e00640 1 -- 172.21.15.47:0/1801852319 shutdown_connections 2024-05-27T10:52:08.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.523+0000 7fc519e00640 1 -- 172.21.15.47:0/1801852319 wait complete. 2024-05-27T10:52:08.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.525+0000 7fc519e00640 1 Processor -- start 2024-05-27T10:52:08.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.525+0000 7fc519e00640 1 -- start start 2024-05-27T10:52:08.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.526+0000 7fc519e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc51406ca40 0x7fc5141f5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:08.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.526+0000 7fc519e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc51406d240 0x7fc51415ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:08.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.526+0000 7fc519e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc51415eaa0 0x7fc5140ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:08.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.526+0000 7fc519e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc5140b10a0 con 0x7fc51415eaa0 2024-05-27T10:52:08.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.526+0000 7fc519e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc51406cf40 con 0x7fc51406ca40 2024-05-27T10:52:08.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.526+0000 7fc519e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc5140b1220 con 0x7fc51406d240 2024-05-27T10:52:08.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.526+0000 7fc519400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc51415eaa0 0x7fc5140ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:08.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.526+0000 7fc519400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc51415eaa0 0x7fc5140ca5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35064/0 (socket says 172.21.15.47:35064) 2024-05-27T10:52:08.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.526+0000 7fc519400640 1 -- 172.21.15.47:0/3724175270 learned_addr learned my addr 172.21.15.47:0/3724175270 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.527+0000 7fc518a00640 1 --2- 172.21.15.47:0/3724175270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc51406ca40 0x7fc5141f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.527+0000 7fc513e00640 1 --2- 172.21.15.47:0/3724175270 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc51406d240 0x7fc51415ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.527+0000 7fc519400640 1 -- 172.21.15.47:0/3724175270 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc51406d240 msgr2=0x7fc51415ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.527+0000 7fc519400640 1 --2- 172.21.15.47:0/3724175270 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc51406d240 0x7fc51415ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.527+0000 7fc519400640 1 -- 172.21.15.47:0/3724175270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc51406ca40 msgr2=0x7fc5141f5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.527+0000 7fc519400640 1 --2- 172.21.15.47:0/3724175270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc51406ca40 0x7fc5141f5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.527+0000 7fc519400640 1 -- 172.21.15.47:0/3724175270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5141f46e0 con 0x7fc51415eaa0 2024-05-27T10:52:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.527+0000 7fc518a00640 1 --2- 172.21.15.47:0/3724175270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc51406ca40 0x7fc5141f5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.527+0000 7fc513e00640 1 --2- 172.21.15.47:0/3724175270 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc51406d240 0x7fc51415ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.527+0000 7fc519400640 1 --2- 172.21.15.47:0/3724175270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc51415eaa0 0x7fc5140ca5b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc50c02a2b0 tx=0x7fc50c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.527+0000 7fc510c00640 1 -- 172.21.15.47:0/3724175270 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c037040 con 0x7fc51415eaa0 2024-05-27T10:52:08.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.527+0000 7fc510c00640 1 -- 172.21.15.47:0/3724175270 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc50c042070 con 0x7fc51415eaa0 2024-05-27T10:52:08.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.527+0000 7fc510c00640 1 -- 172.21.15.47:0/3724175270 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c030920 con 0x7fc51415eaa0 2024-05-27T10:52:08.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.527+0000 7fc519e00640 1 -- 172.21.15.47:0/3724175270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5141f49c0 con 0x7fc51415eaa0 2024-05-27T10:52:08.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.528+0000 7fc519e00640 1 -- 172.21.15.47:0/3724175270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5141f3f70 con 0x7fc51415eaa0 2024-05-27T10:52:08.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.529+0000 7fc519e00640 1 -- 172.21.15.47:0/3724175270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc51404fce0 con 0x7fc51415eaa0 2024-05-27T10:52:08.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.530+0000 7fc510c00640 1 -- 172.21.15.47:0/3724175270 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc50c030ac0 con 0x7fc51415eaa0 2024-05-27T10:52:08.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.530+0000 7fc510c00640 1 --2- 172.21.15.47:0/3724175270 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc4f006c8f0 0x7fc4f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:08.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.531+0000 7fc510c00640 1 -- 172.21.15.47:0/3724175270 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc50c0ac460 con 0x7fc51415eaa0 2024-05-27T10:52:08.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.531+0000 7fc518a00640 1 --2- 172.21.15.47:0/3724175270 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc4f006c8f0 0x7fc4f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:08.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.531+0000 7fc518a00640 1 --2- 172.21.15.47:0/3724175270 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc4f006c8f0 0x7fc4f006edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc006fd0 tx=0x7fc4fc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:08.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.535+0000 7fc510c00640 1 -- 172.21.15.47:0/3724175270 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc50c07a230 con 0x7fc51415eaa0 2024-05-27T10:52:08.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.742+0000 7fc519e00640 1 -- 172.21.15.47:0/3724175270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5140c7e30 con 0x7fc51415eaa0 2024-05-27T10:52:08.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.744+0000 7fc510c00640 1 -- 172.21.15.47:0/3724175270 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16521 (secure 0 0 0) 0x7fc50c07e530 con 0x7fc51415eaa0 2024-05-27T10:52:08.747 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:08.747 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:03.257638+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:52:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.747+0000 7fc519e00640 1 -- 172.21.15.47:0/3724175270 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc4f006c8f0 msgr2=0x7fc4f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.747+0000 7fc519e00640 1 --2- 172.21.15.47:0/3724175270 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc4f006c8f0 0x7fc4f006edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc006fd0 tx=0x7fc4fc008040 comp rx=0 tx=0).stop 2024-05-27T10:52:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.747+0000 7fc519e00640 1 -- 172.21.15.47:0/3724175270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc51415eaa0 msgr2=0x7fc5140ca5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.747+0000 7fc519e00640 1 --2- 172.21.15.47:0/3724175270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc51415eaa0 0x7fc5140ca5b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc50c02a2b0 tx=0x7fc50c0046c0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.748+0000 7fc519e00640 1 -- 172.21.15.47:0/3724175270 shutdown_connections 2024-05-27T10:52:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.748+0000 7fc519e00640 1 --2- 172.21.15.47:0/3724175270 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc4f006c8f0 0x7fc4f006edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.748+0000 7fc519e00640 1 --2- 172.21.15.47:0/3724175270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc51415eaa0 0x7fc5140ca5b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.748+0000 7fc519e00640 1 --2- 172.21.15.47:0/3724175270 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc51406d240 0x7fc51415ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.748+0000 7fc519e00640 1 --2- 172.21.15.47:0/3724175270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc51406ca40 0x7fc5141f5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.748+0000 7fc519e00640 1 -- 172.21.15.47:0/3724175270 >> 172.21.15.47:0/3724175270 conn(0x7fc51408bfd0 msgr2=0x7fc5140d2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.748+0000 7fc519e00640 1 -- 172.21.15.47:0/3724175270 shutdown_connections 2024-05-27T10:52:08.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:08.748+0000 7fc519e00640 1 -- 172.21.15.47:0/3724175270 wait complete. 2024-05-27T10:52:08.767 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-27T10:52:08.767 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-27T10:52:08.768 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-27T10:52:08.768 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-27T10:52:08.769 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-27T10:52:08.769 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-27T10:52:08.769 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-27T10:52:08.770 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-27T10:52:09.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.072+0000 7f3e6bc00640 1 Processor -- start 2024-05-27T10:52:09.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.072+0000 7f3e6bc00640 1 -- start start 2024-05-27T10:52:09.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.074+0000 7f3e6bc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3e64162c60 0x7f3e640b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.074+0000 7f3e6bc00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e64167400 0x7f3e640b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.074+0000 7f3e6bc00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3e640b29f0 0x7f3e64072fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.075+0000 7f3e6bc00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f3e64164160 con 0x7f3e64162c60 2024-05-27T10:52:09.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.075+0000 7f3e6bc00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f3e64166f70 con 0x7f3e640b29f0 2024-05-27T10:52:09.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.075+0000 7f3e6bc00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3e64163c20 con 0x7f3e64167400 2024-05-27T10:52:09.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.076+0000 7f3e69c00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3e640b29f0 0x7f3e64072fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.076+0000 7f3e69c00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3e640b29f0 0x7f3e64072fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:43868/0 (socket says 172.21.15.47:43868) 2024-05-27T10:52:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.076+0000 7f3e69c00640 1 -- 172.21.15.47:0/124359151 learned_addr learned my addr 172.21.15.47:0/124359151 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.076+0000 7f3e63e00640 1 --2- 172.21.15.47:0/124359151 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e64167400 0x7f3e640b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.076+0000 7f3e69200640 1 --2- 172.21.15.47:0/124359151 >> v2:172.21.15.47:3300/0 conn(0x7f3e64162c60 0x7f3e640b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.076+0000 7f6b19c00640 1 Processor -- start 2024-05-27T10:52:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.077+0000 7f6b19c00640 1 -- start start 2024-05-27T10:52:09.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.078+0000 7f779b000640 1 Processor -- start 2024-05-27T10:52:09.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.078+0000 7f779b000640 1 -- start start 2024-05-27T10:52:09.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.079+0000 7f779b000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f779406d240 0x7f779406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.077+0000 7f3e69c00640 1 -- 172.21.15.47:0/124359151 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e64167400 msgr2=0x7f3e640b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.077+0000 7f3e69c00640 1 --2- 172.21.15.47:0/124359151 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e64167400 0x7f3e640b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.077+0000 7f3e69c00640 1 -- 172.21.15.47:0/124359151 >> v2:172.21.15.47:3300/0 conn(0x7f3e64162c60 msgr2=0x7f3e640b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.077+0000 7f3e69c00640 1 --2- 172.21.15.47:0/124359151 >> v2:172.21.15.47:3300/0 conn(0x7f3e64162c60 0x7f3e640b31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.077+0000 7f3e69c00640 1 -- 172.21.15.47:0/124359151 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e64163040 con 0x7f3e640b29f0 2024-05-27T10:52:09.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.078+0000 7f3e69200640 1 --2- 172.21.15.47:0/124359151 >> v2:172.21.15.47:3300/0 conn(0x7f3e64162c60 0x7f3e640b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T10:52:09.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.079+0000 7f3e69c00640 1 --2- 172.21.15.47:0/124359151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e640b29f0 0x7f3e64072fd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3e64071b70 tx=0x7f3e5c02a6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b60eed00439a8b95 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.079+0000 7f3e63400640 1 -- 172.21.15.47:0/124359151 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c036070 con 0x7f3e640b29f0 2024-05-27T10:52:09.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.080+0000 7f3e63400640 1 -- 172.21.15.47:0/124359151 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e5c031600 con 0x7f3e640b29f0 2024-05-27T10:52:09.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.079+0000 7f779b000640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f779415eaa0 0x7f77940cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.079+0000 7f779b000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f779406ca40 0x7f77940cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.079+0000 7f779b000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f77940cf4b0 con 0x7f779406ca40 2024-05-27T10:52:09.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.080+0000 7f779b000640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f77940cebc0 con 0x7f779415eaa0 2024-05-27T10:52:09.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.080+0000 7f779b000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f779406db60 con 0x7f779406d240 2024-05-27T10:52:09.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.080+0000 7f3e63400640 1 -- 172.21.15.47:0/124359151 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c036070 con 0x7f3e640b29f0 2024-05-27T10:52:09.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.080+0000 7f779a600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f779406ca40 0x7f77940cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.080+0000 7f779a600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f779406ca40 0x7f77940cfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35074/0 (socket says 172.21.15.47:35074) 2024-05-27T10:52:09.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.080+0000 7f3e6bc00640 1 -- 172.21.15.47:0/124359151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e640b29f0 msgr2=0x7f3e64072fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.080+0000 7f3e6bc00640 1 --2- 172.21.15.47:0/124359151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e640b29f0 0x7f3e64072fd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3e64071b70 tx=0x7f3e5c02a6d0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.080+0000 7f779a600640 1 -- 172.21.15.47:0/3479371449 learned_addr learned my addr 172.21.15.47:0/3479371449 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.080+0000 7f7799c00640 1 --2- 172.21.15.47:0/3479371449 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f779406d240 0x7f779406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.080+0000 7f7799200640 1 --2- 172.21.15.47:0/3479371449 >> v2:172.21.15.53:3300/0 conn(0x7f779415eaa0 0x7f77940cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.081+0000 7f779a600640 1 -- 172.21.15.47:0/3479371449 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f779406d240 msgr2=0x7f779406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.081+0000 7f779a600640 1 --2- 172.21.15.47:0/3479371449 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f779406d240 0x7f779406d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.081+0000 7f779a600640 1 -- 172.21.15.47:0/3479371449 >> v2:172.21.15.53:3300/0 conn(0x7f779415eaa0 msgr2=0x7f77940cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.081+0000 7f779a600640 1 --2- 172.21.15.47:0/3479371449 >> v2:172.21.15.53:3300/0 conn(0x7f779415eaa0 0x7f77940cf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.081+0000 7f779a600640 1 -- 172.21.15.47:0/3479371449 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77940cee60 con 0x7f779406ca40 2024-05-27T10:52:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.081+0000 7f3e6bc00640 1 -- 172.21.15.47:0/124359151 shutdown_connections 2024-05-27T10:52:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.081+0000 7f3e6bc00640 1 --2- 172.21.15.47:0/124359151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e640b29f0 0x7f3e64072fd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.081+0000 7f3e6bc00640 1 --2- 172.21.15.47:0/124359151 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e64167400 0x7f3e640b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.081+0000 7f3e6bc00640 1 --2- 172.21.15.47:0/124359151 >> v2:172.21.15.47:3300/0 conn(0x7f3e64162c60 0x7f3e640b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.081+0000 7f3e6bc00640 1 -- 172.21.15.47:0/124359151 >> 172.21.15.47:0/124359151 conn(0x7f3e640b1ed0 msgr2=0x7f3e640b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.082+0000 7f7799200640 1 --2- 172.21.15.47:0/3479371449 >> v2:172.21.15.53:3300/0 conn(0x7f779415eaa0 0x7f77940cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:52:09.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.082+0000 7f3e6bc00640 1 -- 172.21.15.47:0/124359151 shutdown_connections 2024-05-27T10:52:09.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.082+0000 7f6b19c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b0c0e3260 0x7f6b0c04f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.082+0000 7f6b19c00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b0c04fdb0 0x7f6b0c052c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.083+0000 7f779a600640 1 --2- 172.21.15.47:0/3479371449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f779406ca40 0x7f77940cfe80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f779408ced0 tx=0x7f778c02a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36fb550481289c7f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.083+0000 7f6b19c00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b0c0e3640 con 0x7f6b0c0531b0 2024-05-27T10:52:09.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.083+0000 7f7793e00640 1 -- 172.21.15.47:0/3479371449 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c036070 con 0x7f779406ca40 2024-05-27T10:52:09.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.083+0000 7f6b19c00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f6b0c050210 con 0x7f6b0c04fdb0 2024-05-27T10:52:09.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.083+0000 7f6b19c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f6b0c053930 con 0x7f6b0c0e3260 2024-05-27T10:52:09.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.083+0000 7f6b13e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b0c0e3260 0x7f6b0c04f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.084+0000 7f7793e00640 1 -- 172.21.15.47:0/3479371449 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f778c031600 con 0x7f779406ca40 2024-05-27T10:52:09.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.084+0000 7f7793e00640 1 -- 172.21.15.47:0/3479371449 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c036070 con 0x7f779406ca40 2024-05-27T10:52:09.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.084+0000 7f6b13e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b0c0e3260 0x7f6b0c04f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:56428/0 (socket says 172.21.15.47:56428) 2024-05-27T10:52:09.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.084+0000 7f6b13e00640 1 -- 172.21.15.47:0/3924871200 learned_addr learned my addr 172.21.15.47:0/3924871200 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.084+0000 7fdcda600640 1 Processor -- start 2024-05-27T10:52:09.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.084+0000 7f8029e00640 1 Processor -- start 2024-05-27T10:52:09.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.082+0000 7f3e6bc00640 1 -- 172.21.15.47:0/124359151 wait complete. 2024-05-27T10:52:09.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.084+0000 7f6b13400640 1 --2- 172.21.15.47:0/3924871200 >> v2:172.21.15.53:3300/0 conn(0x7f6b0c04fdb0 0x7f6b0c052c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.085+0000 7f3e6bc00640 1 Processor -- start 2024-05-27T10:52:09.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.085+0000 7f3e6bc00640 1 -- start start 2024-05-27T10:52:09.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.085+0000 7f779b000640 1 -- 172.21.15.47:0/3479371449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f779406ca40 msgr2=0x7f77940cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.085+0000 7f779b000640 1 --2- 172.21.15.47:0/3479371449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f779406ca40 0x7f77940cfe80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f779408ced0 tx=0x7f778c02a690 comp rx=0 tx=0).stop 2024-05-27T10:52:09.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.085+0000 7f6b13400640 1 -- 172.21.15.47:0/3924871200 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b0c0e3260 msgr2=0x7f6b0c04f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.085+0000 7f6b13400640 1 --2- 172.21.15.47:0/3924871200 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b0c0e3260 0x7f6b0c04f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.085+0000 7f6b13400640 1 -- 172.21.15.47:0/3924871200 >> v1:172.21.15.53:6789/0 conn(0x7f6b0c0531b0 legacy=0x7f6b0c005ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.085+0000 7f6b13400640 1 -- 172.21.15.47:0/3924871200 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0c053c10 con 0x7f6b0c04fdb0 2024-05-27T10:52:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.085+0000 7f8029e00640 1 -- start start 2024-05-27T10:52:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.086+0000 7f8029e00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f801c0061e0 0x7f801c006690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.086+0000 7f3e6bc00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e640b29f0 0x7f3e64153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.086+0000 7f3e6bc00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e64162c60 0x7f3e640ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f8029e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f801c006bd0 0x7f801c03c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f3e6bc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e64167400 0x7f3e640cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f3e6bc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3e64166c00 con 0x7f3e64167400 2024-05-27T10:52:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f3e6bc00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3e64166960 con 0x7f3e640b29f0 2024-05-27T10:52:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f3e6bc00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3e640b3f20 con 0x7f3e64162c60 2024-05-27T10:52:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f779b000640 1 -- 172.21.15.47:0/3479371449 shutdown_connections 2024-05-27T10:52:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f779b000640 1 --2- 172.21.15.47:0/3479371449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f779406ca40 0x7f77940cfe80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f779b000640 1 --2- 172.21.15.47:0/3479371449 >> v2:172.21.15.53:3300/0 conn(0x7f779415eaa0 0x7f77940cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f779b000640 1 --2- 172.21.15.47:0/3479371449 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f779406d240 0x7f779406d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f779b000640 1 -- 172.21.15.47:0/3479371449 >> 172.21.15.47:0/3479371449 conn(0x7f779408bfd0 msgr2=0x7f77940d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f6b13400640 1 --2- 172.21.15.47:0/3924871200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b0c04fdb0 0x7f6b0c052c70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b080097a0 tx=0x7f6b0802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a9eedfa05b81539 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.084+0000 7fdcda600640 1 -- start start 2024-05-27T10:52:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7fdcda600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdccc0361b0 0x7fdccc039b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7fdcda600640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdccc0529f0 0x7fdccc052e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7fdcda600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdccc03b340 con 0x7fdccc04a320 2024-05-27T10:52:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7fdcda600640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fdccc03b5e0 con 0x7fdccc0529f0 2024-05-27T10:52:09.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7fdcda600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fdccc03b8c0 con 0x7fdccc0361b0 2024-05-27T10:52:09.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f8029e00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f801c0e36d0 con 0x7f801c0e32f0 2024-05-27T10:52:09.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f8029e00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f801c007000 con 0x7f801c0061e0 2024-05-27T10:52:09.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f8029e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f801c057b30 con 0x7f801c006bd0 2024-05-27T10:52:09.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f3e69c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e64167400 0x7f3e640cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f3e69200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e640b29f0 0x7f3e64153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f3e69200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e640b29f0 0x7f3e64153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:43882/0 (socket says 172.21.15.47:43882) 2024-05-27T10:52:09.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f3e69200640 1 -- 172.21.15.47:0/3299365114 learned_addr learned my addr 172.21.15.47:0/3299365114 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f3e63e00640 1 --2- 172.21.15.47:0/3299365114 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e64162c60 0x7f3e640ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f779b000640 1 -- 172.21.15.47:0/3479371449 shutdown_connections 2024-05-27T10:52:09.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f8022000640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f801c0061e0 0x7f801c006690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f8022a00640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f801c0e32f0 0x7f801c0572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.47:38822/0 (socket says 172.21.15.47:38822) 2024-05-27T10:52:09.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.087+0000 7f8022a00640 1 -- 172.21.15.47:0/2756345101 learned_addr learned my addr 172.21.15.47:0/2756345101 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:09.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.088+0000 7f779b000640 1 -- 172.21.15.47:0/3479371449 wait complete. 2024-05-27T10:52:09.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.088+0000 7fdcd9200640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fdccc04a320 0x7fdccc03c3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43868/0 (socket says 172.21.15.47:43868) 2024-05-27T10:52:09.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.088+0000 7fdcd3e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdccc0361b0 0x7fdccc039b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.088+0000 7fdcd9200640 1 -- 172.21.15.47:0/864880650 learned_addr learned my addr 172.21.15.47:0/864880650 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:09.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.088+0000 7f6b12a00640 1 -- 172.21.15.47:0/3924871200 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b08037070 con 0x7f6b0c04fdb0 2024-05-27T10:52:09.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.088+0000 7f6b12a00640 1 -- 172.21.15.47:0/3924871200 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b08032440 con 0x7f6b0c04fdb0 2024-05-27T10:52:09.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.088+0000 7f6b12a00640 1 -- 172.21.15.47:0/3924871200 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b08032850 con 0x7f6b0c04fdb0 2024-05-27T10:52:09.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.088+0000 7f8023400640 1 --2- 172.21.15.47:0/2756345101 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f801c006bd0 0x7f801c03c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.088+0000 7f3e63e00640 1 -- 172.21.15.47:0/3299365114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e640b29f0 msgr2=0x7f3e64153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.088+0000 7f3e63e00640 1 --2- 172.21.15.47:0/3299365114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e640b29f0 0x7f3e64153ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.088+0000 7fdcd9c00640 1 --2- 172.21.15.47:0/864880650 >> v2:172.21.15.53:3300/0 conn(0x7fdccc0529f0 0x7fdccc052e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.088+0000 7f3e63e00640 1 -- 172.21.15.47:0/3299365114 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e64167400 msgr2=0x7f3e640cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.089+0000 7f8021600640 1 -- 172.21.15.47:0/2756345101 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3492683616 0 0) 0x7f801c0e36d0 con 0x7f801c0e32f0 2024-05-27T10:52:09.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.089+0000 7f8021600640 1 -- 172.21.15.47:0/2756345101 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8008003520 con 0x7f801c0e32f0 2024-05-27T10:52:09.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.088+0000 7f3e63e00640 1 --2- 172.21.15.47:0/3299365114 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e64167400 0x7f3e640cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.089+0000 7f3e63e00640 1 -- 172.21.15.47:0/3299365114 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e640cf5f0 con 0x7f3e64162c60 2024-05-27T10:52:09.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.089+0000 7f6b19c00640 1 -- 172.21.15.47:0/3924871200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b0c04fdb0 msgr2=0x7f6b0c052c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.089+0000 7f6b19c00640 1 --2- 172.21.15.47:0/3924871200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b0c04fdb0 0x7f6b0c052c70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b080097a0 tx=0x7f6b0802a250 comp rx=0 tx=0).stop 2024-05-27T10:52:09.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.089+0000 7f8023400640 1 -- 172.21.15.47:0/2756345101 >> v2:172.21.15.53:3300/0 conn(0x7f801c0061e0 msgr2=0x7f801c006690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.089+0000 7f8023400640 1 --2- 172.21.15.47:0/2756345101 >> v2:172.21.15.53:3300/0 conn(0x7f801c0061e0 0x7f801c006690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.089+0000 7f8023400640 1 -- 172.21.15.47:0/2756345101 >> v1:172.21.15.53:6789/0 conn(0x7f801c0e32f0 legacy=0x7f801c0572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.089+0000 7f8023400640 1 -- 172.21.15.47:0/2756345101 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f801c057e10 con 0x7f801c006bd0 2024-05-27T10:52:09.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.089+0000 7f3e63e00640 1 --2- 172.21.15.47:0/3299365114 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e64162c60 0x7f3e640ceaa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000e870 tx=0x7f3e5000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.089+0000 7f6b19c00640 1 -- 172.21.15.47:0/3924871200 shutdown_connections 2024-05-27T10:52:09.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.089+0000 7f6b19c00640 1 --2- 172.21.15.47:0/3924871200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b0c04fdb0 0x7f6b0c052c70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.089+0000 7f6b19c00640 1 --2- 172.21.15.47:0/3924871200 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b0c0e3260 0x7f6b0c04f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.089+0000 7f6b19c00640 1 -- 172.21.15.47:0/3924871200 >> 172.21.15.47:0/3924871200 conn(0x7f6b0c009fb0 msgr2=0x7f6b0c00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.090+0000 7f6b19c00640 1 -- 172.21.15.47:0/3924871200 shutdown_connections 2024-05-27T10:52:09.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.089+0000 7fdcd3e00640 1 -- 172.21.15.47:0/864880650 >> v2:172.21.15.53:3300/0 conn(0x7fdccc0529f0 msgr2=0x7fdccc052e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.089+0000 7fdcd3e00640 1 --2- 172.21.15.47:0/864880650 >> v2:172.21.15.53:3300/0 conn(0x7fdccc0529f0 0x7fdccc052e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.089+0000 7fdcd3e00640 1 -- 172.21.15.47:0/864880650 >> v1:172.21.15.47:6789/0 conn(0x7fdccc04a320 legacy=0x7fdccc03c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.090+0000 7fdcd3e00640 1 -- 172.21.15.47:0/864880650 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdccc03bba0 con 0x7fdccc0361b0 2024-05-27T10:52:09.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.090+0000 7f3e60c00640 1 -- 172.21.15.47:0/3299365114 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e50017070 con 0x7f3e64162c60 2024-05-27T10:52:09.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.091+0000 7f8023400640 1 --2- 172.21.15.47:0/2756345101 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f801c006bd0 0x7f801c03c110 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f80140097a0 tx=0x7f801402a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c762d0dcb374923f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.091+0000 7f3e60c00640 1 -- 172.21.15.47:0/3299365114 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e5000ee60 con 0x7f3e64162c60 2024-05-27T10:52:09.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.091+0000 7f3e6bc00640 1 -- 172.21.15.47:0/3299365114 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e640cf8d0 con 0x7f3e64162c60 2024-05-27T10:52:09.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.090+0000 7f6b19c00640 1 -- 172.21.15.47:0/3924871200 wait complete. 2024-05-27T10:52:09.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.091+0000 7f779b000640 1 Processor -- start 2024-05-27T10:52:09.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.091+0000 7f3e6bc00640 1 -- 172.21.15.47:0/3299365114 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e640cfe90 con 0x7f3e64162c60 2024-05-27T10:52:09.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.092+0000 7f3e60c00640 1 -- 172.21.15.47:0/3299365114 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e50017070 con 0x7f3e64162c60 2024-05-27T10:52:09.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.092+0000 7f779b000640 1 -- start start 2024-05-27T10:52:09.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.092+0000 7f6b19c00640 1 Processor -- start 2024-05-27T10:52:09.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.092+0000 7fdcd3e00640 1 --2- 172.21.15.47:0/864880650 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdccc0361b0 0x7fdccc039b80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdcc80097a0 tx=0x7fdcc802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f9382ef3ca5e0c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.092+0000 7f6b19c00640 1 -- start start 2024-05-27T10:52:09.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.092+0000 7f8021600640 1 -- 172.21.15.47:0/2756345101 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8014037070 con 0x7f801c006bd0 2024-05-27T10:52:09.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.092+0000 7f8021600640 1 -- 172.21.15.47:0/2756345101 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f801402ae40 con 0x7f801c006bd0 2024-05-27T10:52:09.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.092+0000 7f8021600640 1 -- 172.21.15.47:0/2756345101 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8014032660 con 0x7f801c006bd0 2024-05-27T10:52:09.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.093+0000 7fdcd3400640 1 -- 172.21.15.47:0/864880650 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8037070 con 0x7fdccc0361b0 2024-05-27T10:52:09.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.093+0000 7fdcd3400640 1 -- 172.21.15.47:0/864880650 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc8032440 con 0x7fdccc0361b0 2024-05-27T10:52:09.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.093+0000 7fdcd3400640 1 -- 172.21.15.47:0/864880650 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8037070 con 0x7fdccc0361b0 2024-05-27T10:52:09.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.093+0000 7f8029e00640 1 -- 172.21.15.47:0/2756345101 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f801c006bd0 msgr2=0x7f801c03c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.093+0000 7f8029e00640 1 --2- 172.21.15.47:0/2756345101 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f801c006bd0 0x7f801c03c110 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f80140097a0 tx=0x7f801402a0f0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.093+0000 7f779b000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f779406ca40 0x7f7794161600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.093+0000 7f779b000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f779406d240 0x7f77940b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.093+0000 7f779b000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f779415eaa0 0x7f77940b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.094+0000 7f8029e00640 1 -- 172.21.15.47:0/2756345101 shutdown_connections 2024-05-27T10:52:09.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.094+0000 7f8029e00640 1 --2- 172.21.15.47:0/2756345101 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f801c006bd0 0x7f801c03c110 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.094+0000 7f8029e00640 1 --2- 172.21.15.47:0/2756345101 >> v2:172.21.15.53:3300/0 conn(0x7f801c0061e0 0x7f801c006690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.094+0000 7f8029e00640 1 -- 172.21.15.47:0/2756345101 >> 172.21.15.47:0/2756345101 conn(0x7f801c058ee0 msgr2=0x7f801c0592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.093+0000 7f779b000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f77940b10a0 con 0x7f779406ca40 2024-05-27T10:52:09.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.093+0000 7f779b000640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f779406cf40 con 0x7f779406d240 2024-05-27T10:52:09.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.094+0000 7fdcda600640 1 -- 172.21.15.47:0/864880650 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdccc0361b0 msgr2=0x7fdccc039b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.094+0000 7fdcda600640 1 --2- 172.21.15.47:0/864880650 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdccc0361b0 0x7fdccc039b80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdcc80097a0 tx=0x7fdcc802a180 comp rx=0 tx=0).stop 2024-05-27T10:52:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.093+0000 7f779b000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f77940b1220 con 0x7f779415eaa0 2024-05-27T10:52:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.094+0000 7f7799c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f779406ca40 0x7f7794161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.094+0000 7f7799c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f779406ca40 0x7f7794161600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35104/0 (socket says 172.21.15.47:35104) 2024-05-27T10:52:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.094+0000 7f7799c00640 1 -- 172.21.15.47:0/1531160242 learned_addr learned my addr 172.21.15.47:0/1531160242 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.094+0000 7f6b19c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b0c04fdb0 0x7f6b0c0d7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.094+0000 7f7799200640 1 --2- 172.21.15.47:0/1531160242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f779406d240 0x7f77940b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.094+0000 7fdcda600640 1 -- 172.21.15.47:0/864880650 shutdown_connections 2024-05-27T10:52:09.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.094+0000 7fdcda600640 1 --2- 172.21.15.47:0/864880650 >> v2:172.21.15.53:3300/0 conn(0x7fdccc0529f0 0x7fdccc052e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.095+0000 7f8029e00640 1 -- 172.21.15.47:0/2756345101 shutdown_connections 2024-05-27T10:52:09.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.094+0000 7fdcda600640 1 --2- 172.21.15.47:0/864880650 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdccc0361b0 0x7fdccc039b80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.094+0000 7fdcda600640 1 -- 172.21.15.47:0/864880650 >> 172.21.15.47:0/864880650 conn(0x7fdccc0537b0 msgr2=0x7fdccc053b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.095+0000 7fdcda600640 1 -- 172.21.15.47:0/864880650 shutdown_connections 2024-05-27T10:52:09.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.094+0000 7f6b19c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b0c0531b0 0x7f6b0c04e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.095+0000 7f779a600640 1 --2- 172.21.15.47:0/1531160242 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f779415eaa0 0x7f77940b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.094+0000 7f6b19c00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b0c0e3260 0x7f6b0c0e4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.094+0000 7f6b19c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c0544b0 con 0x7f6b0c0531b0 2024-05-27T10:52:09.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.095+0000 7f7799c00640 1 -- 172.21.15.47:0/1531160242 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f779415eaa0 msgr2=0x7f77940b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.095+0000 7f7799c00640 1 --2- 172.21.15.47:0/1531160242 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f779415eaa0 0x7f77940b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.096+0000 7f7799c00640 1 -- 172.21.15.47:0/1531160242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f779406d240 msgr2=0x7f77940b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.096+0000 7f7799c00640 1 --2- 172.21.15.47:0/1531160242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f779406d240 0x7f77940b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.096+0000 7f7799c00640 1 -- 172.21.15.47:0/1531160242 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7794161b40 con 0x7f779406ca40 2024-05-27T10:52:09.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.096+0000 7f779a600640 1 --2- 172.21.15.47:0/1531160242 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f779415eaa0 0x7f77940b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:09.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.094+0000 7f6b19c00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c0541d0 con 0x7f6b0c0e3260 2024-05-27T10:52:09.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.094+0000 7f6b19c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f6b0c053640 con 0x7f6b0c04fdb0 2024-05-27T10:52:09.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.095+0000 7f6b19200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b0c0e3260 0x7f6b0c0e4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.095+0000 7f6b19200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b0c0e3260 0x7f6b0c0e4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:43918/0 (socket says 172.21.15.47:43918) 2024-05-27T10:52:09.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.095+0000 7f6b19200640 1 -- 172.21.15.47:0/2492042268 learned_addr learned my addr 172.21.15.47:0/2492042268 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.096+0000 7f6b13400640 1 --2- 172.21.15.47:0/2492042268 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b0c0531b0 0x7f6b0c04e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.096+0000 7f6b19200640 1 -- 172.21.15.47:0/2492042268 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b0c04fdb0 msgr2=0x7f6b0c0d7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.096+0000 7f6b19200640 1 --2- 172.21.15.47:0/2492042268 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6b0c04fdb0 0x7f6b0c0d7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.096+0000 7f6b19200640 1 -- 172.21.15.47:0/2492042268 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b0c0531b0 msgr2=0x7f6b0c04e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.097+0000 7f3e60c00640 1 -- 172.21.15.47:0/3299365114 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e5001a070 con 0x7f3e64162c60 2024-05-27T10:52:09.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.097+0000 7f3e56000640 1 -- 172.21.15.47:0/3299365114 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3e640b4d40 con 0x7f3e64162c60 2024-05-27T10:52:09.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.095+0000 7fdcda600640 1 -- 172.21.15.47:0/864880650 wait complete. 2024-05-27T10:52:09.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.097+0000 7fdcda600640 1 Processor -- start 2024-05-27T10:52:09.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.098+0000 7f7799c00640 1 --2- 172.21.15.47:0/1531160242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f779406ca40 0x7f7794161600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f778000ebe0 tx=0x7f778000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.098+0000 7fdcda600640 1 -- start start 2024-05-27T10:52:09.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.098+0000 7f31c1800640 1 Processor -- start 2024-05-27T10:52:09.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.098+0000 7f31c1800640 1 -- start start 2024-05-27T10:52:09.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.096+0000 7f6b19200640 1 --2- 172.21.15.47:0/2492042268 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b0c0531b0 0x7f6b0c04e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.096+0000 7f6b19200640 1 -- 172.21.15.47:0/2492042268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0c17c950 con 0x7f6b0c0e3260 2024-05-27T10:52:09.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.097+0000 7f6b19200640 1 --2- 172.21.15.47:0/2492042268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b0c0e3260 0x7f6b0c0e4e30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000c3c0 tx=0x7f6b0000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.097+0000 7f6b07e00640 1 -- 172.21.15.47:0/2492042268 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b000052d0 con 0x7f6b0c0e3260 2024-05-27T10:52:09.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.097+0000 7f6b07e00640 1 -- 172.21.15.47:0/2492042268 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b00005490 con 0x7f6b0c0e3260 2024-05-27T10:52:09.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.097+0000 7f6b07e00640 1 -- 172.21.15.47:0/2492042268 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00007260 con 0x7f6b0c0e3260 2024-05-27T10:52:09.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.098+0000 7f6b19c00640 1 -- 172.21.15.47:0/2492042268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b0c17cc30 con 0x7f6b0c0e3260 2024-05-27T10:52:09.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.098+0000 7f6b19c00640 1 -- 172.21.15.47:0/2492042268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b0c17d1f0 con 0x7f6b0c0e3260 2024-05-27T10:52:09.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.096+0000 7f8029e00640 1 -- 172.21.15.47:0/2756345101 wait complete. 2024-05-27T10:52:09.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.098+0000 7f8029e00640 1 Processor -- start 2024-05-27T10:52:09.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.099+0000 7f7791600640 1 -- 172.21.15.47:0/1531160242 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7780017070 con 0x7f779406ca40 2024-05-27T10:52:09.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.099+0000 7f7791600640 1 -- 172.21.15.47:0/1531160242 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f778000ed90 con 0x7f779406ca40 2024-05-27T10:52:09.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.099+0000 7f7791600640 1 -- 172.21.15.47:0/1531160242 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778000cdf0 con 0x7f779406ca40 2024-05-27T10:52:09.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.099+0000 7f3e60c00640 1 --2- 172.21.15.47:0/3299365114 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3e4406caf0 0x7f3e4406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.099+0000 7f779b000640 1 -- 172.21.15.47:0/1531160242 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77941fbf20 con 0x7f779406ca40 2024-05-27T10:52:09.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.099+0000 7f3e60c00640 1 -- 172.21.15.47:0/3299365114 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3e5008b8c0 con 0x7f3e64162c60 2024-05-27T10:52:09.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.099+0000 7f3e60c00640 1 --2- 172.21.15.47:0/3299365114 >> [v2:172.21.15.47:6800/1852621480,v1:172.21.15.47:6801/1852621480] conn(0x7f3e44074c90 0x7f3e440770b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.099+0000 7f3e60c00640 1 -- 172.21.15.47:0/3299365114 --> [v2:172.21.15.47:6800/1852621480,v1:172.21.15.47:6801/1852621480] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e44077760 con 0x7f3e44074c90 2024-05-27T10:52:09.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.099+0000 7f3e60c00640 1 -- 172.21.15.47:0/3299365114 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3e50090280 con 0x7f3e64162c60 2024-05-27T10:52:09.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.099+0000 7f8029e00640 1 -- start start 2024-05-27T10:52:09.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.100+0000 7fdcda600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdccc0361b0 0x7fdccc0db1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.100+0000 7f3e69c00640 1 --2- 172.21.15.47:0/3299365114 >> [v2:172.21.15.47:6800/1852621480,v1:172.21.15.47:6801/1852621480] conn(0x7f3e44074c90 0x7f3e440770b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.100+0000 7f779b000640 1 -- 172.21.15.47:0/1531160242 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77941fc4e0 con 0x7f779406ca40 2024-05-27T10:52:09.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.100+0000 7fdcda600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdccc04a320 0x7fdccc0e6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.100+0000 7fdcda600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdccc0529f0 0x7fdccc0e72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.100+0000 7f31c1800640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f31bc161e70 0x7f31bc0cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.100+0000 7f31c1800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f31bc0d3480 0x7f31bc0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.100+0000 7f6b19c00640 1 -- 172.21.15.47:0/2492042268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6b0c0052c0 con 0x7f6b0c0e3260 2024-05-27T10:52:09.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.101+0000 7f3e69200640 1 --2- 172.21.15.47:0/3299365114 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3e4406caf0 0x7f3e4406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.101+0000 7fdcd3e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdccc04a320 0x7fdccc0e6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.101+0000 7fdcd3e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdccc04a320 0x7fdccc0e6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:43932/0 (socket says 172.21.15.47:43932) 2024-05-27T10:52:09.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.101+0000 7fdcd3e00640 1 -- 172.21.15.47:0/913696641 learned_addr learned my addr 172.21.15.47:0/913696641 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.101+0000 7fdcda600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc0eb4d0 con 0x7fdccc0361b0 2024-05-27T10:52:09.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.101+0000 7f31c1800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31bc162250 con 0x7f31bc0d0380 2024-05-27T10:52:09.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.101+0000 7f31c1800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f31bc0d2ff0 con 0x7f31bc0d3480 2024-05-27T10:52:09.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.101+0000 7f31c1800640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f31bc0d23e0 con 0x7f31bc161e70 2024-05-27T10:52:09.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.101+0000 7fdcda600640 1 -- 172.21.15.47:0/913696641 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc0eb350 con 0x7fdccc04a320 2024-05-27T10:52:09.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.101+0000 7fdcda600640 1 -- 172.21.15.47:0/913696641 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fdccc054870 con 0x7fdccc0529f0 2024-05-27T10:52:09.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.101+0000 7fdcd9c00640 1 --2- 172.21.15.47:0/913696641 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdccc0529f0 0x7fdccc0e72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.101+0000 7f31baa00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f31bc161e70 0x7f31bc0cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.101+0000 7f3e69c00640 1 --2- 172.21.15.47:0/3299365114 >> [v2:172.21.15.47:6800/1852621480,v1:172.21.15.47:6801/1852621480] conn(0x7f3e44074c90 0x7f3e440770b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.102+0000 7fdcd9200640 1 --2- 172.21.15.47:0/913696641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdccc0361b0 0x7fdccc0db1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.102+0000 7f023c600640 1 Processor -- start 2024-05-27T10:52:09.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.102+0000 7f31ba000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f31bc0d3480 0x7f31bc0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.102+0000 7f023c600640 1 -- start start 2024-05-27T10:52:09.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.102+0000 7f31ba000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f31bc0d3480 0x7f31bc0d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35142/0 (socket says 172.21.15.47:35142) 2024-05-27T10:52:09.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.102+0000 7f8ef5c00640 1 Processor -- start 2024-05-27T10:52:09.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.103+0000 7f779b000640 1 -- 172.21.15.47:0/1531160242 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f77941fcba0 con 0x7f779406ca40 2024-05-27T10:52:09.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.103+0000 7f8029e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f801c0061e0 0x7f801c0515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.103+0000 7f8029e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f801c006bd0 0x7f801c052870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.103+0000 7f8029e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f801c0e32f0 0x7f801c04eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.103+0000 7f8029e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f801c058bd0 con 0x7f801c006bd0 2024-05-27T10:52:09.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.103+0000 7f8029e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f801c0583d0 con 0x7f801c0061e0 2024-05-27T10:52:09.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.103+0000 7f8029e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f801c051160 con 0x7f801c0e32f0 2024-05-27T10:52:09.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.103+0000 7f8ef5c00640 1 -- start start 2024-05-27T10:52:09.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.103+0000 7fdcd9c00640 1 -- 172.21.15.47:0/913696641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdccc04a320 msgr2=0x7fdccc0e6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.103+0000 7fdcd9c00640 1 --2- 172.21.15.47:0/913696641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdccc04a320 0x7fdccc0e6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.103+0000 7fdcd9c00640 1 -- 172.21.15.47:0/913696641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdccc0361b0 msgr2=0x7fdccc0db1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.103+0000 7fdcd9c00640 1 --2- 172.21.15.47:0/913696641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdccc0361b0 0x7fdccc0db1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.103+0000 7fdcd9c00640 1 -- 172.21.15.47:0/913696641 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdccc04c9a0 con 0x7fdccc0529f0 2024-05-27T10:52:09.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.104+0000 7f8022a00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f801c0061e0 0x7f801c0515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.104+0000 7f8022a00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f801c0061e0 0x7f801c0515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:43952/0 (socket says 172.21.15.47:43952) 2024-05-27T10:52:09.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.104+0000 7f8022a00640 1 -- 172.21.15.47:0/1214945706 learned_addr learned my addr 172.21.15.47:0/1214945706 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.104+0000 7f3e60c00640 1 -- 172.21.15.47:0/3299365114 <== osd.0 v2:172.21.15.47:6800/1852621480 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3e44077760 con 0x7f3e44074c90 2024-05-27T10:52:09.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.104+0000 7f3e69200640 1 --2- 172.21.15.47:0/3299365114 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3e4406caf0 0x7f3e4406efb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3e58009560 tx=0x7f3e58009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.102+0000 7f31ba000640 1 -- 172.21.15.47:0/384951703 learned_addr learned my addr 172.21.15.47:0/384951703 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.104+0000 7f31baa00640 1 -- 172.21.15.47:0/384951703 >> v2:172.21.15.47:3300/0 conn(0x7f31bc0d3480 msgr2=0x7f31bc0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.104+0000 7f31baa00640 1 --2- 172.21.15.47:0/384951703 >> v2:172.21.15.47:3300/0 conn(0x7f31bc0d3480 0x7f31bc0d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.104+0000 7f31baa00640 1 -- 172.21.15.47:0/384951703 >> v1:172.21.15.47:6789/0 conn(0x7f31bc0d0380 legacy=0x7f31bc1624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.105+0000 7f023c600640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f023415f120 0x7f02340ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.104+0000 7f31baa00640 1 -- 172.21.15.47:0/384951703 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31bc0d26c0 con 0x7f31bc161e70 2024-05-27T10:52:09.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.104+0000 7fdcd9c00640 1 --2- 172.21.15.47:0/913696641 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdccc0529f0 0x7fdccc0e72a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000d4c0 tx=0x7fdcc000d980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.104+0000 7f8023400640 1 --2- 172.21.15.47:0/1214945706 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f801c0e32f0 0x7f801c04eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.105+0000 7f8022a00640 1 -- 172.21.15.47:0/1214945706 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f801c0e32f0 msgr2=0x7f801c04eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.105+0000 7f8022a00640 1 --2- 172.21.15.47:0/1214945706 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f801c0e32f0 0x7f801c04eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.105+0000 7f8022a00640 1 -- 172.21.15.47:0/1214945706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f801c006bd0 msgr2=0x7f801c052870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.105+0000 7f023c600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f02340b3c00 0x7f02340b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.105+0000 7f8ef5c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8ef015b6d0 0x7f8ef006f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.105+0000 7f8ef5c00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8ef006c050 0x7f8ef015fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.105+0000 7f8ef5c00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ef00b3860 con 0x7f8ef00ce5d0 2024-05-27T10:52:09.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.105+0000 7f8ef5c00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f8ef00b4450 con 0x7f8ef006c050 2024-05-27T10:52:09.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.105+0000 7f8ef5c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8ef00b3b20 con 0x7f8ef015b6d0 2024-05-27T10:52:09.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.105+0000 7f6b07e00640 1 -- 172.21.15.47:0/2492042268 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6b00007400 con 0x7f6b0c0e3260 2024-05-27T10:52:09.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.105+0000 7f023c600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02340b0190 con 0x7f02340d0270 2024-05-27T10:52:09.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.105+0000 7f0239c00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f02340d0270 0x7f02340d0650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43890/0 (socket says 172.21.15.47:43890) 2024-05-27T10:52:09.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.105+0000 7f0239c00640 1 -- 172.21.15.47:0/2371142662 learned_addr learned my addr 172.21.15.47:0/2371142662 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:09.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.105+0000 7f023c600640 1 -- 172.21.15.47:0/2371142662 --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f02340b44c0 con 0x7f02340b3c00 2024-05-27T10:52:09.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.105+0000 7f023c600640 1 -- 172.21.15.47:0/2371142662 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f02340b0470 con 0x7f023415f120 2024-05-27T10:52:09.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.106+0000 7f023a600640 1 --2- 172.21.15.47:0/2371142662 >> v2:172.21.15.47:3300/0 conn(0x7f02340b3c00 0x7f02340b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.106+0000 7f8eeea00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8ef015b6d0 0x7f8ef006f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.106+0000 7f8eeea00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8ef015b6d0 0x7f8ef006f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:56518/0 (socket says 172.21.15.47:56518) 2024-05-27T10:52:09.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.106+0000 7f8eeea00640 1 -- 172.21.15.47:0/983806228 learned_addr learned my addr 172.21.15.47:0/983806228 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.105+0000 7fdcd0c00640 1 -- 172.21.15.47:0/913696641 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0004020 con 0x7fdccc0529f0 2024-05-27T10:52:09.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.106+0000 7fdcd0c00640 1 -- 172.21.15.47:0/913696641 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc00041e0 con 0x7fdccc0529f0 2024-05-27T10:52:09.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.106+0000 7fdcd0c00640 1 -- 172.21.15.47:0/913696641 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc00043d0 con 0x7fdccc0529f0 2024-05-27T10:52:09.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.106+0000 7f0239200640 1 --2- 172.21.15.47:0/2371142662 >> v2:172.21.15.53:3300/0 conn(0x7f023415f120 0x7f02340ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.106+0000 7f023a600640 1 -- 172.21.15.47:0/2371142662 >> v2:172.21.15.53:3300/0 conn(0x7f023415f120 msgr2=0x7f02340ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.106+0000 7f023a600640 1 --2- 172.21.15.47:0/2371142662 >> v2:172.21.15.53:3300/0 conn(0x7f023415f120 0x7f02340ad2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.106+0000 7f023a600640 1 -- 172.21.15.47:0/2371142662 >> v1:172.21.15.47:6789/0 conn(0x7f02340d0270 legacy=0x7f02340d0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.106+0000 7f8eef400640 1 --2- 172.21.15.47:0/983806228 >> v2:172.21.15.53:3300/0 conn(0x7f8ef006c050 0x7f8ef015fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.107+0000 7f6b07e00640 1 --2- 172.21.15.47:0/2492042268 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6af406c940 0x7f6af406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.107+0000 7f8eeea00640 1 -- 172.21.15.47:0/983806228 >> v2:172.21.15.53:3300/0 conn(0x7f8ef006c050 msgr2=0x7f8ef015fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.107+0000 7f8eeea00640 1 --2- 172.21.15.47:0/983806228 >> v2:172.21.15.53:3300/0 conn(0x7f8ef006c050 0x7f8ef015fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.107+0000 7f8eeea00640 1 -- 172.21.15.47:0/983806228 >> v1:172.21.15.53:6789/0 conn(0x7f8ef00ce5d0 legacy=0x7f8ef006b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.107+0000 7f8eeea00640 1 -- 172.21.15.47:0/983806228 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef00b3e00 con 0x7f8ef015b6d0 2024-05-27T10:52:09.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.107+0000 7f6b07e00640 1 -- 172.21.15.47:0/2492042268 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6b00056d50 con 0x7f6b0c0e3260 2024-05-27T10:52:09.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.105+0000 7f8022000640 1 --2- 172.21.15.47:0/1214945706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f801c006bd0 0x7f801c052870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.106+0000 7f8022a00640 1 --2- 172.21.15.47:0/1214945706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f801c006bd0 0x7f801c052870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.106+0000 7f8022a00640 1 -- 172.21.15.47:0/1214945706 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f801c051b30 con 0x7f801c0061e0 2024-05-27T10:52:09.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.107+0000 7f8022a00640 1 --2- 172.21.15.47:0/1214945706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f801c0061e0 0x7f801c0515f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f80240699b0 tx=0x7f802406cd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.106+0000 7fdcda600640 1 -- 172.21.15.47:0/913696641 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdccc04cc80 con 0x7fdccc0529f0 2024-05-27T10:52:09.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.106+0000 7fdcda600640 1 -- 172.21.15.47:0/913696641 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdccc04d240 con 0x7fdccc0529f0 2024-05-27T10:52:09.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.107+0000 7f6b07e00640 1 --2- 172.21.15.47:0/2492042268 >> [v2:172.21.15.47:6824/1861819371,v1:172.21.15.47:6825/1861819371] conn(0x7f6af4075770 0x7f6af4077c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.108+0000 7f6b07e00640 1 -- 172.21.15.47:0/2492042268 --> [v2:172.21.15.47:6824/1861819371,v1:172.21.15.47:6825/1861819371] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6af40782e0 con 0x7f6af4075770 2024-05-27T10:52:09.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.108+0000 7f6b07e00640 1 -- 172.21.15.47:0/2492042268 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6b000556e0 con 0x7f6b0c0e3260 2024-05-27T10:52:09.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.108+0000 7f6b13e00640 1 --2- 172.21.15.47:0/2492042268 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6af406c940 0x7f6af406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.107+0000 7f023a600640 1 -- 172.21.15.47:0/2371142662 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02340b0750 con 0x7f02340b3c00 2024-05-27T10:52:09.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.108+0000 7f6b13400640 1 --2- 172.21.15.47:0/2492042268 >> [v2:172.21.15.47:6824/1861819371,v1:172.21.15.47:6825/1861819371] conn(0x7f6af4075770 0x7f6af4077c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.107+0000 7f8022000640 1 --2- 172.21.15.47:0/1214945706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f801c006bd0 0x7f801c052870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:09.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.104+0000 7f7791600640 1 -- 172.21.15.47:0/1531160242 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f778001a070 con 0x7f779406ca40 2024-05-27T10:52:09.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.108+0000 7fdcda600640 1 -- 172.21.15.47:0/913696641 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdccc005710 con 0x7fdccc0529f0 2024-05-27T10:52:09.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.106+0000 7f7791600640 1 --2- 172.21.15.47:0/1531160242 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f777406c970 0x7f777406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.106+0000 7f7791600640 1 -- 172.21.15.47:0/1531160242 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f778008b930 con 0x7f779406ca40 2024-05-27T10:52:09.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.106+0000 7f7791600640 1 --2- 172.21.15.47:0/1531160242 >> [v2:172.21.15.47:6808/3537662321,v1:172.21.15.47:6809/3537662321] conn(0x7f7774074b70 0x7f7774076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.106+0000 7f7791600640 1 -- 172.21.15.47:0/1531160242 --> [v2:172.21.15.47:6808/3537662321,v1:172.21.15.47:6809/3537662321] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7774077640 con 0x7f7774074b70 2024-05-27T10:52:09.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.107+0000 7f779a600640 1 --2- 172.21.15.47:0/1531160242 >> [v2:172.21.15.47:6808/3537662321,v1:172.21.15.47:6809/3537662321] conn(0x7f7774074b70 0x7f7774076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.107+0000 7f7799200640 1 --2- 172.21.15.47:0/1531160242 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f777406c970 0x7f777406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.108+0000 7f7791600640 1 -- 172.21.15.47:0/1531160242 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7780055a70 con 0x7f779406ca40 2024-05-27T10:52:09.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.109+0000 7f779a600640 1 --2- 172.21.15.47:0/1531160242 >> [v2:172.21.15.47:6808/3537662321,v1:172.21.15.47:6809/3537662321] conn(0x7f7774074b70 0x7f7774076f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.109+0000 7f801b400640 1 -- 172.21.15.47:0/1214945706 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8024071840 con 0x7f801c0061e0 2024-05-27T10:52:09.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.109+0000 7f023a600640 1 --2- 172.21.15.47:0/2371142662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02340b3c00 0x7f02340b0f50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f02340d1340 tx=0x7f022002c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a986605ac7a0f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.109+0000 7f801b400640 1 -- 172.21.15.47:0/1214945706 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80240719e0 con 0x7f801c0061e0 2024-05-27T10:52:09.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.109+0000 7f801b400640 1 -- 172.21.15.47:0/1214945706 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8024071bd0 con 0x7f801c0061e0 2024-05-27T10:52:09.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.109+0000 7f8029e00640 1 -- 172.21.15.47:0/1214945706 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f801c052db0 con 0x7f801c0061e0 2024-05-27T10:52:09.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.109+0000 7f7799200640 1 --2- 172.21.15.47:0/1531160242 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f777406c970 0x7f777406ee30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f77940ba260 tx=0x7f7788008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.109+0000 7f8029e00640 1 -- 172.21.15.47:0/1214945706 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f801c050830 con 0x7f801c0061e0 2024-05-27T10:52:09.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.109+0000 7f6b13e00640 1 --2- 172.21.15.47:0/2492042268 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6af406c940 0x7f6af406ee00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6b1406afa0 tx=0x7f6b1406e040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.109+0000 7f0233e00640 1 -- 172.21.15.47:0/2371142662 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220038070 con 0x7f02340b3c00 2024-05-27T10:52:09.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.109+0000 7f0233e00640 1 -- 172.21.15.47:0/2371142662 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0220031710 con 0x7f02340b3c00 2024-05-27T10:52:09.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.110+0000 7f0233e00640 1 -- 172.21.15.47:0/2371142662 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220031ae0 con 0x7f02340b3c00 2024-05-27T10:52:09.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.110+0000 7f6b13400640 1 --2- 172.21.15.47:0/2492042268 >> [v2:172.21.15.47:6824/1861819371,v1:172.21.15.47:6825/1861819371] conn(0x7f6af4075770 0x7f6af4077c10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.110+0000 7f7791600640 1 -- 172.21.15.47:0/1531160242 <== osd.1 v2:172.21.15.47:6808/3537662321 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7774077640 con 0x7f7774074b70 2024-05-27T10:52:09.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.110+0000 7f023c600640 1 -- 172.21.15.47:0/2371142662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02340b3c00 msgr2=0x7f02340b0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.110+0000 7f8eeea00640 1 --2- 172.21.15.47:0/983806228 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8ef015b6d0 0x7f8ef006f5b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0009870 tx=0x7f8ee002a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41280ec7552563f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.110+0000 7f023c600640 1 --2- 172.21.15.47:0/2371142662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02340b3c00 0x7f02340b0f50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f02340d1340 tx=0x7f022002c3d0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.110+0000 7f31baa00640 1 --2- 172.21.15.47:0/384951703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31bc161e70 0x7f31bc0cfe40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0b7200 tx=0x7f31a802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acbd6e3d5e2e14a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.111+0000 7f8eee000640 1 -- 172.21.15.47:0/983806228 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee0037070 con 0x7f8ef015b6d0 2024-05-27T10:52:09.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.111+0000 7f8eee000640 1 -- 172.21.15.47:0/983806228 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ee0032440 con 0x7f8ef015b6d0 2024-05-27T10:52:09.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.111+0000 7f8eee000640 1 -- 172.21.15.47:0/983806228 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee0032810 con 0x7f8ef015b6d0 2024-05-27T10:52:09.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.111+0000 7f023c600640 1 -- 172.21.15.47:0/2371142662 shutdown_connections 2024-05-27T10:52:09.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.111+0000 7f023c600640 1 --2- 172.21.15.47:0/2371142662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02340b3c00 0x7f02340b0f50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.111+0000 7f023c600640 1 --2- 172.21.15.47:0/2371142662 >> v2:172.21.15.53:3300/0 conn(0x7f023415f120 0x7f02340ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.111+0000 7f023c600640 1 -- 172.21.15.47:0/2371142662 >> 172.21.15.47:0/2371142662 conn(0x7f0234072170 msgr2=0x7f02340b56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.111+0000 7f8029e00640 1 -- 172.21.15.47:0/1214945706 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7ffc001030 con 0x7f801c0061e0 2024-05-27T10:52:09.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.111+0000 7f31b9600640 1 -- 172.21.15.47:0/384951703 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a8037070 con 0x7f31bc161e70 2024-05-27T10:52:09.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.111+0000 7f31b9600640 1 -- 172.21.15.47:0/384951703 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a8032440 con 0x7f31bc161e70 2024-05-27T10:52:09.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.112+0000 7fdcd0c00640 1 -- 172.21.15.47:0/913696641 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdcc001b020 con 0x7fdccc0529f0 2024-05-27T10:52:09.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.111+0000 7f31b9600640 1 -- 172.21.15.47:0/384951703 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a8032810 con 0x7f31bc161e70 2024-05-27T10:52:09.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.112+0000 7f6b07e00640 1 -- 172.21.15.47:0/2492042268 <== osd.2 v2:172.21.15.47:6824/1861819371 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6af40782e0 con 0x7f6af4075770 2024-05-27T10:52:09.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.112+0000 7fdcd0c00640 1 --2- 172.21.15.47:0/913696641 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdcb406c920 0x7fdcb406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.111+0000 7f023c600640 1 -- 172.21.15.47:0/2371142662 shutdown_connections 2024-05-27T10:52:09.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.112+0000 7f023c600640 1 -- 172.21.15.47:0/2371142662 wait complete. 2024-05-27T10:52:09.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.113+0000 7fdcd0c00640 1 -- 172.21.15.47:0/913696641 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdcc008c1a0 con 0x7fdccc0529f0 2024-05-27T10:52:09.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.113+0000 7fdcd0c00640 1 --2- 172.21.15.47:0/913696641 >> [v2:172.21.15.47:6816/830128512,v1:172.21.15.47:6817/830128512] conn(0x7fdcb4074b40 0x7fdcb4076f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.113+0000 7f31c1800640 1 -- 172.21.15.47:0/384951703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31bc161e70 msgr2=0x7f31bc0cfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.113+0000 7f31c1800640 1 --2- 172.21.15.47:0/384951703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31bc161e70 0x7f31bc0cfe40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0b7200 tx=0x7f31a802a1a0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.113+0000 7f8ef5c00640 1 -- 172.21.15.47:0/983806228 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8ef015b6d0 msgr2=0x7f8ef006f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.113+0000 7f8ef5c00640 1 --2- 172.21.15.47:0/983806228 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8ef015b6d0 0x7f8ef006f5b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0009870 tx=0x7f8ee002a130 comp rx=0 tx=0).stop 2024-05-27T10:52:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.113+0000 7f8ef5c00640 1 -- 172.21.15.47:0/983806228 shutdown_connections 2024-05-27T10:52:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.113+0000 7f8ef5c00640 1 --2- 172.21.15.47:0/983806228 >> v2:172.21.15.53:3300/0 conn(0x7f8ef006c050 0x7f8ef015fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.113+0000 7fdcd0c00640 1 -- 172.21.15.47:0/913696641 --> [v2:172.21.15.47:6816/830128512,v1:172.21.15.47:6817/830128512] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdcb4077610 con 0x7fdcb4074b40 2024-05-27T10:52:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.113+0000 7fdcd0c00640 1 -- 172.21.15.47:0/913696641 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fdcc008c590 con 0x7fdccc0529f0 2024-05-27T10:52:09.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.113+0000 7f8ef5c00640 1 --2- 172.21.15.47:0/983806228 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8ef015b6d0 0x7f8ef006f5b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.113+0000 7f8ef5c00640 1 -- 172.21.15.47:0/983806228 >> 172.21.15.47:0/983806228 conn(0x7f8ef00d07b0 msgr2=0x7f8ef00d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.113+0000 7fdcd3e00640 1 --2- 172.21.15.47:0/913696641 >> [v2:172.21.15.47:6816/830128512,v1:172.21.15.47:6817/830128512] conn(0x7fdcb4074b40 0x7fdcb4076f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.113+0000 7f8ef5c00640 1 -- 172.21.15.47:0/983806228 shutdown_connections 2024-05-27T10:52:09.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.113+0000 7f8ef5c00640 1 -- 172.21.15.47:0/983806228 wait complete. 2024-05-27T10:52:09.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.114+0000 7f023c600640 1 Processor -- start 2024-05-27T10:52:09.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.114+0000 7f023c600640 1 -- start start 2024-05-27T10:52:09.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.114+0000 7fdcd9200640 1 --2- 172.21.15.47:0/913696641 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdcb406c920 0x7fdcb406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.114+0000 7fdcd3e00640 1 --2- 172.21.15.47:0/913696641 >> [v2:172.21.15.47:6816/830128512,v1:172.21.15.47:6817/830128512] conn(0x7fdcb4074b40 0x7fdcb4076f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.115+0000 7fdcd9200640 1 --2- 172.21.15.47:0/913696641 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdcb406c920 0x7fdcb406ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4069ad0 tx=0x7fdcd406e040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.115+0000 7f801b400640 1 -- 172.21.15.47:0/1214945706 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8024094480 con 0x7f801c0061e0 2024-05-27T10:52:09.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.116+0000 7fdcd0c00640 1 -- 172.21.15.47:0/913696641 <== osd.3 v2:172.21.15.47:6816/830128512 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdcb4077610 con 0x7fdcb4074b40 2024-05-27T10:52:09.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.116+0000 7f31c1800640 1 -- 172.21.15.47:0/384951703 shutdown_connections 2024-05-27T10:52:09.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.116+0000 7f31c1800640 1 --2- 172.21.15.47:0/384951703 >> v2:172.21.15.47:3300/0 conn(0x7f31bc0d3480 0x7f31bc0d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.116+0000 7f31c1800640 1 --2- 172.21.15.47:0/384951703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31bc161e70 0x7f31bc0cfe40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.116+0000 7f31c1800640 1 -- 172.21.15.47:0/384951703 >> 172.21.15.47:0/384951703 conn(0x7f31bc08bfd0 msgr2=0x7f31bc0d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.116+0000 7f8ef5c00640 1 Processor -- start 2024-05-27T10:52:09.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.116+0000 7f801b400640 1 --2- 172.21.15.47:0/1214945706 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f800406c940 0x7f800406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.117+0000 7f023c600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02340b3c00 0x7f0234159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.117+0000 7f801b400640 1 -- 172.21.15.47:0/1214945706 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8024107320 con 0x7f801c0061e0 2024-05-27T10:52:09.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.117+0000 7f023c600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02340d0270 0x7f02340cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.117+0000 7f801b400640 1 --2- 172.21.15.47:0/1214945706 >> [v2:172.21.15.53:6800/331298306,v1:172.21.15.53:6801/331298306] conn(0x7f8004074bc0 0x7f8004076fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.117+0000 7f023c600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f023415f120 0x7f02341eca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.117+0000 7f801b400640 1 -- 172.21.15.47:0/1214945706 --> [v2:172.21.15.53:6800/331298306,v1:172.21.15.53:6801/331298306] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f802408de50 con 0x7f8004074bc0 2024-05-27T10:52:09.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.117+0000 7f801b400640 1 -- 172.21.15.47:0/1214945706 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8024107800 con 0x7f801c0061e0 2024-05-27T10:52:09.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.117+0000 7f0239c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02340b3c00 0x7f0234159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.117+0000 7f0239c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02340b3c00 0x7f0234159fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:56522/0 (socket says 172.21.15.47:56522) 2024-05-27T10:52:09.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.117+0000 7f0239c00640 1 -- 172.21.15.47:0/1721555006 learned_addr learned my addr 172.21.15.47:0/1721555006 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.117+0000 7f8022000640 1 --2- 172.21.15.47:0/1214945706 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f800406c940 0x7f800406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.118+0000 7f31c1800640 1 -- 172.21.15.47:0/384951703 shutdown_connections 2024-05-27T10:52:09.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.118+0000 7f023c600640 1 -- 172.21.15.47:0/1721555006 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f023415ac40 con 0x7f023415f120 2024-05-27T10:52:09.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.118+0000 7f023c600640 1 -- 172.21.15.47:0/1721555006 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f02340ad800 con 0x7f02340d0270 2024-05-27T10:52:09.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.118+0000 7f0239200640 1 --2- 172.21.15.47:0/1721555006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02340d0270 0x7f02340cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.118+0000 7f023c600640 1 -- 172.21.15.47:0/1721555006 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f02340b4090 con 0x7f02340b3c00 2024-05-27T10:52:09.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.118+0000 7f8023400640 1 --2- 172.21.15.47:0/1214945706 >> [v2:172.21.15.53:6800/331298306,v1:172.21.15.53:6801/331298306] conn(0x7f8004074bc0 0x7f8004076fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.117+0000 7f8ef5c00640 1 -- start start 2024-05-27T10:52:09.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.118+0000 7f31c1800640 1 -- 172.21.15.47:0/384951703 wait complete. 2024-05-27T10:52:09.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.118+0000 7f023a600640 1 --2- 172.21.15.47:0/1721555006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f023415f120 0x7f02341eca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.118+0000 7f8ef5c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8ef006c050 0x7f8ef00ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.118+0000 7f8ef5c00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ef015b6d0 0x7f8ef0157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.118+0000 7f8ef5c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ef01580f0 0x7f8ef015f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.118+0000 7f8ef5c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef0072110 con 0x7f8ef01580f0 2024-05-27T10:52:09.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.118+0000 7f8ef5c00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef006c830 con 0x7f8ef015b6d0 2024-05-27T10:52:09.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.118+0000 7f8ef5c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8ef0072290 con 0x7f8ef006c050 2024-05-27T10:52:09.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.119+0000 7f8022000640 1 --2- 172.21.15.47:0/1214945706 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f800406c940 0x7f800406ee00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f801c039620 tx=0x7f8010008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.119+0000 7f8eeea00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8ef006c050 0x7f8ef00ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.119+0000 7f8eeea00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8ef006c050 0x7f8ef00ccce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:56528/0 (socket says 172.21.15.47:56528) 2024-05-27T10:52:09.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.119+0000 7f8eeea00640 1 -- 172.21.15.47:0/2859572056 learned_addr learned my addr 172.21.15.47:0/2859572056 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.119+0000 7f8023400640 1 --2- 172.21.15.47:0/1214945706 >> [v2:172.21.15.53:6800/331298306,v1:172.21.15.53:6801/331298306] conn(0x7f8004074bc0 0x7f8004076fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.119+0000 7f023a600640 1 -- 172.21.15.47:0/1721555006 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02340b3c00 msgr2=0x7f0234159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.119+0000 7f023a600640 1 --2- 172.21.15.47:0/1721555006 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02340b3c00 0x7f0234159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.119+0000 7f023a600640 1 -- 172.21.15.47:0/1721555006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02340d0270 msgr2=0x7f02340cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.119+0000 7f023a600640 1 --2- 172.21.15.47:0/1721555006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02340d0270 0x7f02340cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.119+0000 7f8eef400640 1 --2- 172.21.15.47:0/2859572056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ef01580f0 0x7f8ef015f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.119+0000 7f023a600640 1 -- 172.21.15.47:0/1721555006 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02340ccec0 con 0x7f023415f120 2024-05-27T10:52:09.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.120+0000 7f8ee7e00640 1 --2- 172.21.15.47:0/2859572056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ef015b6d0 0x7f8ef0157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.120+0000 7f8eef400640 1 -- 172.21.15.47:0/2859572056 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8ef006c050 msgr2=0x7f8ef00ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.120+0000 7f8eef400640 1 --2- 172.21.15.47:0/2859572056 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8ef006c050 0x7f8ef00ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.120+0000 7f023a600640 1 --2- 172.21.15.47:0/1721555006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f023415f120 0x7f02341eca40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0220033000 tx=0x7f02200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.120+0000 7f8eef400640 1 -- 172.21.15.47:0/2859572056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ef015b6d0 msgr2=0x7f8ef0157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.120+0000 7f8eef400640 1 --2- 172.21.15.47:0/2859572056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ef015b6d0 0x7f8ef0157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.120+0000 7f8eef400640 1 -- 172.21.15.47:0/2859572056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef0158630 con 0x7f8ef01580f0 2024-05-27T10:52:09.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.120+0000 7f8ee7e00640 1 --2- 172.21.15.47:0/2859572056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ef015b6d0 0x7f8ef0157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:52:09.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.121+0000 7f8eef400640 1 --2- 172.21.15.47:0/2859572056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ef01580f0 0x7f8ef015f370 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8009d90 tx=0x7f8ee800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.121+0000 7f8ee6a00640 1 -- 172.21.15.47:0/2859572056 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8018020 con 0x7f8ef01580f0 2024-05-27T10:52:09.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.121+0000 7f0231600640 1 -- 172.21.15.47:0/1721555006 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220038050 con 0x7f023415f120 2024-05-27T10:52:09.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.121+0000 7f8ee6a00640 1 -- 172.21.15.47:0/2859572056 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ee8014480 con 0x7f8ef01580f0 2024-05-27T10:52:09.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.121+0000 7f023c600640 1 -- 172.21.15.47:0/1721555006 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02340cd1a0 con 0x7f023415f120 2024-05-27T10:52:09.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.121+0000 7f023c600640 1 -- 172.21.15.47:0/1721555006 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02340cd760 con 0x7f023415f120 2024-05-27T10:52:09.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.121+0000 7f8ee6a00640 1 -- 172.21.15.47:0/2859572056 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8014870 con 0x7f8ef01580f0 2024-05-27T10:52:09.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.121+0000 7f8ef5c00640 1 -- 172.21.15.47:0/2859572056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ef0158910 con 0x7f8ef01580f0 2024-05-27T10:52:09.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.121+0000 7f8ef5c00640 1 -- 172.21.15.47:0/2859572056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ef00cd220 con 0x7f8ef01580f0 2024-05-27T10:52:09.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.122+0000 7f31c1800640 1 Processor -- start 2024-05-27T10:52:09.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.122+0000 7f31c1800640 1 -- start start 2024-05-27T10:52:09.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.122+0000 7f801b400640 1 -- 172.21.15.47:0/1214945706 <== osd.4 v2:172.21.15.53:6800/331298306 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f802408de50 con 0x7f8004074bc0 2024-05-27T10:52:09.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.123+0000 7f31c1800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f31bc0d0380 0x7f31bc0c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.123+0000 7f31c1800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31bc0d3480 0x7f31bc1f99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.123+0000 7f31c1800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31bc161e70 0x7f31bc15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.124+0000 7f31c1800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f31bc0d15a0 con 0x7f31bc0d3480 2024-05-27T10:52:09.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.124+0000 7f31c1800640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f31bc0d2c80 con 0x7f31bc161e70 2024-05-27T10:52:09.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.124+0000 7f31c1800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f31bc0d1720 con 0x7f31bc0d0380 2024-05-27T10:52:09.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.124+0000 7f31bb400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31bc161e70 0x7f31bc15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.123+0000 7f0231600640 1 -- 172.21.15.47:0/1721555006 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0220044070 con 0x7f023415f120 2024-05-27T10:52:09.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.123+0000 7f0231600640 1 -- 172.21.15.47:0/1721555006 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220038050 con 0x7f023415f120 2024-05-27T10:52:09.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.124+0000 7f31baa00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f31bc0d0380 0x7f31bc0c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.126+0000 7f8ee6a00640 1 -- 172.21.15.47:0/2859572056 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ee8005d10 con 0x7f8ef01580f0 2024-05-27T10:52:09.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.127+0000 7f8ef5c00640 1 -- 172.21.15.47:0/2859572056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ef00690f0 con 0x7f8ef01580f0 2024-05-27T10:52:09.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.125+0000 7f31baa00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f31bc0d0380 0x7f31bc0c9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:56540/0 (socket says 172.21.15.47:56540) 2024-05-27T10:52:09.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.126+0000 7f31ba000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31bc0d3480 0x7f31bc1f99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.126+0000 7f31ba000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31bc0d3480 0x7f31bc1f99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35196/0 (socket says 172.21.15.47:35196) 2024-05-27T10:52:09.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.126+0000 7f31ba000640 1 -- 172.21.15.47:0/4287165983 learned_addr learned my addr 172.21.15.47:0/4287165983 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.127+0000 7f31ba000640 1 -- 172.21.15.47:0/4287165983 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f31bc0d0380 msgr2=0x7f31bc0c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.128+0000 7f31ba000640 1 --2- 172.21.15.47:0/4287165983 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f31bc0d0380 0x7f31bc0c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.128+0000 7f31ba000640 1 -- 172.21.15.47:0/4287165983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31bc161e70 msgr2=0x7f31bc15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.128+0000 7f023c600640 1 -- 172.21.15.47:0/1721555006 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0210001030 con 0x7f023415f120 2024-05-27T10:52:09.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.128+0000 7f31ba000640 1 --2- 172.21.15.47:0/4287165983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31bc161e70 0x7f31bc15ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.128+0000 7f31ba000640 1 -- 172.21.15.47:0/4287165983 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31bc0c8420 con 0x7f31bc0d3480 2024-05-27T10:52:09.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.128+0000 7f8ee6a00640 1 --2- 172.21.15.47:0/2859572056 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f8ecc06c970 0x7f8ecc06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.128+0000 7f31baa00640 1 --2- 172.21.15.47:0/4287165983 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f31bc0d0380 0x7f31bc0c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:09.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.128+0000 7f31bb400640 1 --2- 172.21.15.47:0/4287165983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31bc161e70 0x7f31bc15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:09.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.128+0000 7f31ba000640 1 --2- 172.21.15.47:0/4287165983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31bc0d3480 0x7f31bc1f99c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00e7e0 tx=0x7f31ac00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.128+0000 7f8ee6a00640 1 -- 172.21.15.47:0/2859572056 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8ee80586f0 con 0x7f8ef01580f0 2024-05-27T10:52:09.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.129+0000 7f8eeea00640 1 --2- 172.21.15.47:0/2859572056 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f8ecc06c970 0x7f8ecc06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.129+0000 7f31b2a00640 1 -- 172.21.15.47:0/4287165983 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac017070 con 0x7f31bc0d3480 2024-05-27T10:52:09.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.129+0000 7f31b2a00640 1 -- 172.21.15.47:0/4287165983 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31ac00c8d0 con 0x7f31bc0d3480 2024-05-27T10:52:09.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.129+0000 7f31b2a00640 1 -- 172.21.15.47:0/4287165983 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac00f040 con 0x7f31bc0d3480 2024-05-27T10:52:09.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.129+0000 7f31c1800640 1 -- 172.21.15.47:0/4287165983 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31bc0c8700 con 0x7f31bc0d3480 2024-05-27T10:52:09.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.129+0000 7f8ee6a00640 1 --2- 172.21.15.47:0/2859572056 >> [v2:172.21.15.53:6824/841884034,v1:172.21.15.53:6825/841884034] conn(0x7f8ecc0757a0 0x7f8ecc077c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.129+0000 7f8ee6a00640 1 -- 172.21.15.47:0/2859572056 --> [v2:172.21.15.53:6824/841884034,v1:172.21.15.53:6825/841884034] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ecc078310 con 0x7f8ecc0757a0 2024-05-27T10:52:09.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.129+0000 7f31c1800640 1 -- 172.21.15.47:0/4287165983 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31bc0c8cc0 con 0x7f31bc0d3480 2024-05-27T10:52:09.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.131+0000 7f8ee7e00640 1 --2- 172.21.15.47:0/2859572056 >> [v2:172.21.15.53:6824/841884034,v1:172.21.15.53:6825/841884034] conn(0x7f8ecc0757a0 0x7f8ecc077c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.131+0000 7f31c1800640 1 -- 172.21.15.47:0/4287165983 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f31bc0689e0 con 0x7f31bc0d3480 2024-05-27T10:52:09.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.132+0000 7f8ee6a00640 1 -- 172.21.15.47:0/2859572056 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8ee8057080 con 0x7f8ef01580f0 2024-05-27T10:52:09.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.132+0000 7f8eeea00640 1 --2- 172.21.15.47:0/2859572056 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f8ecc06c970 0x7f8ecc06ee30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8ee002a170 tx=0x7f8ee002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.128+0000 7f0231600640 1 -- 172.21.15.47:0/1721555006 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f02200315d0 con 0x7f023415f120 2024-05-27T10:52:09.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.132+0000 7f8ee7e00640 1 --2- 172.21.15.47:0/2859572056 >> [v2:172.21.15.53:6824/841884034,v1:172.21.15.53:6825/841884034] conn(0x7f8ecc0757a0 0x7f8ecc077c40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.133+0000 7f0231600640 1 --2- 172.21.15.47:0/1721555006 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f021406caf0 0x7f021406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.133+0000 7f0231600640 1 -- 172.21.15.47:0/1721555006 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f02200ac940 con 0x7f023415f120 2024-05-27T10:52:09.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.133+0000 7f0231600640 1 --2- 172.21.15.47:0/1721555006 >> [v2:172.21.15.53:6816/204629598,v1:172.21.15.53:6817/204629598] conn(0x7f0214074d10 0x7f0214077130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.133+0000 7f0231600640 1 -- 172.21.15.47:0/1721555006 --> [v2:172.21.15.53:6816/204629598,v1:172.21.15.53:6817/204629598] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f02200067f0 con 0x7f0214074d10 2024-05-27T10:52:09.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.133+0000 7f0231600640 1 -- 172.21.15.47:0/1721555006 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f02200b12a0 con 0x7f023415f120 2024-05-27T10:52:09.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.133+0000 7f31b2a00640 1 -- 172.21.15.47:0/4287165983 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f31ac01a070 con 0x7f31bc0d3480 2024-05-27T10:52:09.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.134+0000 7f0239200640 1 --2- 172.21.15.47:0/1721555006 >> [v2:172.21.15.53:6816/204629598,v1:172.21.15.53:6817/204629598] conn(0x7f0214074d10 0x7f0214077130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.134+0000 7f31b2a00640 1 --2- 172.21.15.47:0/4287165983 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f319c06c9c0 0x7f319c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.134+0000 7f31b2a00640 1 -- 172.21.15.47:0/4287165983 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f31ac08b710 con 0x7f31bc0d3480 2024-05-27T10:52:09.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.135+0000 7f31b2a00640 1 --2- 172.21.15.47:0/4287165983 >> [v2:172.21.15.53:6808/3828340653,v1:172.21.15.53:6809/3828340653] conn(0x7f319c074c40 0x7f319c077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.135+0000 7f31baa00640 1 --2- 172.21.15.47:0/4287165983 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f319c06c9c0 0x7f319c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.135+0000 7f31b2a00640 1 -- 172.21.15.47:0/4287165983 --> [v2:172.21.15.53:6808/3828340653,v1:172.21.15.53:6809/3828340653] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31ac006810 con 0x7f319c074c40 2024-05-27T10:52:09.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.135+0000 7f31b2a00640 1 -- 172.21.15.47:0/4287165983 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f31ac092050 con 0x7f31bc0d3480 2024-05-27T10:52:09.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.135+0000 7f0239200640 1 --2- 172.21.15.47:0/1721555006 >> [v2:172.21.15.53:6816/204629598,v1:172.21.15.53:6817/204629598] conn(0x7f0214074d10 0x7f0214077130 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.135+0000 7f0239c00640 1 --2- 172.21.15.47:0/1721555006 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f021406caf0 0x7f021406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.135+0000 7f0239c00640 1 --2- 172.21.15.47:0/1721555006 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f021406caf0 0x7f021406efb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f022c004c20 tx=0x7f022c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.135+0000 7f8ee6a00640 1 -- 172.21.15.47:0/2859572056 <== osd.7 v2:172.21.15.53:6824/841884034 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ecc078310 con 0x7f8ecc0757a0 2024-05-27T10:52:09.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.137+0000 7f31bb400640 1 --2- 172.21.15.47:0/4287165983 >> [v2:172.21.15.53:6808/3828340653,v1:172.21.15.53:6809/3828340653] conn(0x7f319c074c40 0x7f319c077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.137+0000 7f31baa00640 1 --2- 172.21.15.47:0/4287165983 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f319c06c9c0 0x7f319c06ee80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f31a8034000 tx=0x7f31a802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.137+0000 7f0231600640 1 -- 172.21.15.47:0/1721555006 <== osd.6 v2:172.21.15.53:6816/204629598 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f02200067f0 con 0x7f0214074d10 2024-05-27T10:52:09.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.139+0000 7f31bb400640 1 --2- 172.21.15.47:0/4287165983 >> [v2:172.21.15.53:6808/3828340653,v1:172.21.15.53:6809/3828340653] conn(0x7f319c074c40 0x7f319c077060 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.141+0000 7f31b2a00640 1 -- 172.21.15.47:0/4287165983 <== osd.5 v2:172.21.15.53:6808/3828340653 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f31ac006810 con 0x7f319c074c40 2024-05-27T10:52:09.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.142+0000 7f3e56000640 1 -- 172.21.15.47:0/3299365114 --> [v2:172.21.15.47:6800/1852621480,v1:172.21.15.47:6801/1852621480] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3e6404fce0 con 0x7f3e44074c90 2024-05-27T10:52:09.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.143+0000 7f3e60c00640 1 -- 172.21.15.47:0/3299365114 <== osd.0 v2:172.21.15.47:6800/1852621480 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3e6404fce0 con 0x7f3e44074c90 2024-05-27T10:52:09.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.144+0000 7f3e56000640 1 -- 172.21.15.47:0/3299365114 >> [v2:172.21.15.47:6800/1852621480,v1:172.21.15.47:6801/1852621480] conn(0x7f3e44074c90 msgr2=0x7f3e440770b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.144+0000 7fdcda600640 1 -- 172.21.15.47:0/913696641 --> [v2:172.21.15.47:6816/830128512,v1:172.21.15.47:6817/830128512] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdccc0565e0 con 0x7fdcb4074b40 2024-05-27T10:52:09.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.144+0000 7f3e56000640 1 --2- 172.21.15.47:0/3299365114 >> [v2:172.21.15.47:6800/1852621480,v1:172.21.15.47:6801/1852621480] conn(0x7f3e44074c90 0x7f3e440770b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.145+0000 7f3e56000640 1 -- 172.21.15.47:0/3299365114 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3e4406caf0 msgr2=0x7f3e4406efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.145+0000 7f3e56000640 1 --2- 172.21.15.47:0/3299365114 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3e4406caf0 0x7f3e4406efb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3e58009560 tx=0x7f3e58009190 comp rx=0 tx=0).stop 2024-05-27T10:52:09.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.145+0000 7fdcd0c00640 1 -- 172.21.15.47:0/913696641 <== osd.3 v2:172.21.15.47:6816/830128512 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdccc0565e0 con 0x7fdcb4074b40 2024-05-27T10:52:09.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.145+0000 7f3e56000640 1 -- 172.21.15.47:0/3299365114 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e64162c60 msgr2=0x7f3e640ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.145+0000 7f3e56000640 1 --2- 172.21.15.47:0/3299365114 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e64162c60 0x7f3e640ceaa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000e870 tx=0x7f3e5000ed30 comp rx=0 tx=0).stop 2024-05-27T10:52:09.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.146+0000 7fdcda600640 1 -- 172.21.15.47:0/913696641 >> [v2:172.21.15.47:6816/830128512,v1:172.21.15.47:6817/830128512] conn(0x7fdcb4074b40 msgr2=0x7fdcb4076f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.146+0000 7fdcda600640 1 --2- 172.21.15.47:0/913696641 >> [v2:172.21.15.47:6816/830128512,v1:172.21.15.47:6817/830128512] conn(0x7fdcb4074b40 0x7fdcb4076f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.146+0000 7fdcda600640 1 -- 172.21.15.47:0/913696641 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdcb406c920 msgr2=0x7fdcb406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.146+0000 7fdcda600640 1 --2- 172.21.15.47:0/913696641 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdcb406c920 0x7fdcb406ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4069ad0 tx=0x7fdcd406e040 comp rx=0 tx=0).stop 2024-05-27T10:52:09.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.146+0000 7fdcda600640 1 -- 172.21.15.47:0/913696641 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdccc0529f0 msgr2=0x7fdccc0e72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.146+0000 7fdcda600640 1 --2- 172.21.15.47:0/913696641 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdccc0529f0 0x7fdccc0e72a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000d4c0 tx=0x7fdcc000d980 comp rx=0 tx=0).stop 2024-05-27T10:52:09.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.146+0000 7fdcd9c00640 1 -- 172.21.15.47:0/913696641 reap_dead start 2024-05-27T10:52:09.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.147+0000 7fdcda600640 1 -- 172.21.15.47:0/913696641 shutdown_connections 2024-05-27T10:52:09.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.147+0000 7fdcda600640 1 -- 172.21.15.47:0/913696641 >> 172.21.15.47:0/913696641 conn(0x7fdccc0537b0 msgr2=0x7fdccc0ea6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.146+0000 7f3e69c00640 1 -- 172.21.15.47:0/3299365114 reap_dead start 2024-05-27T10:52:09.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.147+0000 7f3e56000640 1 -- 172.21.15.47:0/3299365114 shutdown_connections 2024-05-27T10:52:09.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.147+0000 7f3e56000640 1 -- 172.21.15.47:0/3299365114 >> 172.21.15.47:0/3299365114 conn(0x7f3e640b1ed0 msgr2=0x7f3e640b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.147+0000 7f3e56000640 1 -- 172.21.15.47:0/3299365114 shutdown_connections 2024-05-27T10:52:09.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.147+0000 7f3e56000640 1 -- 172.21.15.47:0/3299365114 wait complete. 2024-05-27T10:52:09.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.148+0000 7fdcda600640 1 -- 172.21.15.47:0/913696641 shutdown_connections 2024-05-27T10:52:09.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.148+0000 7fdcda600640 1 -- 172.21.15.47:0/913696641 wait complete. 2024-05-27T10:52:09.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.152+0000 7f779b000640 1 -- 172.21.15.47:0/1531160242 --> [v2:172.21.15.47:6808/3537662321,v1:172.21.15.47:6809/3537662321] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f779404fce0 con 0x7f7774074b70 2024-05-27T10:52:09.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.151+0000 7f6b19c00640 1 -- 172.21.15.47:0/2492042268 --> [v2:172.21.15.47:6824/1861819371,v1:172.21.15.47:6825/1861819371] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6b0c048390 con 0x7f6af4075770 2024-05-27T10:52:09.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.152+0000 7f7791600640 1 -- 172.21.15.47:0/1531160242 <== osd.1 v2:172.21.15.47:6808/3537662321 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f779404fce0 con 0x7f7774074b70 2024-05-27T10:52:09.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.152+0000 7f6b07e00640 1 -- 172.21.15.47:0/2492042268 <== osd.2 v2:172.21.15.47:6824/1861819371 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6b0c048390 con 0x7f6af4075770 2024-05-27T10:52:09.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.154+0000 7f6b19c00640 1 -- 172.21.15.47:0/2492042268 >> [v2:172.21.15.47:6824/1861819371,v1:172.21.15.47:6825/1861819371] conn(0x7f6af4075770 msgr2=0x7f6af4077c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.154+0000 7f6b19c00640 1 --2- 172.21.15.47:0/2492042268 >> [v2:172.21.15.47:6824/1861819371,v1:172.21.15.47:6825/1861819371] conn(0x7f6af4075770 0x7f6af4077c10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.154+0000 7f779b000640 1 -- 172.21.15.47:0/1531160242 >> [v2:172.21.15.47:6808/3537662321,v1:172.21.15.47:6809/3537662321] conn(0x7f7774074b70 msgr2=0x7f7774076f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.154+0000 7f6b19c00640 1 -- 172.21.15.47:0/2492042268 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6af406c940 msgr2=0x7f6af406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.154+0000 7f6b19c00640 1 --2- 172.21.15.47:0/2492042268 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6af406c940 0x7f6af406ee00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6b1406afa0 tx=0x7f6b1406e040 comp rx=0 tx=0).stop 2024-05-27T10:52:09.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.154+0000 7f779b000640 1 --2- 172.21.15.47:0/1531160242 >> [v2:172.21.15.47:6808/3537662321,v1:172.21.15.47:6809/3537662321] conn(0x7f7774074b70 0x7f7774076f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.155+0000 7f8029e00640 1 -- 172.21.15.47:0/1214945706 --> [v2:172.21.15.53:6800/331298306,v1:172.21.15.53:6801/331298306] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7ffc002dd0 con 0x7f8004074bc0 2024-05-27T10:52:09.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.155+0000 7f779b000640 1 -- 172.21.15.47:0/1531160242 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f777406c970 msgr2=0x7f777406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.155+0000 7f779b000640 1 --2- 172.21.15.47:0/1531160242 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f777406c970 0x7f777406ee30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f77940ba260 tx=0x7f7788008040 comp rx=0 tx=0).stop 2024-05-27T10:52:09.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.155+0000 7f779b000640 1 -- 172.21.15.47:0/1531160242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f779406ca40 msgr2=0x7f7794161600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.155+0000 7f779b000640 1 --2- 172.21.15.47:0/1531160242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f779406ca40 0x7f7794161600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f778000ebe0 tx=0x7f778000c520 comp rx=0 tx=0).stop 2024-05-27T10:52:09.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.155+0000 7f779a600640 1 -- 172.21.15.47:0/1531160242 reap_dead start 2024-05-27T10:52:09.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.155+0000 7f779b000640 1 -- 172.21.15.47:0/1531160242 shutdown_connections 2024-05-27T10:52:09.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.155+0000 7f779b000640 1 -- 172.21.15.47:0/1531160242 >> 172.21.15.47:0/1531160242 conn(0x7f779408bfd0 msgr2=0x7f77940b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.155+0000 7f801b400640 1 -- 172.21.15.47:0/1214945706 <== osd.4 v2:172.21.15.53:6800/331298306 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7ffc002dd0 con 0x7f8004074bc0 2024-05-27T10:52:09.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.156+0000 7f779b000640 1 -- 172.21.15.47:0/1531160242 shutdown_connections 2024-05-27T10:52:09.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.156+0000 7f6b19c00640 1 -- 172.21.15.47:0/2492042268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b0c0e3260 msgr2=0x7f6b0c0e4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.156+0000 7f6b19c00640 1 --2- 172.21.15.47:0/2492042268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b0c0e3260 0x7f6b0c0e4e30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000c3c0 tx=0x7f6b0000c880 comp rx=0 tx=0).stop 2024-05-27T10:52:09.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.156+0000 7f6b19200640 1 -- 172.21.15.47:0/2492042268 reap_dead start 2024-05-27T10:52:09.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.156+0000 7f6b19c00640 1 -- 172.21.15.47:0/2492042268 shutdown_connections 2024-05-27T10:52:09.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.156+0000 7f6b19c00640 1 -- 172.21.15.47:0/2492042268 >> 172.21.15.47:0/2492042268 conn(0x7f6b0c009fb0 msgr2=0x7f6b0c0d7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.156+0000 7f779b000640 1 -- 172.21.15.47:0/1531160242 wait complete. 2024-05-27T10:52:09.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.156+0000 7f6b19c00640 1 -- 172.21.15.47:0/2492042268 shutdown_connections 2024-05-27T10:52:09.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.156+0000 7f6b19c00640 1 -- 172.21.15.47:0/2492042268 wait complete. 2024-05-27T10:52:09.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.156+0000 7f8029e00640 1 -- 172.21.15.47:0/1214945706 >> [v2:172.21.15.53:6800/331298306,v1:172.21.15.53:6801/331298306] conn(0x7f8004074bc0 msgr2=0x7f8004076fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.156+0000 7f8029e00640 1 --2- 172.21.15.47:0/1214945706 >> [v2:172.21.15.53:6800/331298306,v1:172.21.15.53:6801/331298306] conn(0x7f8004074bc0 0x7f8004076fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.159+0000 7f8029e00640 1 -- 172.21.15.47:0/1214945706 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f800406c940 msgr2=0x7f800406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.159+0000 7f8029e00640 1 --2- 172.21.15.47:0/1214945706 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f800406c940 0x7f800406ee00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f801c039620 tx=0x7f8010008040 comp rx=0 tx=0).stop 2024-05-27T10:52:09.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.159+0000 7f8029e00640 1 -- 172.21.15.47:0/1214945706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f801c0061e0 msgr2=0x7f801c0515f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.159+0000 7f8029e00640 1 --2- 172.21.15.47:0/1214945706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f801c0061e0 0x7f801c0515f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f80240699b0 tx=0x7f802406cd20 comp rx=0 tx=0).stop 2024-05-27T10:52:09.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.159+0000 7f8023400640 1 -- 172.21.15.47:0/1214945706 reap_dead start 2024-05-27T10:52:09.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.160+0000 7f8029e00640 1 -- 172.21.15.47:0/1214945706 shutdown_connections 2024-05-27T10:52:09.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.160+0000 7f8029e00640 1 -- 172.21.15.47:0/1214945706 >> 172.21.15.47:0/1214945706 conn(0x7f801c058ee0 msgr2=0x7f801c0e3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.160+0000 7f8029e00640 1 -- 172.21.15.47:0/1214945706 shutdown_connections 2024-05-27T10:52:09.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.160+0000 7f8029e00640 1 -- 172.21.15.47:0/1214945706 wait complete. 2024-05-27T10:52:09.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.169+0000 7f8ef5c00640 1 -- 172.21.15.47:0/2859572056 --> [v2:172.21.15.53:6824/841884034,v1:172.21.15.53:6825/841884034] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8ef006c610 con 0x7f8ecc0757a0 2024-05-27T10:52:09.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.170+0000 7f31c1800640 1 -- 172.21.15.47:0/4287165983 --> [v2:172.21.15.53:6808/3828340653,v1:172.21.15.53:6809/3828340653] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f31bc0d0c30 con 0x7f319c074c40 2024-05-27T10:52:09.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.171+0000 7f8ee6a00640 1 -- 172.21.15.47:0/2859572056 <== osd.7 v2:172.21.15.53:6824/841884034 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8ef006c610 con 0x7f8ecc0757a0 2024-05-27T10:52:09.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.171+0000 7f023c600640 1 -- 172.21.15.47:0/1721555006 --> [v2:172.21.15.53:6816/204629598,v1:172.21.15.53:6817/204629598] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0210002dd0 con 0x7f0214074d10 2024-05-27T10:52:09.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.171+0000 7f8ef5c00640 1 -- 172.21.15.47:0/2859572056 >> [v2:172.21.15.53:6824/841884034,v1:172.21.15.53:6825/841884034] conn(0x7f8ecc0757a0 msgr2=0x7f8ecc077c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.171+0000 7f8ef5c00640 1 --2- 172.21.15.47:0/2859572056 >> [v2:172.21.15.53:6824/841884034,v1:172.21.15.53:6825/841884034] conn(0x7f8ecc0757a0 0x7f8ecc077c40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.172+0000 7f31b2a00640 1 -- 172.21.15.47:0/4287165983 <== osd.5 v2:172.21.15.53:6808/3828340653 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f31bc0d0c30 con 0x7f319c074c40 2024-05-27T10:52:09.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.172+0000 7f0231600640 1 -- 172.21.15.47:0/1721555006 <== osd.6 v2:172.21.15.53:6816/204629598 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0210002dd0 con 0x7f0214074d10 2024-05-27T10:52:09.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.172+0000 7f31c1800640 1 -- 172.21.15.47:0/4287165983 >> [v2:172.21.15.53:6808/3828340653,v1:172.21.15.53:6809/3828340653] conn(0x7f319c074c40 msgr2=0x7f319c077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.172+0000 7f31c1800640 1 --2- 172.21.15.47:0/4287165983 >> [v2:172.21.15.53:6808/3828340653,v1:172.21.15.53:6809/3828340653] conn(0x7f319c074c40 0x7f319c077060 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.173+0000 7f31c1800640 1 -- 172.21.15.47:0/4287165983 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f319c06c9c0 msgr2=0x7f319c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.173+0000 7f31c1800640 1 --2- 172.21.15.47:0/4287165983 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f319c06c9c0 0x7f319c06ee80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f31a8034000 tx=0x7f31a802e000 comp rx=0 tx=0).stop 2024-05-27T10:52:09.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.173+0000 7f31c1800640 1 -- 172.21.15.47:0/4287165983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31bc0d3480 msgr2=0x7f31bc1f99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.173+0000 7f31c1800640 1 --2- 172.21.15.47:0/4287165983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31bc0d3480 0x7f31bc1f99c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00e7e0 tx=0x7f31ac00eca0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.173+0000 7f31bb400640 1 -- 172.21.15.47:0/4287165983 reap_dead start 2024-05-27T10:52:09.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.174+0000 7f8ef5c00640 1 -- 172.21.15.47:0/2859572056 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f8ecc06c970 msgr2=0x7f8ecc06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.174+0000 7f8ef5c00640 1 --2- 172.21.15.47:0/2859572056 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f8ecc06c970 0x7f8ecc06ee30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8ee002a170 tx=0x7f8ee002e000 comp rx=0 tx=0).stop 2024-05-27T10:52:09.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.174+0000 7f8ef5c00640 1 -- 172.21.15.47:0/2859572056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ef01580f0 msgr2=0x7f8ef015f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.174+0000 7f8ef5c00640 1 --2- 172.21.15.47:0/2859572056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ef01580f0 0x7f8ef015f370 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8009d90 tx=0x7f8ee800c490 comp rx=0 tx=0).stop 2024-05-27T10:52:09.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.174+0000 7f8eef400640 1 -- 172.21.15.47:0/2859572056 reap_dead start 2024-05-27T10:52:09.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.174+0000 7f8ef5c00640 1 -- 172.21.15.47:0/2859572056 shutdown_connections 2024-05-27T10:52:09.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.174+0000 7f8ef5c00640 1 -- 172.21.15.47:0/2859572056 >> 172.21.15.47:0/2859572056 conn(0x7f8ef00d07b0 msgr2=0x7f8ef006b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.174+0000 7f8ef5c00640 1 -- 172.21.15.47:0/2859572056 shutdown_connections 2024-05-27T10:52:09.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.175+0000 7f8ef5c00640 1 -- 172.21.15.47:0/2859572056 wait complete. 2024-05-27T10:52:09.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.175+0000 7f023c600640 1 -- 172.21.15.47:0/1721555006 >> [v2:172.21.15.53:6816/204629598,v1:172.21.15.53:6817/204629598] conn(0x7f0214074d10 msgr2=0x7f0214077130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.175+0000 7f023c600640 1 --2- 172.21.15.47:0/1721555006 >> [v2:172.21.15.53:6816/204629598,v1:172.21.15.53:6817/204629598] conn(0x7f0214074d10 0x7f0214077130 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.175+0000 7f023c600640 1 -- 172.21.15.47:0/1721555006 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f021406caf0 msgr2=0x7f021406efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.175+0000 7f023c600640 1 --2- 172.21.15.47:0/1721555006 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f021406caf0 0x7f021406efb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f022c004c20 tx=0x7f022c009040 comp rx=0 tx=0).stop 2024-05-27T10:52:09.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.175+0000 7f023c600640 1 -- 172.21.15.47:0/1721555006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f023415f120 msgr2=0x7f02341eca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.175+0000 7f023c600640 1 --2- 172.21.15.47:0/1721555006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f023415f120 0x7f02341eca40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0220033000 tx=0x7f02200046c0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.175+0000 7f023a600640 1 -- 172.21.15.47:0/1721555006 reap_dead start 2024-05-27T10:52:09.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.175+0000 7f023c600640 1 -- 172.21.15.47:0/1721555006 shutdown_connections 2024-05-27T10:52:09.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.175+0000 7f023c600640 1 -- 172.21.15.47:0/1721555006 >> 172.21.15.47:0/1721555006 conn(0x7f0234072170 msgr2=0x7f02340b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.175+0000 7f31c1800640 1 -- 172.21.15.47:0/4287165983 shutdown_connections 2024-05-27T10:52:09.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.175+0000 7f31c1800640 1 -- 172.21.15.47:0/4287165983 >> 172.21.15.47:0/4287165983 conn(0x7f31bc08bfd0 msgr2=0x7f31bc0c7310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.175+0000 7f023c600640 1 -- 172.21.15.47:0/1721555006 shutdown_connections 2024-05-27T10:52:09.198 INFO:teuthology.orchestra.run.smithi047.stdout:55834574853 2024-05-27T10:52:09.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.175+0000 7f31c1800640 1 -- 172.21.15.47:0/4287165983 shutdown_connections 2024-05-27T10:52:09.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.175+0000 7f31c1800640 1 -- 172.21.15.47:0/4287165983 wait complete. 2024-05-27T10:52:09.199 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-27T10:52:09.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.176+0000 7f023c600640 1 -- 172.21.15.47:0/1721555006 wait complete. 2024-05-27T10:52:09.200 INFO:teuthology.orchestra.run.smithi047.stdout:55834574853 2024-05-27T10:52:09.200 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-27T10:52:09.201 INFO:teuthology.orchestra.run.smithi047.stdout:55834574854 2024-05-27T10:52:09.201 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-27T10:52:09.202 INFO:teuthology.orchestra.run.smithi047.stdout:55834574855 2024-05-27T10:52:09.202 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-27T10:52:09.203 INFO:teuthology.orchestra.run.smithi047.stdout:55834574853 2024-05-27T10:52:09.203 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-27T10:52:09.204 INFO:teuthology.orchestra.run.smithi047.stdout:55834574855 2024-05-27T10:52:09.204 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-27T10:52:09.205 INFO:teuthology.orchestra.run.smithi047.stdout:55834574853 2024-05-27T10:52:09.205 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-27T10:52:09.206 INFO:teuthology.orchestra.run.smithi047.stdout:55834574854 2024-05-27T10:52:09.206 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-27T10:52:09.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.523+0000 7fd43be00640 1 Processor -- start 2024-05-27T10:52:09.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.524+0000 7fd43be00640 1 -- start start 2024-05-27T10:52:09.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.526+0000 7fd43be00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd4340e3160 0x7fd43403a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.526+0000 7fd43be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd4340e6ca0 0x7fd4340e7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.526+0000 7fd43be00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd434005ee0 0x7fd434006350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.526+0000 7fd43be00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd4340e7650 con 0x7fd4340e6ca0 2024-05-27T10:52:09.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.526+0000 7fd43be00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fd434053060 con 0x7fd4340e3160 2024-05-27T10:52:09.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.526+0000 7fd43be00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd4340e7a90 con 0x7fd434005ee0 2024-05-27T10:52:09.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.527+0000 7fd43a000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd4340e6ca0 0x7fd4340e7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.527+0000 7fd43a000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd4340e6ca0 0x7fd4340e7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35208/0 (socket says 172.21.15.47:35208) 2024-05-27T10:52:09.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.527+0000 7fd43a000640 1 -- 172.21.15.47:0/1969300394 learned_addr learned my addr 172.21.15.47:0/1969300394 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.527+0000 7fd43b400640 1 --2- 172.21.15.47:0/1969300394 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd434005ee0 0x7fd434006350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.527+0000 7fd43a000640 1 -- 172.21.15.47:0/1969300394 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd434005ee0 msgr2=0x7fd434006350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.527+0000 7fd43a000640 1 --2- 172.21.15.47:0/1969300394 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd434005ee0 0x7fd434006350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.527+0000 7fd43a000640 1 -- 172.21.15.47:0/1969300394 >> v2:172.21.15.53:3300/0 conn(0x7fd4340e3160 msgr2=0x7fd43403a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.527+0000 7fd43a000640 1 --2- 172.21.15.47:0/1969300394 >> v2:172.21.15.53:3300/0 conn(0x7fd4340e3160 0x7fd43403a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.527+0000 7fd43a000640 1 -- 172.21.15.47:0/1969300394 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4340071d0 con 0x7fd4340e6ca0 2024-05-27T10:52:09.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.529+0000 7fd43a000640 1 --2- 172.21.15.47:0/1969300394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4340e6ca0 0x7fd4340e7110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd43400bd20 tx=0x7fd428032ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b63f3be90c0e65 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.530+0000 7fd439600640 1 -- 172.21.15.47:0/1969300394 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd428036870 con 0x7fd4340e6ca0 2024-05-27T10:52:09.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.530+0000 7fd439600640 1 -- 172.21.15.47:0/1969300394 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd428036a10 con 0x7fd4340e6ca0 2024-05-27T10:52:09.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.530+0000 7fd439600640 1 -- 172.21.15.47:0/1969300394 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd428036870 con 0x7fd4340e6ca0 2024-05-27T10:52:09.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.531+0000 7fd43be00640 1 -- 172.21.15.47:0/1969300394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4340e6ca0 msgr2=0x7fd4340e7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.531+0000 7fd43be00640 1 --2- 172.21.15.47:0/1969300394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4340e6ca0 0x7fd4340e7110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd43400bd20 tx=0x7fd428032ab0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.531+0000 7fd43be00640 1 -- 172.21.15.47:0/1969300394 shutdown_connections 2024-05-27T10:52:09.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.531+0000 7fd43be00640 1 --2- 172.21.15.47:0/1969300394 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd434005ee0 0x7fd434006350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.531+0000 7fd43be00640 1 --2- 172.21.15.47:0/1969300394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4340e6ca0 0x7fd4340e7110 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.531+0000 7fd43be00640 1 --2- 172.21.15.47:0/1969300394 >> v2:172.21.15.53:3300/0 conn(0x7fd4340e3160 0x7fd43403a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.531+0000 7fd43be00640 1 -- 172.21.15.47:0/1969300394 >> 172.21.15.47:0/1969300394 conn(0x7fd434009fb0 msgr2=0x7fd43400a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.531+0000 7fd43be00640 1 -- 172.21.15.47:0/1969300394 shutdown_connections 2024-05-27T10:52:09.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.531+0000 7fd43be00640 1 -- 172.21.15.47:0/1969300394 wait complete. 2024-05-27T10:52:09.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.536+0000 7fd43be00640 1 Processor -- start 2024-05-27T10:52:09.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.536+0000 7fd43be00640 1 -- start start 2024-05-27T10:52:09.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.538+0000 7fd43be00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd434005ee0 0x7fd4340d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.538+0000 7fd43be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4340e3160 0x7fd434048e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.538+0000 7fd43be00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4340e6ca0 0x7fd4340db840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.538+0000 7fd43be00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd434052cf0 con 0x7fd4340e3160 2024-05-27T10:52:09.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.538+0000 7fd43be00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd434007790 con 0x7fd4340e6ca0 2024-05-27T10:52:09.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.538+0000 7fd43be00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd4340e3540 con 0x7fd434005ee0 2024-05-27T10:52:09.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.539+0000 7fd43aa00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd434005ee0 0x7fd4340d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.539+0000 7fd43aa00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd434005ee0 0x7fd4340d1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:56566/0 (socket says 172.21.15.47:56566) 2024-05-27T10:52:09.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.539+0000 7fd43aa00640 1 -- 172.21.15.47:0/372682793 learned_addr learned my addr 172.21.15.47:0/372682793 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.540+0000 7fd43a000640 1 --2- 172.21.15.47:0/372682793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4340e3160 0x7fd434048e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.540+0000 7fd43b400640 1 --2- 172.21.15.47:0/372682793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4340e6ca0 0x7fd4340db840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.540+0000 7fd43aa00640 1 -- 172.21.15.47:0/372682793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4340e6ca0 msgr2=0x7fd4340db840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.540+0000 7fd43aa00640 1 --2- 172.21.15.47:0/372682793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4340e6ca0 0x7fd4340db840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.540+0000 7fd43aa00640 1 -- 172.21.15.47:0/372682793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4340e3160 msgr2=0x7fd434048e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.540+0000 7fd43aa00640 1 --2- 172.21.15.47:0/372682793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4340e3160 0x7fd434048e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.540+0000 7fd43aa00640 1 -- 172.21.15.47:0/372682793 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4340da7e0 con 0x7fd434005ee0 2024-05-27T10:52:09.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.541+0000 7fcceb800640 1 Processor -- start 2024-05-27T10:52:09.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.541+0000 7fd43aa00640 1 --2- 172.21.15.47:0/372682793 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd434005ee0 0x7fd4340d1ae0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd43c063510 tx=0x7fd43c06cd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.541+0000 7fcceb800640 1 -- start start 2024-05-27T10:52:09.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.542+0000 7fd433400640 1 -- 172.21.15.47:0/372682793 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c071690 con 0x7fd434005ee0 2024-05-27T10:52:09.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.542+0000 7fd43be00640 1 -- 172.21.15.47:0/372682793 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4340daa80 con 0x7fd434005ee0 2024-05-27T10:52:09.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.542+0000 7fd43be00640 1 -- 172.21.15.47:0/372682793 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4340db040 con 0x7fd434005ee0 2024-05-27T10:52:09.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.542+0000 7fd433400640 1 -- 172.21.15.47:0/372682793 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd43c071830 con 0x7fd434005ee0 2024-05-27T10:52:09.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.542+0000 7fd433400640 1 -- 172.21.15.47:0/372682793 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c071c60 con 0x7fd434005ee0 2024-05-27T10:52:09.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.543+0000 7f46e3e00640 1 Processor -- start 2024-05-27T10:52:09.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.544+0000 7fd43be00640 1 -- 172.21.15.47:0/372682793 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd414005290 con 0x7fd434005ee0 2024-05-27T10:52:09.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.544+0000 7fcceb800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcce4072420 0x7fcce415eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.544+0000 7fcceb800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcce415b050 con 0x7fcce406c050 2024-05-27T10:52:09.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.544+0000 7fcceb800640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcce415b330 con 0x7fcce40b5140 2024-05-27T10:52:09.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.544+0000 7fcceb800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fcce415f2e0 con 0x7fcce4072420 2024-05-27T10:52:09.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.545+0000 7fcce3e00640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcce40b5140 0x7fcce4071d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.47:38846/0 (socket says 172.21.15.47:38846) 2024-05-27T10:52:09.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.545+0000 7fcce3e00640 1 -- 172.21.15.47:0/2814657070 learned_addr learned my addr 172.21.15.47:0/2814657070 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:09.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.544+0000 7f46e3e00640 1 -- start start 2024-05-27T10:52:09.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.545+0000 7f46e3e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f46dc0ead00 0x7f46dc04fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.546+0000 7f46e3e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46dc053720 con 0x7f46dc04ffd0 2024-05-27T10:52:09.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.546+0000 7f46e3e00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46dc053a00 con 0x7f46dc006ef0 2024-05-27T10:52:09.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.546+0000 7f46e3e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f46dc054330 con 0x7f46dc0ead00 2024-05-27T10:52:09.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.546+0000 7fd433400640 1 -- 172.21.15.47:0/372682793 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd43c094480 con 0x7fd434005ee0 2024-05-27T10:52:09.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.546+0000 7fcce9800640 1 --2- 172.21.15.47:0/2814657070 >> v2:172.21.15.47:3300/0 conn(0x7fcce4072420 0x7fcce415eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.546+0000 7fcce3400640 1 -- 172.21.15.47:0/2814657070 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3125331239 0 0) 0x7fcce415b330 con 0x7fcce40b5140 2024-05-27T10:52:09.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.547+0000 7fcce3400640 1 -- 172.21.15.47:0/2814657070 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccc8003520 con 0x7fcce40b5140 2024-05-27T10:52:09.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.547+0000 7f46e3400640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f46dc006ef0 0x7f46dc0382e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.47:38860/0 (socket says 172.21.15.47:38860) 2024-05-27T10:52:09.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.547+0000 7f46e3400640 1 -- 172.21.15.47:0/3991560611 learned_addr learned my addr 172.21.15.47:0/3991560611 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:09.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.547+0000 7fcce3400640 1 -- 172.21.15.47:0/2814657070 <== mon.1 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 732549683 0 0) 0x7fccc8003520 con 0x7fcce40b5140 2024-05-27T10:52:09.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.547+0000 7f46e2a00640 1 --2- 172.21.15.47:0/3991560611 >> v2:172.21.15.47:3300/0 conn(0x7f46dc0ead00 0x7f46dc04fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.548+0000 7fd433400640 1 --2- 172.21.15.47:0/372682793 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd41c06c8f0 0x7fd41c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.548+0000 7fd433400640 1 -- 172.21.15.47:0/372682793 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd43c1073c0 con 0x7fd434005ee0 2024-05-27T10:52:09.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.547+0000 7fcce3400640 1 -- 172.21.15.47:0/2814657070 >> v2:172.21.15.47:3300/0 conn(0x7fcce4072420 msgr2=0x7fcce415eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.547+0000 7fcce3400640 1 --2- 172.21.15.47:0/2814657070 >> v2:172.21.15.47:3300/0 conn(0x7fcce4072420 0x7fcce415eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.548+0000 7fcce3400640 1 -- 172.21.15.47:0/2814657070 >> v1:172.21.15.47:6789/0 conn(0x7fcce406c050 legacy=0x7fcce40cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.548+0000 7fcce3400640 1 -- 172.21.15.47:0/2814657070 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce4162520 con 0x7fcce40b5140 2024-05-27T10:52:09.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.548+0000 7fcce3400640 1 -- 172.21.15.47:0/2814657070 <== mon.1 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7fccd40019f0 con 0x7fcce40b5140 2024-05-27T10:52:09.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.548+0000 7fcce3400640 1 -- 172.21.15.47:0/2814657070 >> v1:172.21.15.53:6789/0 conn(0x7fcce40b5140 legacy=0x7fcce4071d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.548+0000 7fcce3400640 1 --2- 172.21.15.47:0/2814657070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccc80039b0 0x7fccc8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.548+0000 7fcce3400640 1 --2- 172.21.15.47:0/2814657070 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fccc8004800 0x7fccc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.548+0000 7fcce3400640 1 --2- 172.21.15.47:0/2814657070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccc80051c0 0x7fccc800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.548+0000 7fcce3400640 1 -- 172.21.15.47:0/2814657070 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcce415f2e0 con 0x7fccc80039b0 2024-05-27T10:52:09.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.548+0000 7fcce3400640 1 -- 172.21.15.47:0/2814657070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fccc800c070 con 0x7fccc80051c0 2024-05-27T10:52:09.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.548+0000 7fcce3400640 1 -- 172.21.15.47:0/2814657070 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fccc8014a80 con 0x7fccc8004800 2024-05-27T10:52:09.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.548+0000 7fd43a000640 1 --2- 172.21.15.47:0/372682793 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd41c06c8f0 0x7fd41c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.548+0000 7f06a7200640 1 Processor -- start 2024-05-27T10:52:09.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.548+0000 7f46e1600640 1 -- 172.21.15.47:0/3991560611 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2215689480 0 0) 0x7f46dc053a00 con 0x7f46dc006ef0 2024-05-27T10:52:09.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.549+0000 7fcce3e00640 1 --2- 172.21.15.47:0/2814657070 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fccc8004800 0x7fccc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.549+0000 7fcce8e00640 1 --2- 172.21.15.47:0/2814657070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccc80039b0 0x7fccc8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.549+0000 7f06a7200640 1 -- start start 2024-05-27T10:52:09.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.549+0000 7fcce3e00640 1 -- 172.21.15.47:0/2814657070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccc80051c0 msgr2=0x7fccc800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.549+0000 7fcce3e00640 1 --2- 172.21.15.47:0/2814657070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccc80051c0 0x7fccc800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.550+0000 7fcce3e00640 1 -- 172.21.15.47:0/2814657070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccc80039b0 msgr2=0x7fccc8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.550+0000 7fcce3e00640 1 --2- 172.21.15.47:0/2814657070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccc80039b0 0x7fccc8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.549+0000 7f46e1600640 1 -- 172.21.15.47:0/3991560611 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46c8003520 con 0x7f46dc006ef0 2024-05-27T10:52:09.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.549+0000 7f46e2a00640 1 -- 172.21.15.47:0/3991560611 >> v1:172.21.15.53:6789/0 conn(0x7f46dc006ef0 legacy=0x7f46dc0382e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.550+0000 7f46e2a00640 1 -- 172.21.15.47:0/3991560611 >> v1:172.21.15.47:6789/0 conn(0x7f46dc04ffd0 legacy=0x7f46dc037bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.550+0000 7f46e2a00640 1 -- 172.21.15.47:0/3991560611 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46dc053ce0 con 0x7f46dc0ead00 2024-05-27T10:52:09.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.550+0000 7fcce9800640 1 -- 172.21.15.47:0/2814657070 reap_dead start 2024-05-27T10:52:09.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.550+0000 7fcce3e00640 1 -- 172.21.15.47:0/2814657070 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce4162520 con 0x7fccc8004800 2024-05-27T10:52:09.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.551+0000 7fd43a000640 1 --2- 172.21.15.47:0/372682793 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd41c06c8f0 0x7fd41c06edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd42803d000 tx=0x7fd428008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.551+0000 7fcce8e00640 1 --2- 172.21.15.47:0/2814657070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccc80039b0 0x7fccc8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T10:52:09.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.551+0000 7f46e2a00640 1 --2- 172.21.15.47:0/3991560611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc0ead00 0x7f46dc04fa90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009a00 tx=0x7f46d402a4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15e9aad0e81efb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.552+0000 7f06a7200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f06a006f250 0x7f06a006f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.552+0000 7f46e1600640 1 -- 172.21.15.47:0/3991560611 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d4036070 con 0x7f46dc0ead00 2024-05-27T10:52:09.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.552+0000 7f46e1600640 1 -- 172.21.15.47:0/3991560611 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d4031600 con 0x7f46dc0ead00 2024-05-27T10:52:09.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.552+0000 7f46e1600640 1 -- 172.21.15.47:0/3991560611 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d4031a10 con 0x7f46dc0ead00 2024-05-27T10:52:09.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.552+0000 7f06a7200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06a00afe20 con 0x7f06a01481b0 2024-05-27T10:52:09.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.552+0000 7f06a7200640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06a00af860 con 0x7f06a006e3c0 2024-05-27T10:52:09.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.552+0000 7f06a7200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f06a006fc10 con 0x7f06a006f250 2024-05-27T10:52:09.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.552+0000 7f24d4e00640 1 Processor -- start 2024-05-27T10:52:09.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.552+0000 7fcce3e00640 1 --2- 172.21.15.47:0/2814657070 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fccc8004800 0x7fccc8004c80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fccd400a890 tx=0x7fccc8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abac64a1d756ba1d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.552+0000 7f24d4e00640 1 -- start start 2024-05-27T10:52:09.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.553+0000 7f06a5200640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f06a006e3c0 0x7f06a006e820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.47:38872/0 (socket says 172.21.15.47:38872) 2024-05-27T10:52:09.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.553+0000 7f06a5200640 1 -- 172.21.15.47:0/551245664 learned_addr learned my addr 172.21.15.47:0/551245664 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:09.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.553+0000 7f069fe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f06a01481b0 0x7f06a00b34e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43922/0 (socket says 172.21.15.47:43922) 2024-05-27T10:52:09.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.553+0000 7f46e3e00640 1 -- 172.21.15.47:0/3991560611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc0ead00 msgr2=0x7f46dc04fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.553+0000 7f46e3e00640 1 --2- 172.21.15.47:0/3991560611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc0ead00 0x7f46dc04fa90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009a00 tx=0x7f46d402a4a0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.553+0000 7f069f400640 1 --2- 172.21.15.47:0/551245664 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f06a006f250 0x7f06a006f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.553+0000 7f46e3e00640 1 -- 172.21.15.47:0/3991560611 shutdown_connections 2024-05-27T10:52:09.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.553+0000 7f46e3e00640 1 --2- 172.21.15.47:0/3991560611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc0ead00 0x7f46dc04fa90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.553+0000 7f46e3e00640 1 -- 172.21.15.47:0/3991560611 >> 172.21.15.47:0/3991560611 conn(0x7f46dc009fb0 msgr2=0x7f46dc00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.553+0000 7f46e3e00640 1 -- 172.21.15.47:0/3991560611 shutdown_connections 2024-05-27T10:52:09.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.553+0000 7f46e3e00640 1 -- 172.21.15.47:0/3991560611 wait complete. 2024-05-27T10:52:09.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.554+0000 7f069ea00640 1 -- 172.21.15.47:0/551245664 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3727413548 0 0) 0x7f06a00afe20 con 0x7f06a01481b0 2024-05-27T10:52:09.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.554+0000 7f069f400640 1 -- 172.21.15.47:0/551245664 >> v1:172.21.15.53:6789/0 conn(0x7f06a006e3c0 legacy=0x7f06a006e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.554+0000 7f069f400640 1 -- 172.21.15.47:0/551245664 >> v1:172.21.15.47:6789/0 conn(0x7f06a01481b0 legacy=0x7f06a00b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.554+0000 7f069f400640 1 -- 172.21.15.47:0/551245664 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a00afb40 con 0x7f06a006f250 2024-05-27T10:52:09.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.554+0000 7f24d4e00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f24d006c050 0x7f24d00b5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.554+0000 7f24d4e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f24d015eda0 0x7f24d00cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.554+0000 7f24d4e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f24d0154570 0x7f24d0154a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.554+0000 7f24d4e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f24d00b4f30 con 0x7f24d015eda0 2024-05-27T10:52:09.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.554+0000 7f24d4e00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f24d015f250 con 0x7f24d006c050 2024-05-27T10:52:09.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.554+0000 7f24d4e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f24d00b5840 con 0x7f24d0154570 2024-05-27T10:52:09.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.555+0000 7f24cde00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f24d006c050 0x7f24d00b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.555+0000 7f24cde00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f24d006c050 0x7f24d00b5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:44026/0 (socket says 172.21.15.47:44026) 2024-05-27T10:52:09.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.555+0000 7f24cde00640 1 -- 172.21.15.47:0/2067392727 learned_addr learned my addr 172.21.15.47:0/2067392727 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.555+0000 7f24cd400640 1 --2- 172.21.15.47:0/2067392727 >> v2:172.21.15.47:3300/0 conn(0x7f24d015eda0 0x7f24d00cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.555+0000 7f46e3e00640 1 Processor -- start 2024-05-27T10:52:09.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.555+0000 7f24ce800640 1 --2- 172.21.15.47:0/2067392727 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f24d0154570 0x7f24d0154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.556+0000 7f069f400640 1 --2- 172.21.15.47:0/551245664 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f06a006f250 0x7f06a006f6d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f068c009750 tx=0x7f068c02a010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57a243b1dd8d07f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.556+0000 7f46e3e00640 1 -- start start 2024-05-27T10:52:09.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.556+0000 7fd033000640 1 Processor -- start 2024-05-27T10:52:09.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.556+0000 7fd033000640 1 -- start start 2024-05-27T10:52:09.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.557+0000 7f3bfce00640 1 Processor -- start 2024-05-27T10:52:09.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.556+0000 7f24cd400640 1 -- 172.21.15.47:0/2067392727 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f24d0154570 msgr2=0x7f24d0154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.556+0000 7f24cd400640 1 --2- 172.21.15.47:0/2067392727 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f24d0154570 0x7f24d0154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.556+0000 7f24cd400640 1 -- 172.21.15.47:0/2067392727 >> v2:172.21.15.53:3300/0 conn(0x7f24d006c050 msgr2=0x7f24d00b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.556+0000 7f24cd400640 1 --2- 172.21.15.47:0/2067392727 >> v2:172.21.15.53:3300/0 conn(0x7f24d006c050 0x7f24d00b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.556+0000 7f24cd400640 1 -- 172.21.15.47:0/2067392727 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d015b050 con 0x7f24d015eda0 2024-05-27T10:52:09.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.556+0000 7f24ce800640 1 --2- 172.21.15.47:0/2067392727 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f24d0154570 0x7f24d0154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:09.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.557+0000 7f46e3e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46dc006ef0 0x7f46dc0e91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.557+0000 7f3bfce00640 1 -- start start 2024-05-27T10:52:09.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.557+0000 7f46e3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc04ffd0 0x7f46dc0466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7f46e3e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f46dc0ead00 0x7f46dc046c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7f24cd400640 1 --2- 172.21.15.47:0/2067392727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24d015eda0 0x7f24d00cfb80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f24bc0097a0 tx=0x7f24bc02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f16fd8bc065569b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7f3bfce00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3bf8160090 0x7f3bf8160470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7f3bfce00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3bf80cfed0 0x7f3bf815ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7f3bfce00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bf80ccda0 con 0x7f3bf80d0330 2024-05-27T10:52:09.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7f3bfce00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f3bf80cdc30 con 0x7f3bf8160090 2024-05-27T10:52:09.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7f3bfce00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f3bf81609b0 con 0x7f3bf80cfed0 2024-05-27T10:52:09.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7fd033000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd02c0d11e0 0x7fd02c162e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7fd033000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd02c0cf2b0 0x7fd02c0d2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7fd033000640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd02c0d15c0 0x7fd02c0d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7fd033000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd02c1633a0 con 0x7fd02c0d11e0 2024-05-27T10:52:09.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7fd033000640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fd02c0d5050 con 0x7fd02c0d15c0 2024-05-27T10:52:09.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7fd033000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd02c0cf7e0 con 0x7fd02c0cf2b0 2024-05-27T10:52:09.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7f46e2000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc04ffd0 0x7f46dc0466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7f46e2000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc04ffd0 0x7f46dc0466f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35270/0 (socket says 172.21.15.47:35270) 2024-05-27T10:52:09.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7f46e2000640 1 -- 172.21.15.47:0/3638248925 learned_addr learned my addr 172.21.15.47:0/3638248925 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7f46e3e00640 1 -- 172.21.15.47:0/3638248925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc054940 con 0x7f46dc04ffd0 2024-05-27T10:52:09.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7f46e3e00640 1 -- 172.21.15.47:0/3638248925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc0547c0 con 0x7f46dc006ef0 2024-05-27T10:52:09.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7f46e3e00640 1 -- 172.21.15.47:0/3638248925 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f46dc04f550 con 0x7f46dc0ead00 2024-05-27T10:52:09.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7f46e2a00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46dc006ef0 0x7f46dc0e91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7f3bf7400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3bf8160090 0x7f3bf8160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7f3bf7400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3bf8160090 0x7f3bf8160470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35278/0 (socket says 172.21.15.47:35278) 2024-05-27T10:52:09.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7f3bf7400640 1 -- 172.21.15.47:0/374404897 learned_addr learned my addr 172.21.15.47:0/374404897 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.558+0000 7f46e3400640 1 --2- 172.21.15.47:0/3638248925 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f46dc0ead00 0x7f46dc046c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.559+0000 7f3bf6a00640 1 --2- 172.21.15.47:0/374404897 >> v2:172.21.15.53:3300/0 conn(0x7f3bf80cfed0 0x7f3bf815ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.559+0000 7f24cca00640 1 -- 172.21.15.47:0/2067392727 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc037070 con 0x7f24d015eda0 2024-05-27T10:52:09.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.559+0000 7f24cca00640 1 -- 172.21.15.47:0/2067392727 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24bc02ae40 con 0x7f24d015eda0 2024-05-27T10:52:09.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.559+0000 7f24cca00640 1 -- 172.21.15.47:0/2067392727 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc032660 con 0x7f24d015eda0 2024-05-27T10:52:09.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.559+0000 7fd02be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd02c0d11e0 0x7fd02c162e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.559+0000 7f46e2000640 1 -- 172.21.15.47:0/3638248925 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f46dc0ead00 msgr2=0x7f46dc046c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.559+0000 7f46e2000640 1 --2- 172.21.15.47:0/3638248925 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f46dc0ead00 0x7f46dc046c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.559+0000 7f46e2000640 1 -- 172.21.15.47:0/3638248925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46dc006ef0 msgr2=0x7f46dc0e91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.559+0000 7f46e2000640 1 --2- 172.21.15.47:0/3638248925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46dc006ef0 0x7f46dc0e91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.559+0000 7f46e2000640 1 -- 172.21.15.47:0/3638248925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46dc17d560 con 0x7f46dc04ffd0 2024-05-27T10:52:09.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.559+0000 7fd02be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd02c0d11e0 0x7fd02c162e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35284/0 (socket says 172.21.15.47:35284) 2024-05-27T10:52:09.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.559+0000 7f48e4400640 1 Processor -- start 2024-05-27T10:52:09.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.559+0000 7f3bf7400640 1 -- 172.21.15.47:0/374404897 >> v2:172.21.15.53:3300/0 conn(0x7f3bf80cfed0 msgr2=0x7f3bf815ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.559+0000 7fd02be00640 1 -- 172.21.15.47:0/2135174393 learned_addr learned my addr 172.21.15.47:0/2135174393 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.559+0000 7f3bf7400640 1 --2- 172.21.15.47:0/374404897 >> v2:172.21.15.53:3300/0 conn(0x7f3bf80cfed0 0x7f3bf815ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.559+0000 7f3bf7400640 1 -- 172.21.15.47:0/374404897 >> v1:172.21.15.53:6789/0 conn(0x7f3bf80d0330 legacy=0x7f3bf815cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.559+0000 7f3bf7400640 1 -- 172.21.15.47:0/374404897 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf809ba50 con 0x7f3bf8160090 2024-05-27T10:52:09.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.559+0000 7fd02b400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd02c0cf2b0 0x7fd02c0d2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.560+0000 7f48e4400640 1 -- start start 2024-05-27T10:52:09.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.560+0000 7f46e2000640 1 --2- 172.21.15.47:0/3638248925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc04ffd0 0x7f46dc0466f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f46d000c400 tx=0x7f46d000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.560+0000 7f24d4e00640 1 -- 172.21.15.47:0/2067392727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24d015eda0 msgr2=0x7f24d00cfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.560+0000 7f24d4e00640 1 --2- 172.21.15.47:0/2067392727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24d015eda0 0x7f24d00cfb80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f24bc0097a0 tx=0x7f24bc02a130 comp rx=0 tx=0).stop 2024-05-27T10:52:09.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.560+0000 7f24d4e00640 1 -- 172.21.15.47:0/2067392727 shutdown_connections 2024-05-27T10:52:09.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.560+0000 7f24d4e00640 1 --2- 172.21.15.47:0/2067392727 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f24d0154570 0x7f24d0154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.560+0000 7f24d4e00640 1 --2- 172.21.15.47:0/2067392727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24d015eda0 0x7f24d00cfb80 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f24bc0097a0 tx=0x7f24bc02a130 comp rx=0 tx=0).stop 2024-05-27T10:52:09.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.560+0000 7f24d4e00640 1 --2- 172.21.15.47:0/2067392727 >> v2:172.21.15.53:3300/0 conn(0x7f24d006c050 0x7f24d00b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.560+0000 7f24d4e00640 1 -- 172.21.15.47:0/2067392727 >> 172.21.15.47:0/2067392727 conn(0x7f24d0067ad0 msgr2=0x7f24d006b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.559+0000 7fd031000640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd02c0d15c0 0x7fd02c0d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.560+0000 7fd02be00640 1 -- 172.21.15.47:0/2135174393 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd02c0cf2b0 msgr2=0x7fd02c0d2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.560+0000 7f24d4e00640 1 -- 172.21.15.47:0/2067392727 shutdown_connections 2024-05-27T10:52:09.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.560+0000 7f46daa00640 1 -- 172.21.15.47:0/3638248925 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d00052d0 con 0x7f46dc04ffd0 2024-05-27T10:52:09.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.561+0000 7f24d4e00640 1 -- 172.21.15.47:0/2067392727 wait complete. 2024-05-27T10:52:09.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.560+0000 7fd02be00640 1 --2- 172.21.15.47:0/2135174393 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd02c0cf2b0 0x7fd02c0d2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.560+0000 7fd02be00640 1 -- 172.21.15.47:0/2135174393 >> v2:172.21.15.53:3300/0 conn(0x7fd02c0d15c0 msgr2=0x7fd02c0d27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.560+0000 7fd02be00640 1 --2- 172.21.15.47:0/2135174393 >> v2:172.21.15.53:3300/0 conn(0x7fd02c0d15c0 0x7fd02c0d27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.560+0000 7fd02be00640 1 -- 172.21.15.47:0/2135174393 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd02c0cfac0 con 0x7fd02c0d11e0 2024-05-27T10:52:09.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.561+0000 7f46daa00640 1 -- 172.21.15.47:0/3638248925 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d0005490 con 0x7f46dc04ffd0 2024-05-27T10:52:09.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.561+0000 7fd02b400640 1 --2- 172.21.15.47:0/2135174393 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd02c0cf2b0 0x7fd02c0d2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:52:09.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.561+0000 7f46e3e00640 1 -- 172.21.15.47:0/3638248925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46dc0e96e0 con 0x7f46dc04ffd0 2024-05-27T10:52:09.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.561+0000 7f46daa00640 1 -- 172.21.15.47:0/3638248925 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d0007260 con 0x7f46dc04ffd0 2024-05-27T10:52:09.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.561+0000 7f46e3e00640 1 -- 172.21.15.47:0/3638248925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46dc04daa0 con 0x7f46dc04ffd0 2024-05-27T10:52:09.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.561+0000 7f48e4400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f48dc0cf4e0 0x7f48dc15ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.561+0000 7f48e4400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f48dc0d16f0 0x7f48dc0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.561+0000 7f48e4400640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48dc0d36e0 con 0x7f48dc0d1310 2024-05-27T10:52:09.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.561+0000 7f48e4400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f48dc0d2640 con 0x7f48dc0cf4e0 2024-05-27T10:52:09.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.561+0000 7f48e4400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f48dc0d2920 con 0x7f48dc0d16f0 2024-05-27T10:52:09.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.561+0000 7f3bf7400640 1 --2- 172.21.15.47:0/374404897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bf8160090 0x7f3bf8160470 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80c5a10 tx=0x7f3be802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437f695135ba303f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.562+0000 7f48e1000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f48dc0cf4e0 0x7f48dc15ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.562+0000 7f48e1000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f48dc0cf4e0 0x7f48dc15ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35286/0 (socket says 172.21.15.47:35286) 2024-05-27T10:52:09.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.562+0000 7f48e1000640 1 -- 172.21.15.47:0/550459999 learned_addr learned my addr 172.21.15.47:0/550459999 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.562+0000 7f48e2400640 1 --2- 172.21.15.47:0/550459999 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f48dc0d16f0 0x7f48dc0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.562+0000 7fd02be00640 1 --2- 172.21.15.47:0/2135174393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd02c0d11e0 0x7fd02c162e60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd02c0cb700 tx=0x7fd02402a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ccf343f5bacbd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.563+0000 7f48e2400640 1 -- 172.21.15.47:0/550459999 >> v2:172.21.15.47:3300/0 conn(0x7f48dc0cf4e0 msgr2=0x7f48dc15ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.563+0000 7f48e2400640 1 --2- 172.21.15.47:0/550459999 >> v2:172.21.15.47:3300/0 conn(0x7f48dc0cf4e0 0x7f48dc15ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.563+0000 7f48e2400640 1 -- 172.21.15.47:0/550459999 >> v1:172.21.15.53:6789/0 conn(0x7f48dc0d1310 legacy=0x7f48dc15e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.563+0000 7f48e2400640 1 -- 172.21.15.47:0/550459999 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48dc0d2c00 con 0x7f48dc0d16f0 2024-05-27T10:52:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.563+0000 7fd02aa00640 1 -- 172.21.15.47:0/2135174393 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd024036070 con 0x7fd02c0d11e0 2024-05-27T10:52:09.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.563+0000 7f3bf6000640 1 -- 172.21.15.47:0/374404897 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be8037070 con 0x7f3bf8160090 2024-05-27T10:52:09.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.562+0000 7f46e3e00640 1 -- 172.21.15.47:0/3638248925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46dc0052c0 con 0x7f46dc04ffd0 2024-05-27T10:52:09.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.563+0000 7f24d4e00640 1 Processor -- start 2024-05-27T10:52:09.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.563+0000 7fd02aa00640 1 -- 172.21.15.47:0/2135174393 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd024031600 con 0x7fd02c0d11e0 2024-05-27T10:52:09.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.563+0000 7f3bf6000640 1 -- 172.21.15.47:0/374404897 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3be8032440 con 0x7f3bf8160090 2024-05-27T10:52:09.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.563+0000 7fd02aa00640 1 -- 172.21.15.47:0/2135174393 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0240319d0 con 0x7fd02c0d11e0 2024-05-27T10:52:09.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.563+0000 7f24d4e00640 1 -- start start 2024-05-27T10:52:09.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.564+0000 7f3bfce00640 1 -- 172.21.15.47:0/374404897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bf8160090 msgr2=0x7f3bf8160470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.564+0000 7f3bf6000640 1 -- 172.21.15.47:0/374404897 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be8032810 con 0x7f3bf8160090 2024-05-27T10:52:09.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.564+0000 7f3bfce00640 1 --2- 172.21.15.47:0/374404897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bf8160090 0x7f3bf8160470 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80c5a10 tx=0x7f3be802a230 comp rx=0 tx=0).stop 2024-05-27T10:52:09.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.564+0000 7fd033000640 1 -- 172.21.15.47:0/2135174393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd02c0d11e0 msgr2=0x7fd02c162e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.564+0000 7fd033000640 1 --2- 172.21.15.47:0/2135174393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd02c0d11e0 0x7fd02c162e60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd02c0cb700 tx=0x7fd02402a690 comp rx=0 tx=0).stop 2024-05-27T10:52:09.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.564+0000 7f48e2400640 1 --2- 172.21.15.47:0/550459999 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f48dc0d16f0 0x7f48dc0d0390 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009d90 tx=0x7f48d402a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10e8173926f93478 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.564+0000 7f3bfce00640 1 -- 172.21.15.47:0/374404897 shutdown_connections 2024-05-27T10:52:09.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.564+0000 7f3bfce00640 1 --2- 172.21.15.47:0/374404897 >> v2:172.21.15.53:3300/0 conn(0x7f3bf80cfed0 0x7f3bf815ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.564+0000 7f3bfce00640 1 --2- 172.21.15.47:0/374404897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bf8160090 0x7f3bf8160470 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.564+0000 7f3bfce00640 1 -- 172.21.15.47:0/374404897 >> 172.21.15.47:0/374404897 conn(0x7f3bf80b3df0 msgr2=0x7f3bf80b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.564+0000 7fd033000640 1 -- 172.21.15.47:0/2135174393 shutdown_connections 2024-05-27T10:52:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.564+0000 7fd033000640 1 --2- 172.21.15.47:0/2135174393 >> v2:172.21.15.53:3300/0 conn(0x7fd02c0d15c0 0x7fd02c0d27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.564+0000 7fd033000640 1 --2- 172.21.15.47:0/2135174393 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd02c0cf2b0 0x7fd02c0d2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.564+0000 7fd033000640 1 --2- 172.21.15.47:0/2135174393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd02c0d11e0 0x7fd02c162e60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.564+0000 7fd033000640 1 -- 172.21.15.47:0/2135174393 >> 172.21.15.47:0/2135174393 conn(0x7fd02c08bfd0 msgr2=0x7fd02c0d46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.564+0000 7f3bfce00640 1 -- 172.21.15.47:0/374404897 shutdown_connections 2024-05-27T10:52:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.565+0000 7f069ea00640 1 -- 172.21.15.47:0/551245664 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c037070 con 0x7f06a006f250 2024-05-27T10:52:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.564+0000 7fcce3400640 1 -- 172.21.15.47:0/2814657070 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd400a460 con 0x7fccc8004800 2024-05-27T10:52:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.565+0000 7fcce3400640 1 -- 172.21.15.47:0/2814657070 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccd402f070 con 0x7fccc8004800 2024-05-27T10:52:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.565+0000 7fcce3400640 1 -- 172.21.15.47:0/2814657070 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd402bce0 con 0x7fccc8004800 2024-05-27T10:52:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.565+0000 7f24d4e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24d006c050 0x7f24d0144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.565+0000 7f24d4e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24d0154570 0x7f24d01451f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.565+0000 7f24d4e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f24d00ac200 0x7f24d00ac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.565+0000 7f069ea00640 1 -- 172.21.15.47:0/551245664 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f068c02ad20 con 0x7f06a006f250 2024-05-27T10:52:09.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.565+0000 7f069ea00640 1 -- 172.21.15.47:0/551245664 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c032660 con 0x7f06a006f250 2024-05-27T10:52:09.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.565+0000 7fd033000640 1 -- 172.21.15.47:0/2135174393 shutdown_connections 2024-05-27T10:52:09.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.565+0000 7f48dbe00640 1 -- 172.21.15.47:0/550459999 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d4007740 con 0x7f48dc0d16f0 2024-05-27T10:52:09.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.565+0000 7f48dbe00640 1 -- 172.21.15.47:0/550459999 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d40078e0 con 0x7f48dc0d16f0 2024-05-27T10:52:09.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.565+0000 7f48dbe00640 1 -- 172.21.15.47:0/550459999 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d4007cf0 con 0x7f48dc0d16f0 2024-05-27T10:52:09.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.565+0000 7fd433400640 1 -- 172.21.15.47:0/372682793 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd43c0a3080 con 0x7fd434005ee0 2024-05-27T10:52:09.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.565+0000 7f24d4e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f24d00d00c0 con 0x7f24d0154570 2024-05-27T10:52:09.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.565+0000 7f24cd400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24d0154570 0x7f24d01451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.565+0000 7f24d4e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f24d015b610 con 0x7f24d006c050 2024-05-27T10:52:09.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.565+0000 7f24d4e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f24d015bb30 con 0x7f24d00ac200 2024-05-27T10:52:09.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.566+0000 7f06a7200640 1 -- 172.21.15.47:0/551245664 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f06a006f250 msgr2=0x7f06a006f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.565+0000 7f3bfce00640 1 -- 172.21.15.47:0/374404897 wait complete. 2024-05-27T10:52:09.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.566+0000 7fcceb800640 1 -- 172.21.15.47:0/2814657070 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fccc8004800 msgr2=0x7fccc8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.566+0000 7fcceb800640 1 --2- 172.21.15.47:0/2814657070 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fccc8004800 0x7fccc8004c80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fccd400a890 tx=0x7fccc8005830 comp rx=0 tx=0).stop 2024-05-27T10:52:09.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.566+0000 7f06a7200640 1 --2- 172.21.15.47:0/551245664 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f06a006f250 0x7f06a006f6d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f068c009750 tx=0x7f068c02a010 comp rx=0 tx=0).stop 2024-05-27T10:52:09.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.566+0000 7fcceb800640 1 -- 172.21.15.47:0/2814657070 shutdown_connections 2024-05-27T10:52:09.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.566+0000 7fcceb800640 1 --2- 172.21.15.47:0/2814657070 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fccc8004800 0x7fccc8004c80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.566+0000 7fcceb800640 1 -- 172.21.15.47:0/2814657070 >> 172.21.15.47:0/2814657070 conn(0x7fcce4067ad0 msgr2=0x7fcce406b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.566+0000 7f24cde00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24d006c050 0x7f24d0144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.566+0000 7f24ce800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f24d00ac200 0x7f24d00ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.566+0000 7f24cde00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24d006c050 0x7f24d0144910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:44066/0 (socket says 172.21.15.47:44066) 2024-05-27T10:52:09.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.566+0000 7f24cde00640 1 -- 172.21.15.47:0/165984877 learned_addr learned my addr 172.21.15.47:0/165984877 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.566+0000 7fcceb800640 1 -- 172.21.15.47:0/2814657070 shutdown_connections 2024-05-27T10:52:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.566+0000 7f48e4400640 1 -- 172.21.15.47:0/550459999 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f48dc0d16f0 msgr2=0x7f48dc0d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.566+0000 7fcceb800640 1 -- 172.21.15.47:0/2814657070 wait complete. 2024-05-27T10:52:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.566+0000 7f48e4400640 1 --2- 172.21.15.47:0/550459999 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f48dc0d16f0 0x7f48dc0d0390 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009d90 tx=0x7f48d402a680 comp rx=0 tx=0).stop 2024-05-27T10:52:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.567+0000 7f48e4400640 1 -- 172.21.15.47:0/550459999 shutdown_connections 2024-05-27T10:52:09.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.567+0000 7f24ce800640 1 -- 172.21.15.47:0/165984877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24d006c050 msgr2=0x7f24d0144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.567+0000 7f24ce800640 1 --2- 172.21.15.47:0/165984877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24d006c050 0x7f24d0144910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.567+0000 7f24ce800640 1 -- 172.21.15.47:0/165984877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24d0154570 msgr2=0x7f24d01451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.567+0000 7f48e4400640 1 --2- 172.21.15.47:0/550459999 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f48dc0d16f0 0x7f48dc0d0390 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.567+0000 7f48e4400640 1 --2- 172.21.15.47:0/550459999 >> v2:172.21.15.47:3300/0 conn(0x7f48dc0cf4e0 0x7f48dc15ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.567+0000 7f48e4400640 1 -- 172.21.15.47:0/550459999 >> 172.21.15.47:0/550459999 conn(0x7f48dc08bfd0 msgr2=0x7f48dc0d4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.567+0000 7f48e4400640 1 -- 172.21.15.47:0/550459999 shutdown_connections 2024-05-27T10:52:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.567+0000 7f48e4400640 1 -- 172.21.15.47:0/550459999 wait complete. 2024-05-27T10:52:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.565+0000 7fd033000640 1 -- 172.21.15.47:0/2135174393 wait complete. 2024-05-27T10:52:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.568+0000 7f06a7200640 1 -- 172.21.15.47:0/551245664 shutdown_connections 2024-05-27T10:52:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.568+0000 7f06a7200640 1 --2- 172.21.15.47:0/551245664 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f06a006f250 0x7f06a006f6d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.568+0000 7f06a7200640 1 -- 172.21.15.47:0/551245664 >> 172.21.15.47:0/551245664 conn(0x7f06a006b940 msgr2=0x7f06a006bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.568+0000 7fd033000640 1 Processor -- start 2024-05-27T10:52:09.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.568+0000 7f3bfce00640 1 Processor -- start 2024-05-27T10:52:09.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.568+0000 7f24ce800640 1 --2- 172.21.15.47:0/165984877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24d0154570 0x7f24d01451f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.568+0000 7f24ce800640 1 -- 172.21.15.47:0/165984877 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d00acbc0 con 0x7f24d00ac200 2024-05-27T10:52:09.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.568+0000 7fd033000640 1 -- start start 2024-05-27T10:52:09.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.568+0000 7f24cd400640 1 --2- 172.21.15.47:0/165984877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24d0154570 0x7f24d01451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:09.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.569+0000 7f3bfce00640 1 -- start start 2024-05-27T10:52:09.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.569+0000 7f24ce800640 1 --2- 172.21.15.47:0/165984877 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f24d00ac200 0x7f24d00ac680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f24c800efb0 tx=0x7f24c80104e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.569+0000 7fcceb800640 1 Processor -- start 2024-05-27T10:52:09.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.569+0000 7f24c6000640 1 -- 172.21.15.47:0/165984877 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c800e0d0 con 0x7f24d00ac200 2024-05-27T10:52:09.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.569+0000 7f24c6000640 1 -- 172.21.15.47:0/165984877 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c800e270 con 0x7f24d00ac200 2024-05-27T10:52:09.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.569+0000 7f24c6000640 1 -- 172.21.15.47:0/165984877 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c800c670 con 0x7f24d00ac200 2024-05-27T10:52:09.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.570+0000 7f48e4400640 1 Processor -- start 2024-05-27T10:52:09.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.570+0000 7fd033000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd02c0cf2b0 0x7fd02c2025e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.570+0000 7f48e4400640 1 -- start start 2024-05-27T10:52:09.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.569+0000 7fcceb800640 1 -- start start 2024-05-27T10:52:09.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.570+0000 7f06a7200640 1 -- 172.21.15.47:0/551245664 shutdown_connections 2024-05-27T10:52:09.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.570+0000 7f24d4e00640 1 -- 172.21.15.47:0/165984877 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d0157b90 con 0x7f24d00ac200 2024-05-27T10:52:09.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.570+0000 7f3bfce00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3bf80cfed0 0x7f3bf81567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.570+0000 7f3bfce00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bf80d0330 0x7f3bf80c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.570+0000 7f3bfce00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bf8160090 0x7f3bf806ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.570+0000 7f3bfce00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf80cd5e0 con 0x7f3bf80d0330 2024-05-27T10:52:09.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.570+0000 7f3bfce00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf80cd300 con 0x7f3bf8160090 2024-05-27T10:52:09.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.570+0000 7f3bfce00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf80cd8c0 con 0x7f3bf80cfed0 2024-05-27T10:52:09.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.571+0000 7f06a7200640 1 -- 172.21.15.47:0/551245664 wait complete. 2024-05-27T10:52:09.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.571+0000 7f24d4e00640 1 -- 172.21.15.47:0/165984877 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d0158150 con 0x7f24d00ac200 2024-05-27T10:52:09.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.572+0000 7fcceb800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccc8004800 0x7fcce4160940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.572+0000 7fcceb800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcce40cc740 0x7fcce414ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.572+0000 7fcceb800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcce4161510 0x7fcce4150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.573+0000 7fcceb800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcce40b55f0 con 0x7fcce4161510 2024-05-27T10:52:09.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.573+0000 7fcceb800640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcce415bb30 con 0x7fccc8004800 2024-05-27T10:52:09.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.573+0000 7fcceb800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fcce415bcb0 con 0x7fcce40cc740 2024-05-27T10:52:09.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.571+0000 7f46daa00640 1 -- 172.21.15.47:0/3638248925 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f46d0007400 con 0x7f46dc04ffd0 2024-05-27T10:52:09.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.572+0000 7f46daa00640 1 --2- 172.21.15.47:0/3638248925 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f46c406c9c0 0x7f46c406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.572+0000 7f46daa00640 1 -- 172.21.15.47:0/3638248925 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f46d008b070 con 0x7f46dc04ffd0 2024-05-27T10:52:09.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.572+0000 7f46e2a00640 1 --2- 172.21.15.47:0/3638248925 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f46c406c9c0 0x7f46c406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.571+0000 7fd033000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd02c0d11e0 0x7fd02c2041c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.571+0000 7fd033000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd02c0d15c0 0x7fd02c0b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.572+0000 7fd02be00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd02c0cf2b0 0x7fd02c2025e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.572+0000 7fd02be00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd02c0cf2b0 0x7fd02c2025e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:44088/0 (socket says 172.21.15.47:44088) 2024-05-27T10:52:09.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.572+0000 7fd02be00640 1 -- 172.21.15.47:0/1929586077 learned_addr learned my addr 172.21.15.47:0/1929586077 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.572+0000 7fd033000640 1 -- 172.21.15.47:0/1929586077 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c0d0360 con 0x7fd02c0d11e0 2024-05-27T10:52:09.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.572+0000 7fd033000640 1 -- 172.21.15.47:0/1929586077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c0d0080 con 0x7fd02c0cf2b0 2024-05-27T10:52:09.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.572+0000 7fd033000640 1 -- 172.21.15.47:0/1929586077 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd02c0d2cf0 con 0x7fd02c0d15c0 2024-05-27T10:52:09.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.572+0000 7fd031000640 1 --2- 172.21.15.47:0/1929586077 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd02c0d15c0 0x7fd02c0b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.572+0000 7f48e4400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f48dc0cf4e0 0x7f48dc0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.572+0000 7f48e4400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48dc0d1310 0x7f48dc150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.572+0000 7f48e4400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48dc0d16f0 0x7f48dc157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.573+0000 7f48e4400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc0d22f0 con 0x7f48dc0d1310 2024-05-27T10:52:09.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.573+0000 7f48e1000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48dc0d1310 0x7f48dc150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.573+0000 7f48e4400640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc0d31c0 con 0x7f48dc0d16f0 2024-05-27T10:52:09.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.573+0000 7f48e4400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f48dc168870 con 0x7f48dc0cf4e0 2024-05-27T10:52:09.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.573+0000 7f48e1000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48dc0d1310 0x7f48dc150850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35322/0 (socket says 172.21.15.47:35322) 2024-05-27T10:52:09.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.573+0000 7f48e1000640 1 -- 172.21.15.47:0/738346640 learned_addr learned my addr 172.21.15.47:0/738346640 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.571+0000 7f3bf7e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bf8160090 0x7f3bf806ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.571+0000 7f3bf7e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bf8160090 0x7f3bf806ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:44078/0 (socket says 172.21.15.47:44078) 2024-05-27T10:52:09.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.571+0000 7f3bf7e00640 1 -- 172.21.15.47:0/2257126903 learned_addr learned my addr 172.21.15.47:0/2257126903 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.571+0000 7f3bf7400640 1 --2- 172.21.15.47:0/2257126903 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3bf80cfed0 0x7f3bf81567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.572+0000 7f3bf7e00640 1 -- 172.21.15.47:0/2257126903 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3bf80cfed0 msgr2=0x7f3bf81567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.573+0000 7f3bf7e00640 1 --2- 172.21.15.47:0/2257126903 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3bf80cfed0 0x7f3bf81567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.573+0000 7f3bf7e00640 1 -- 172.21.15.47:0/2257126903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bf80d0330 msgr2=0x7f3bf80c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.573+0000 7f3bf7e00640 1 --2- 172.21.15.47:0/2257126903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bf80d0330 0x7f3bf80c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.573+0000 7f3bf7e00640 1 -- 172.21.15.47:0/2257126903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf806d510 con 0x7f3bf8160090 2024-05-27T10:52:09.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.573+0000 7fcce8e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccc8004800 0x7fcce4160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.573+0000 7fcce8e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccc8004800 0x7fcce4160940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:44098/0 (socket says 172.21.15.47:44098) 2024-05-27T10:52:09.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.573+0000 7fcce8e00640 1 -- 172.21.15.47:0/4250003777 learned_addr learned my addr 172.21.15.47:0/4250003777 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.573+0000 7f06a7200640 1 Processor -- start 2024-05-27T10:52:09.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.573+0000 7f48e1000640 1 -- 172.21.15.47:0/738346640 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f48dc0cf4e0 msgr2=0x7f48dc0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.573+0000 7f48e1000640 1 --2- 172.21.15.47:0/738346640 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f48dc0cf4e0 0x7f48dc0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.574+0000 7f48e2400640 1 --2- 172.21.15.47:0/738346640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48dc0d16f0 0x7f48dc157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.574+0000 7f3bf7e00640 1 --2- 172.21.15.47:0/2257126903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bf8160090 0x7f3bf806ca50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000b9e0 tx=0x7f3bf000bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.574+0000 7f48e1000640 1 -- 172.21.15.47:0/738346640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48dc0d16f0 msgr2=0x7f48dc157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.574+0000 7f46e2a00640 1 --2- 172.21.15.47:0/3638248925 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f46c406c9c0 0x7f46c406ee80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f46d4033000 tx=0x7f46d4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.574+0000 7f06a7200640 1 -- start start 2024-05-27T10:52:09.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.574+0000 7fcce8e00640 1 -- 172.21.15.47:0/4250003777 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcce40cc740 msgr2=0x7fcce414ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.574+0000 7fcce8e00640 1 --2- 172.21.15.47:0/4250003777 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcce40cc740 0x7fcce414ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.574+0000 7fcce8e00640 1 -- 172.21.15.47:0/4250003777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcce4161510 msgr2=0x7fcce4150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.574+0000 7fcce8e00640 1 --2- 172.21.15.47:0/4250003777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcce4161510 0x7fcce4150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.574+0000 7fcce8e00640 1 -- 172.21.15.47:0/4250003777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce4160e80 con 0x7fccc8004800 2024-05-27T10:52:09.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.574+0000 7f48e1000640 1 --2- 172.21.15.47:0/738346640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48dc0d16f0 0x7f48dc157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.574+0000 7f48e1000640 1 -- 172.21.15.47:0/738346640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48dc0cd210 con 0x7f48dc0d1310 2024-05-27T10:52:09.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.574+0000 7f48e2400640 1 --2- 172.21.15.47:0/738346640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48dc0d16f0 0x7f48dc157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:09.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.574+0000 7f3bef400640 1 -- 172.21.15.47:0/2257126903 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0003b70 con 0x7f3bf8160090 2024-05-27T10:52:09.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.574+0000 7f3bef400640 1 -- 172.21.15.47:0/2257126903 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf0003d10 con 0x7f3bf8160090 2024-05-27T10:52:09.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.574+0000 7f3bfce00640 1 -- 172.21.15.47:0/2257126903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf806d7f0 con 0x7f3bf8160090 2024-05-27T10:52:09.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.574+0000 7f48e1000640 1 --2- 172.21.15.47:0/738346640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48dc0d1310 0x7f48dc150850 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f48c800e8b0 tx=0x7f48c800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.573+0000 7fd02b400640 1 --2- 172.21.15.47:0/1929586077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd02c0d11e0 0x7fd02c2041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.575+0000 7fcce8e00640 1 --2- 172.21.15.47:0/4250003777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccc8004800 0x7fcce4160940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00f6f0 tx=0x7fccdc00fbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.575+0000 7f3bfce00640 1 -- 172.21.15.47:0/2257126903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf80cb260 con 0x7f3bf8160090 2024-05-27T10:52:09.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.575+0000 7f3bef400640 1 -- 172.21.15.47:0/2257126903 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf000cb60 con 0x7f3bf8160090 2024-05-27T10:52:09.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.575+0000 7fd02be00640 1 -- 172.21.15.47:0/1929586077 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd02c0d15c0 msgr2=0x7fd02c0b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.575+0000 7fd02be00640 1 --2- 172.21.15.47:0/1929586077 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd02c0d15c0 0x7fd02c0b4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.575+0000 7f06a7200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06a006e3c0 0x7f06a01f85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.575+0000 7f06a7200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06a006f250 0x7f06a0136390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.575+0000 7f06a7200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f06a01481b0 0x7f06a01368d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.575+0000 7fd02be00640 1 -- 172.21.15.47:0/1929586077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd02c0d11e0 msgr2=0x7fd02c2041c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.575+0000 7fd02be00640 1 --2- 172.21.15.47:0/1929586077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd02c0d11e0 0x7fd02c2041c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.576+0000 7fd02be00640 1 -- 172.21.15.47:0/1929586077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd02c0c84c0 con 0x7fd02c0cf2b0 2024-05-27T10:52:09.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.576+0000 7f06a7200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f06a00aeb10 con 0x7f06a006f250 2024-05-27T10:52:09.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.576+0000 7f06a7200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f06a006dea0 con 0x7f06a006e3c0 2024-05-27T10:52:09.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.576+0000 7f06a7200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f06a00aec90 con 0x7f06a01481b0 2024-05-27T10:52:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.576+0000 7fcce0c00640 1 -- 172.21.15.47:0/4250003777 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc001350 con 0x7fccc8004800 2024-05-27T10:52:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.576+0000 7fcceb800640 1 -- 172.21.15.47:0/4250003777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce4161dd0 con 0x7fccc8004800 2024-05-27T10:52:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.576+0000 7fcce0c00640 1 -- 172.21.15.47:0/4250003777 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccdc018070 con 0x7fccc8004800 2024-05-27T10:52:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.576+0000 7fcce0c00640 1 -- 172.21.15.47:0/4250003777 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0052d0 con 0x7fccc8004800 2024-05-27T10:52:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.576+0000 7fd02be00640 1 --2- 172.21.15.47:0/1929586077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd02c0cf2b0 0x7fd02c2025e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd024034040 tx=0x7fd024004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.577+0000 7f06a5200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f06a01481b0 0x7f06a01368d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.577+0000 7f06a5200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f06a01481b0 0x7f06a01368d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:56664/0 (socket says 172.21.15.47:56664) 2024-05-27T10:52:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.577+0000 7f06a5200640 1 -- 172.21.15.47:0/46607048 learned_addr learned my addr 172.21.15.47:0/46607048 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.577+0000 7fcceb800640 1 -- 172.21.15.47:0/4250003777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce4160140 con 0x7fccc8004800 2024-05-27T10:52:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.577+0000 7f069fe00640 1 --2- 172.21.15.47:0/46607048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06a006e3c0 0x7f06a01f85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.576+0000 7f24d4e00640 1 -- 172.21.15.47:0/165984877 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d00737e0 con 0x7f24d00ac200 2024-05-27T10:52:09.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.577+0000 7f24c6000640 1 -- 172.21.15.47:0/165984877 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f24c800c810 con 0x7f24d00ac200 2024-05-27T10:52:09.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.578+0000 7f06a5200640 1 -- 172.21.15.47:0/46607048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06a006e3c0 msgr2=0x7f06a01f85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.578+0000 7f06a5200640 1 --2- 172.21.15.47:0/46607048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06a006e3c0 0x7f06a01f85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.578+0000 7f069f400640 1 --2- 172.21.15.47:0/46607048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06a006f250 0x7f06a0136390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.578+0000 7f06a5200640 1 -- 172.21.15.47:0/46607048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06a006f250 msgr2=0x7f06a0136390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.578+0000 7f06a5200640 1 --2- 172.21.15.47:0/46607048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06a006f250 0x7f06a0136390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.578+0000 7f24c6000640 1 --2- 172.21.15.47:0/165984877 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f24b006c9c0 0x7f24b006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.578+0000 7f06a5200640 1 -- 172.21.15.47:0/46607048 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a0137560 con 0x7f06a01481b0 2024-05-27T10:52:09.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.579+0000 7fcceb800640 1 -- 172.21.15.47:0/4250003777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcce4072ae0 con 0x7fccc8004800 2024-05-27T10:52:09.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.578+0000 7f24c6000640 1 -- 172.21.15.47:0/165984877 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f24c80900e0 con 0x7f24d00ac200 2024-05-27T10:52:09.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.579+0000 7f24cde00640 1 --2- 172.21.15.47:0/165984877 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f24b006c9c0 0x7f24b006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.579+0000 7f06a5200640 1 --2- 172.21.15.47:0/46607048 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f06a01481b0 0x7f06a01368d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f069000c500 tx=0x7f069000c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.579+0000 7f3bfce00640 1 -- 172.21.15.47:0/2257126903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd0005290 con 0x7f3bf8160090 2024-05-27T10:52:09.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.579+0000 7f3bef400640 1 -- 172.21.15.47:0/2257126903 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3bf000cd00 con 0x7f3bf8160090 2024-05-27T10:52:09.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.580+0000 7f24cde00640 1 --2- 172.21.15.47:0/165984877 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f24b006c9c0 0x7f24b006ee80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f24c0009ba0 tx=0x7f24c0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.580+0000 7f46daa00640 1 -- 172.21.15.47:0/3638248925 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f46dc0e96e0 con 0x7f46dc04ffd0 2024-05-27T10:52:09.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.579+0000 7fd023e00640 1 -- 172.21.15.47:0/1929586077 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd024036050 con 0x7fd02c0cf2b0 2024-05-27T10:52:09.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.580+0000 7f48d9600640 1 -- 172.21.15.47:0/738346640 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8017070 con 0x7f48dc0d1310 2024-05-27T10:52:09.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.580+0000 7f48d9600640 1 -- 172.21.15.47:0/738346640 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c800c940 con 0x7f48dc0d1310 2024-05-27T10:52:09.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.580+0000 7f48d9600640 1 -- 172.21.15.47:0/738346640 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c800cd10 con 0x7f48dc0d1310 2024-05-27T10:52:09.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.580+0000 7f48e4400640 1 -- 172.21.15.47:0/738346640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48dc0cd4f0 con 0x7f48dc0d1310 2024-05-27T10:52:09.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.580+0000 7fd033000640 1 -- 172.21.15.47:0/1929586077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd02c202070 con 0x7fd02c0cf2b0 2024-05-27T10:52:09.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.580+0000 7fd033000640 1 -- 172.21.15.47:0/1929586077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd02c0c9af0 con 0x7fd02c0cf2b0 2024-05-27T10:52:09.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.581+0000 7fd023e00640 1 -- 172.21.15.47:0/1929586077 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd024042070 con 0x7fd02c0cf2b0 2024-05-27T10:52:09.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.581+0000 7fd023e00640 1 -- 172.21.15.47:0/1929586077 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd024009510 con 0x7fd02c0cf2b0 2024-05-27T10:52:09.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.580+0000 7f48e4400640 1 -- 172.21.15.47:0/738346640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48dc1f6da0 con 0x7f48dc0d1310 2024-05-27T10:52:09.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.581+0000 7f3bef400640 1 --2- 172.21.15.47:0/2257126903 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3bd806c8f0 0x7f3bd806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.581+0000 7f3bef400640 1 -- 172.21.15.47:0/2257126903 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3bf008b930 con 0x7f3bf8160090 2024-05-27T10:52:09.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.581+0000 7f48e4400640 1 -- 172.21.15.47:0/738346640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48b8005290 con 0x7f48dc0d1310 2024-05-27T10:52:09.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.582+0000 7fd033000640 1 -- 172.21.15.47:0/1929586077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd02c0d4bd0 con 0x7fd02c0cf2b0 2024-05-27T10:52:09.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.582+0000 7f3bf7400640 1 --2- 172.21.15.47:0/2257126903 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3bd806c8f0 0x7f3bd806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.583+0000 7fcce0c00640 1 -- 172.21.15.47:0/4250003777 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fccdc00d730 con 0x7fccc8004800 2024-05-27T10:52:09.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.584+0000 7fcce0c00640 1 --2- 172.21.15.47:0/4250003777 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fccc006c8f0 0x7fccc006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.585+0000 7fcce0c00640 1 -- 172.21.15.47:0/4250003777 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fccdc08b980 con 0x7fccc8004800 2024-05-27T10:52:09.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.585+0000 7f48d9600640 1 -- 172.21.15.47:0/738346640 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f48c801a070 con 0x7f48dc0d1310 2024-05-27T10:52:09.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.585+0000 7f3bf7400640 1 --2- 172.21.15.47:0/2257126903 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3bd806c8f0 0x7f3bd806edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3be8034000 tx=0x7f3be8040040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.585+0000 7fcce3e00640 1 --2- 172.21.15.47:0/4250003777 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fccc006c8f0 0x7fccc006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.586+0000 7f48d9600640 1 --2- 172.21.15.47:0/738346640 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f48bc06c8f0 0x7f48bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.586+0000 7fcce3e00640 1 --2- 172.21.15.47:0/4250003777 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fccc006c8f0 0x7fccc006edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fccd4033000 tx=0x7fccd4007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.586+0000 7f48d9600640 1 -- 172.21.15.47:0/738346640 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f48c808c290 con 0x7f48dc0d1310 2024-05-27T10:52:09.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.587+0000 7f48e1a00640 1 --2- 172.21.15.47:0/738346640 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f48bc06c8f0 0x7f48bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.587+0000 7f48e1a00640 1 --2- 172.21.15.47:0/738346640 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f48bc06c8f0 0x7f48bc06edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f48d0000f60 tx=0x7f48d00079b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.590+0000 7f48d9600640 1 -- 172.21.15.47:0/738346640 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f48c805a6a0 con 0x7f48dc0d1310 2024-05-27T10:52:09.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.591+0000 7f0697e00640 1 -- 172.21.15.47:0/46607048 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690018070 con 0x7f06a01481b0 2024-05-27T10:52:09.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.591+0000 7f0697e00640 1 -- 172.21.15.47:0/46607048 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06900074e0 con 0x7f06a01481b0 2024-05-27T10:52:09.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.591+0000 7f0697e00640 1 -- 172.21.15.47:0/46607048 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690004a20 con 0x7f06a01481b0 2024-05-27T10:52:09.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.592+0000 7f06a7200640 1 -- 172.21.15.47:0/46607048 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a00a9b60 con 0x7f06a01481b0 2024-05-27T10:52:09.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.592+0000 7f06a7200640 1 -- 172.21.15.47:0/46607048 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a0137800 con 0x7f06a01481b0 2024-05-27T10:52:09.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.592+0000 7f24c6000640 1 -- 172.21.15.47:0/165984877 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f24d00acbc0 con 0x7f24d00ac200 2024-05-27T10:52:09.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.593+0000 7f06a7200640 1 -- 172.21.15.47:0/46607048 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06a00737e0 con 0x7f06a01481b0 2024-05-27T10:52:09.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.596+0000 7f0697e00640 1 -- 172.21.15.47:0/46607048 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f069001b070 con 0x7f06a01481b0 2024-05-27T10:52:09.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.597+0000 7f0697e00640 1 --2- 172.21.15.47:0/46607048 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f068006c940 0x7f068006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.598+0000 7f0697e00640 1 -- 172.21.15.47:0/46607048 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f069008b100 con 0x7f06a01481b0 2024-05-27T10:52:09.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.598+0000 7f069fe00640 1 --2- 172.21.15.47:0/46607048 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f068006c940 0x7f068006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.599+0000 7f069fe00640 1 --2- 172.21.15.47:0/46607048 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f068006c940 0x7f068006ee00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f06980012e0 tx=0x7f0698005b70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.600+0000 7f3bef400640 1 -- 172.21.15.47:0/2257126903 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3bf0059670 con 0x7f3bf8160090 2024-05-27T10:52:09.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.603+0000 7fd023e00640 1 -- 172.21.15.47:0/1929586077 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd024047460 con 0x7fd02c0cf2b0 2024-05-27T10:52:09.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.605+0000 7fd023e00640 1 --2- 172.21.15.47:0/1929586077 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd00c06c940 0x7fd00c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:09.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.605+0000 7fd02b400640 1 --2- 172.21.15.47:0/1929586077 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd00c06c940 0x7fd00c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:09.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.606+0000 7fd02b400640 1 --2- 172.21.15.47:0/1929586077 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd00c06c940 0x7fd00c06ee00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd018006fd0 tx=0x7fd018008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:09.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.609+0000 7f0697e00640 1 -- 172.21.15.47:0/46607048 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0690059510 con 0x7f06a01481b0 2024-05-27T10:52:09.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.614+0000 7fd023e00640 1 -- 172.21.15.47:0/1929586077 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd0240796d0 con 0x7fd02c0cf2b0 2024-05-27T10:52:09.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.615+0000 7fcce0c00640 1 -- 172.21.15.47:0/4250003777 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcce4072ae0 con 0x7fccc8004800 2024-05-27T10:52:09.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.629+0000 7fd023e00640 1 -- 172.21.15.47:0/1929586077 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd0240abe20 con 0x7fd02c0cf2b0 2024-05-27T10:52:09.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.989+0000 7fd43be00640 1 -- 172.21.15.47:0/372682793 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd414005850 con 0x7fd434005ee0 2024-05-27T10:52:09.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.990+0000 7fd433400640 1 -- 172.21.15.47:0/372682793 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd43c0d57e0 con 0x7fd434005ee0 2024-05-27T10:52:09.988 INFO:teuthology.orchestra.run.smithi047.stdout:55834574851 2024-05-27T10:52:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.994+0000 7fd43be00640 1 -- 172.21.15.47:0/372682793 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd41c06c8f0 msgr2=0x7fd41c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.994+0000 7fd43be00640 1 --2- 172.21.15.47:0/372682793 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd41c06c8f0 0x7fd41c06edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd42803d000 tx=0x7fd428008030 comp rx=0 tx=0).stop 2024-05-27T10:52:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.994+0000 7fd43be00640 1 -- 172.21.15.47:0/372682793 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd434005ee0 msgr2=0x7fd4340d1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.994+0000 7fd43be00640 1 --2- 172.21.15.47:0/372682793 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd434005ee0 0x7fd4340d1ae0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd43c063510 tx=0x7fd43c06cd20 comp rx=0 tx=0).stop 2024-05-27T10:52:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.995+0000 7fd43be00640 1 -- 172.21.15.47:0/372682793 shutdown_connections 2024-05-27T10:52:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.995+0000 7fd43be00640 1 --2- 172.21.15.47:0/372682793 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd41c06c8f0 0x7fd41c06edb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.995+0000 7fd43be00640 1 --2- 172.21.15.47:0/372682793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4340e6ca0 0x7fd4340db840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.995+0000 7fd43be00640 1 --2- 172.21.15.47:0/372682793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4340e3160 0x7fd434048e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.995+0000 7fd43be00640 1 --2- 172.21.15.47:0/372682793 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd434005ee0 0x7fd4340d1ae0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.995+0000 7fd43be00640 1 -- 172.21.15.47:0/372682793 >> 172.21.15.47:0/372682793 conn(0x7fd434009fb0 msgr2=0x7fd4340e4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.995+0000 7fd43be00640 1 -- 172.21.15.47:0/372682793 shutdown_connections 2024-05-27T10:52:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:09.995+0000 7fd43be00640 1 -- 172.21.15.47:0/372682793 wait complete. 2024-05-27T10:52:10.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.008+0000 7f48e4400640 1 -- 172.21.15.47:0/738346640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f48b8005850 con 0x7f48dc0d1310 2024-05-27T10:52:10.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.011+0000 7f48d9600640 1 -- 172.21.15.47:0/738346640 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f48c8059fa0 con 0x7f48dc0d1310 2024-05-27T10:52:10.009 INFO:teuthology.orchestra.run.smithi047.stdout:55834574851 2024-05-27T10:52:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.014+0000 7f48e4400640 1 -- 172.21.15.47:0/738346640 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f48bc06c8f0 msgr2=0x7f48bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.014+0000 7f48e4400640 1 --2- 172.21.15.47:0/738346640 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f48bc06c8f0 0x7f48bc06edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f48d0000f60 tx=0x7f48d00079b0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.014+0000 7f48e4400640 1 -- 172.21.15.47:0/738346640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48dc0d1310 msgr2=0x7f48dc150850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.014+0000 7f48e4400640 1 --2- 172.21.15.47:0/738346640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48dc0d1310 0x7f48dc150850 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f48c800e8b0 tx=0x7f48c800ed70 comp rx=0 tx=0).stop 2024-05-27T10:52:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.014+0000 7f48e4400640 1 -- 172.21.15.47:0/738346640 shutdown_connections 2024-05-27T10:52:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.014+0000 7f48e4400640 1 --2- 172.21.15.47:0/738346640 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f48bc06c8f0 0x7f48bc06edb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.015+0000 7f48e4400640 1 --2- 172.21.15.47:0/738346640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48dc0d16f0 0x7f48dc157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.015+0000 7f48e4400640 1 --2- 172.21.15.47:0/738346640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48dc0d1310 0x7f48dc150850 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.015+0000 7f48e4400640 1 --2- 172.21.15.47:0/738346640 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f48dc0cf4e0 0x7f48dc0cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.015+0000 7f48e4400640 1 -- 172.21.15.47:0/738346640 >> 172.21.15.47:0/738346640 conn(0x7f48dc08bfd0 msgr2=0x7f48dc0b9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.015+0000 7f48e4400640 1 -- 172.21.15.47:0/738346640 shutdown_connections 2024-05-27T10:52:10.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.015+0000 7f48e4400640 1 -- 172.21.15.47:0/738346640 wait complete. 2024-05-27T10:52:10.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.017+0000 7f46e3e00640 1 -- 172.21.15.47:0/3638248925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f46dc04b7b0 con 0x7f46dc04ffd0 2024-05-27T10:52:10.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.018+0000 7f46daa00640 1 -- 172.21.15.47:0/3638248925 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f46dc17d560 con 0x7f46dc04ffd0 2024-05-27T10:52:10.019 INFO:teuthology.orchestra.run.smithi047.stdout:55834574853 2024-05-27T10:52:10.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.022+0000 7f46e3e00640 1 -- 172.21.15.47:0/3638248925 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f46c406c9c0 msgr2=0x7f46c406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:10.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.022+0000 7f46e3e00640 1 --2- 172.21.15.47:0/3638248925 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f46c406c9c0 0x7f46c406ee80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f46d4033000 tx=0x7f46d4008030 comp rx=0 tx=0).stop 2024-05-27T10:52:10.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.022+0000 7f46e3e00640 1 -- 172.21.15.47:0/3638248925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc04ffd0 msgr2=0x7f46dc0466f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:10.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.022+0000 7f46e3e00640 1 --2- 172.21.15.47:0/3638248925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc04ffd0 0x7f46dc0466f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f46d000c400 tx=0x7f46d000c8c0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.0 2024-05-27T10:52:10.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.023+0000 7f46e3e00640 1 -- 172.21.15.47:0/3638248925 shutdown_connections 2024-05-27T10:52:10.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.023+0000 7f46e3e00640 1 --2- 172.21.15.47:0/3638248925 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f46c406c9c0 0x7f46c406ee80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.023+0000 7f46e3e00640 1 --2- 172.21.15.47:0/3638248925 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f46dc0ead00 0x7f46dc046c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.023+0000 7f46e3e00640 1 --2- 172.21.15.47:0/3638248925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46dc04ffd0 0x7f46dc0466f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.023+0000 7f46e3e00640 1 --2- 172.21.15.47:0/3638248925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46dc006ef0 0x7f46dc0e91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.023+0000 7f46e3e00640 1 -- 172.21.15.47:0/3638248925 >> 172.21.15.47:0/3638248925 conn(0x7f46dc009fb0 msgr2=0x7f46dc0056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:10.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.024+0000 7f46e3e00640 1 -- 172.21.15.47:0/3638248925 shutdown_connections 2024-05-27T10:52:10.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.025+0000 7f46e3e00640 1 -- 172.21.15.47:0/3638248925 wait complete. 2024-05-27T10:52:10.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.032+0000 7f24d4e00640 1 -- 172.21.15.47:0/165984877 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f24d004fdc0 con 0x7f24d00ac200 2024-05-27T10:52:10.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.033+0000 7f24c6000640 1 -- 172.21.15.47:0/165984877 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f24c805e580 con 0x7f24d00ac200 2024-05-27T10:52:10.033 INFO:teuthology.orchestra.run.smithi047.stdout:55834574851 2024-05-27T10:52:10.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.037+0000 7f24d4e00640 1 -- 172.21.15.47:0/165984877 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f24b006c9c0 msgr2=0x7f24b006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:10.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.037+0000 7f24d4e00640 1 --2- 172.21.15.47:0/165984877 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f24b006c9c0 0x7f24b006ee80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f24c0009ba0 tx=0x7f24c0008040 comp rx=0 tx=0).stop 2024-05-27T10:52:10.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.037+0000 7f24d4e00640 1 -- 172.21.15.47:0/165984877 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f24d00ac200 msgr2=0x7f24d00ac680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:10.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.037+0000 7f24d4e00640 1 --2- 172.21.15.47:0/165984877 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f24d00ac200 0x7f24d00ac680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f24c800efb0 tx=0x7f24c80104e0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.038+0000 7f24d4e00640 1 -- 172.21.15.47:0/165984877 shutdown_connections 2024-05-27T10:52:10.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.038+0000 7f24d4e00640 1 --2- 172.21.15.47:0/165984877 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f24b006c9c0 0x7f24b006ee80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.038+0000 7f24d4e00640 1 --2- 172.21.15.47:0/165984877 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f24d00ac200 0x7f24d00ac680 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.038+0000 7f24d4e00640 1 --2- 172.21.15.47:0/165984877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24d0154570 0x7f24d01451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.038+0000 7f24d4e00640 1 --2- 172.21.15.47:0/165984877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24d006c050 0x7f24d0144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.038+0000 7f24d4e00640 1 -- 172.21.15.47:0/165984877 >> 172.21.15.47:0/165984877 conn(0x7f24d0067ad0 msgr2=0x7f24d006b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:10.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.038+0000 7f24d4e00640 1 -- 172.21.15.47:0/165984877 shutdown_connections 2024-05-27T10:52:10.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.038+0000 7f24d4e00640 1 -- 172.21.15.47:0/165984877 wait complete. 2024-05-27T10:52:10.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.5 2024-05-27T10:52:10.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.046+0000 7fcceb800640 1 -- 172.21.15.47:0/4250003777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fcce41622f0 con 0x7fccc8004800 2024-05-27T10:52:10.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.047+0000 7fcce0c00640 1 -- 172.21.15.47:0/4250003777 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fccdc059d10 con 0x7fccc8004800 2024-05-27T10:52:10.045 INFO:teuthology.orchestra.run.smithi047.stdout:55834574852 2024-05-27T10:52:10.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.2 2024-05-27T10:52:10.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.050+0000 7fcceb800640 1 -- 172.21.15.47:0/4250003777 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fccc006c8f0 msgr2=0x7fccc006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:10.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.050+0000 7fcceb800640 1 --2- 172.21.15.47:0/4250003777 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fccc006c8f0 0x7fccc006edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fccd4033000 tx=0x7fccd4007000 comp rx=0 tx=0).stop 2024-05-27T10:52:10.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.050+0000 7fcceb800640 1 -- 172.21.15.47:0/4250003777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccc8004800 msgr2=0x7fcce4160940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:10.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.050+0000 7fcceb800640 1 --2- 172.21.15.47:0/4250003777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccc8004800 0x7fcce4160940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00f6f0 tx=0x7fccdc00fbb0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.050+0000 7fcceb800640 1 -- 172.21.15.47:0/4250003777 shutdown_connections 2024-05-27T10:52:10.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.050+0000 7fcceb800640 1 --2- 172.21.15.47:0/4250003777 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fccc006c8f0 0x7fccc006edb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.050+0000 7fcceb800640 1 --2- 172.21.15.47:0/4250003777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcce4161510 0x7fcce4150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.050+0000 7fcceb800640 1 --2- 172.21.15.47:0/4250003777 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcce40cc740 0x7fcce414ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.050+0000 7fcceb800640 1 --2- 172.21.15.47:0/4250003777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccc8004800 0x7fcce4160940 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00f6f0 tx=0x7fccdc00fbb0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.050+0000 7fcceb800640 1 -- 172.21.15.47:0/4250003777 >> 172.21.15.47:0/4250003777 conn(0x7fcce4067ad0 msgr2=0x7fcce415db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:10.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.050+0000 7fcceb800640 1 -- 172.21.15.47:0/4250003777 shutdown_connections 2024-05-27T10:52:10.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.050+0000 7fcceb800640 1 -- 172.21.15.47:0/4250003777 wait complete. 2024-05-27T10:52:10.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.4 2024-05-27T10:52:10.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.059+0000 7f3bfce00640 1 -- 172.21.15.47:0/2257126903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f3bd0005580 con 0x7f3bf8160090 2024-05-27T10:52:10.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.060+0000 7f3bef400640 1 -- 172.21.15.47:0/2257126903 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3bf005d970 con 0x7f3bf8160090 2024-05-27T10:52:10.058 INFO:teuthology.orchestra.run.smithi047.stdout:55834574852 2024-05-27T10:52:10.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.063+0000 7f3bfce00640 1 -- 172.21.15.47:0/2257126903 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3bd806c8f0 msgr2=0x7f3bd806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:10.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.063+0000 7f3bfce00640 1 --2- 172.21.15.47:0/2257126903 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3bd806c8f0 0x7f3bd806edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3be8034000 tx=0x7f3be8040040 comp rx=0 tx=0).stop 2024-05-27T10:52:10.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.063+0000 7f3bfce00640 1 -- 172.21.15.47:0/2257126903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bf8160090 msgr2=0x7f3bf806ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:10.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.063+0000 7f3bfce00640 1 --2- 172.21.15.47:0/2257126903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bf8160090 0x7f3bf806ca50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000b9e0 tx=0x7f3bf000bea0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.063+0000 7f3bfce00640 1 -- 172.21.15.47:0/2257126903 shutdown_connections 2024-05-27T10:52:10.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.063+0000 7f3bfce00640 1 --2- 172.21.15.47:0/2257126903 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3bd806c8f0 0x7f3bd806edb0 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3be8034000 tx=0x7f3be8040040 comp rx=0 tx=0).stop 2024-05-27T10:52:10.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.063+0000 7f3bfce00640 1 --2- 172.21.15.47:0/2257126903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bf8160090 0x7f3bf806ca50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.063+0000 7f3bfce00640 1 --2- 172.21.15.47:0/2257126903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bf80d0330 0x7f3bf80c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.063+0000 7f3bfce00640 1 --2- 172.21.15.47:0/2257126903 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3bf80cfed0 0x7f3bf81567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.063+0000 7f3bfce00640 1 -- 172.21.15.47:0/2257126903 >> 172.21.15.47:0/2257126903 conn(0x7f3bf80b3df0 msgr2=0x7f3bf80d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:10.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.064+0000 7f3bfce00640 1 -- 172.21.15.47:0/2257126903 shutdown_connections 2024-05-27T10:52:10.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.064+0000 7f3bfce00640 1 -- 172.21.15.47:0/2257126903 wait complete. 2024-05-27T10:52:10.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.066+0000 7f06a7200640 1 -- 172.21.15.47:0/46607048 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f06a004fdc0 con 0x7f06a01481b0 2024-05-27T10:52:10.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.067+0000 7f0697e00640 1 -- 172.21.15.47:0/46607048 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0690058e10 con 0x7f06a01481b0 2024-05-27T10:52:10.065 INFO:teuthology.orchestra.run.smithi047.stdout:55834574851 2024-05-27T10:52:10.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.069+0000 7f06a7200640 1 -- 172.21.15.47:0/46607048 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f068006c940 msgr2=0x7f068006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:10.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.069+0000 7f06a7200640 1 --2- 172.21.15.47:0/46607048 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f068006c940 0x7f068006ee00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f06980012e0 tx=0x7f0698005b70 comp rx=0 tx=0).stop 2024-05-27T10:52:10.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.069+0000 7f06a7200640 1 -- 172.21.15.47:0/46607048 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f06a01481b0 msgr2=0x7f06a01368d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:10.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.069+0000 7f06a7200640 1 --2- 172.21.15.47:0/46607048 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f06a01481b0 0x7f06a01368d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f069000c500 tx=0x7f069000c9c0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.069+0000 7f06a7200640 1 -- 172.21.15.47:0/46607048 shutdown_connections 2024-05-27T10:52:10.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.069+0000 7f06a7200640 1 --2- 172.21.15.47:0/46607048 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f068006c940 0x7f068006ee00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.069+0000 7f06a7200640 1 --2- 172.21.15.47:0/46607048 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f06a01481b0 0x7f06a01368d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.069+0000 7f06a7200640 1 --2- 172.21.15.47:0/46607048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06a006f250 0x7f06a0136390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.069+0000 7f06a7200640 1 --2- 172.21.15.47:0/46607048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06a006e3c0 0x7f06a01f85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.069+0000 7f06a7200640 1 -- 172.21.15.47:0/46607048 >> 172.21.15.47:0/46607048 conn(0x7f06a006b940 msgr2=0x7f06a015df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:10.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.069+0000 7f06a7200640 1 -- 172.21.15.47:0/46607048 shutdown_connections 2024-05-27T10:52:10.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.070+0000 7f06a7200640 1 -- 172.21.15.47:0/46607048 wait complete. 2024-05-27T10:52:10.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.073+0000 7fd033000640 1 -- 172.21.15.47:0/1929586077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd02c04fdc0 con 0x7fd02c0cf2b0 2024-05-27T10:52:10.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.073+0000 7fd023e00640 1 -- 172.21.15.47:0/1929586077 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd02c0d4bd0 con 0x7fd02c0cf2b0 2024-05-27T10:52:10.071 INFO:teuthology.orchestra.run.smithi047.stdout:55834574853 2024-05-27T10:52:10.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.1 2024-05-27T10:52:10.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.076+0000 7fd033000640 1 -- 172.21.15.47:0/1929586077 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd00c06c940 msgr2=0x7fd00c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:10.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.076+0000 7fd033000640 1 --2- 172.21.15.47:0/1929586077 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd00c06c940 0x7fd00c06ee00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd018006fd0 tx=0x7fd018008040 comp rx=0 tx=0).stop 2024-05-27T10:52:10.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.076+0000 7fd033000640 1 -- 172.21.15.47:0/1929586077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd02c0cf2b0 msgr2=0x7fd02c2025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:10.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.076+0000 7fd033000640 1 --2- 172.21.15.47:0/1929586077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd02c0cf2b0 0x7fd02c2025e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd024034040 tx=0x7fd024004a40 comp rx=0 tx=0).stop 2024-05-27T10:52:10.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.076+0000 7fd033000640 1 -- 172.21.15.47:0/1929586077 shutdown_connections 2024-05-27T10:52:10.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.076+0000 7fd033000640 1 --2- 172.21.15.47:0/1929586077 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd00c06c940 0x7fd00c06ee00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.076+0000 7fd033000640 1 --2- 172.21.15.47:0/1929586077 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd02c0d15c0 0x7fd02c0b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.076+0000 7fd033000640 1 --2- 172.21.15.47:0/1929586077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd02c0d11e0 0x7fd02c2041c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.076+0000 7fd033000640 1 --2- 172.21.15.47:0/1929586077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd02c0cf2b0 0x7fd02c2025e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:10.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.076+0000 7fd033000640 1 -- 172.21.15.47:0/1929586077 >> 172.21.15.47:0/1929586077 conn(0x7fd02c08bfd0 msgr2=0x7fd02c0b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:10.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.076+0000 7fd033000640 1 -- 172.21.15.47:0/1929586077 shutdown_connections 2024-05-27T10:52:10.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:10.076+0000 7fd033000640 1 -- 172.21.15.47:0/1929586077 wait complete. 2024-05-27T10:52:10.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.6 2024-05-27T10:52:10.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.3 2024-05-27T10:52:10.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.7 2024-05-27T10:52:11.022 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-27T10:52:11.042 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-27T10:52:11.049 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-27T10:52:11.056 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-27T10:52:11.074 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-27T10:52:11.083 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-27T10:52:11.085 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-27T10:52:11.093 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-27T10:52:11.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.291+0000 7f00ace00640 1 Processor -- start 2024-05-27T10:52:11.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.291+0000 7f00ace00640 1 -- start start 2024-05-27T10:52:11.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.295+0000 7f00ace00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f00a0050180 0x7f00a00e0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.295+0000 7f00ace00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f00a00530a0 0x7f00a0005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.296+0000 7f00a7400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f00a00df100 0x7f00a004fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60294/0 (socket says 172.21.15.47:60294) 2024-05-27T10:52:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.296+0000 7f00ace00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00a00df4e0 con 0x7f00a00df100 2024-05-27T10:52:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.296+0000 7f00ace00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f00a00535f0 con 0x7f00a0050180 2024-05-27T10:52:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.297+0000 7f00a7e00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f00a00530a0 0x7f00a0005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.297+0000 7f00a7e00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f00a00530a0 0x7f00a0005fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:47822/0 (socket says 172.21.15.47:47822) 2024-05-27T10:52:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.297+0000 7f00a7e00640 1 -- 172.21.15.47:0/2674562440 learned_addr learned my addr 172.21.15.47:0/2674562440 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.297+0000 7f00a6a00640 1 --2- 172.21.15.47:0/2674562440 >> v2:172.21.15.47:3300/0 conn(0x7f00a0050180 0x7f00a00e0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.297+0000 7f00ace00640 1 -- 172.21.15.47:0/2674562440 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f00a00538d0 con 0x7f00a00530a0 2024-05-27T10:52:11.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.299+0000 7f00a7e00640 1 -- 172.21.15.47:0/2674562440 >> v2:172.21.15.47:3300/0 conn(0x7f00a0050180 msgr2=0x7f00a00e0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:11.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.299+0000 7f00a7e00640 1 --2- 172.21.15.47:0/2674562440 >> v2:172.21.15.47:3300/0 conn(0x7f00a0050180 0x7f00a00e0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.299+0000 7f00a7e00640 1 -- 172.21.15.47:0/2674562440 >> v1:172.21.15.47:6789/0 conn(0x7f00a00df100 legacy=0x7f00a004fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.299+0000 7f00a6a00640 1 --2- 172.21.15.47:0/2674562440 >> v2:172.21.15.47:3300/0 conn(0x7f00a0050180 0x7f00a00e0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:11.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.300+0000 7f00a7e00640 1 -- 172.21.15.47:0/2674562440 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a0053bb0 con 0x7f00a00530a0 2024-05-27T10:52:11.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.302+0000 7f00a7e00640 1 --2- 172.21.15.47:0/2674562440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a00530a0 0x7f00a0005fe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f00a0052c20 tx=0x7f009402a290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41f414f5f748f9b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.302+0000 7f00a6000640 1 -- 172.21.15.47:0/2674562440 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0094037070 con 0x7f00a00530a0 2024-05-27T10:52:11.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.302+0000 7f00a6000640 1 -- 172.21.15.47:0/2674562440 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0094032440 con 0x7f00a00530a0 2024-05-27T10:52:11.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.302+0000 7f00a6000640 1 -- 172.21.15.47:0/2674562440 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0094032830 con 0x7f00a00530a0 2024-05-27T10:52:11.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.304+0000 7f00ace00640 1 -- 172.21.15.47:0/2674562440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a00530a0 msgr2=0x7f00a0005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.304+0000 7f00ace00640 1 --2- 172.21.15.47:0/2674562440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a00530a0 0x7f00a0005fe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f00a0052c20 tx=0x7f009402a290 comp rx=0 tx=0).stop 2024-05-27T10:52:11.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.304+0000 7f00ace00640 1 -- 172.21.15.47:0/2674562440 shutdown_connections 2024-05-27T10:52:11.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.304+0000 7f00ace00640 1 --2- 172.21.15.47:0/2674562440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a00530a0 0x7f00a0005fe0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.304+0000 7f00ace00640 1 --2- 172.21.15.47:0/2674562440 >> v2:172.21.15.47:3300/0 conn(0x7f00a0050180 0x7f00a00e0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.304+0000 7f00ace00640 1 -- 172.21.15.47:0/2674562440 >> 172.21.15.47:0/2674562440 conn(0x7f00a0009fb0 msgr2=0x7f00a000a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:11.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.308+0000 7f00ace00640 1 -- 172.21.15.47:0/2674562440 shutdown_connections 2024-05-27T10:52:11.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.308+0000 7f00ace00640 1 -- 172.21.15.47:0/2674562440 wait complete. 2024-05-27T10:52:11.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.312+0000 7f00ace00640 1 Processor -- start 2024-05-27T10:52:11.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.313+0000 7f00ace00640 1 -- start start 2024-05-27T10:52:11.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.314+0000 7f00ace00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00a0050180 0x7f00a00ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.314+0000 7f00ace00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00a00530a0 0x7f00a00d2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.314+0000 7f00ace00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a00df100 0x7f00a00d3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.314+0000 7f00ace00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f00a000aad0 con 0x7f00a00530a0 2024-05-27T10:52:11.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.314+0000 7f00ace00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f00a0054170 con 0x7f00a00df100 2024-05-27T10:52:11.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.314+0000 7f00ace00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f00a000ac50 con 0x7f00a0050180 2024-05-27T10:52:11.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.316+0000 7f00a7400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00a0050180 0x7f00a00ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.316+0000 7f00a7e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a00df100 0x7f00a00d3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.316+0000 7f00a7e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a00df100 0x7f00a00d3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:47828/0 (socket says 172.21.15.47:47828) 2024-05-27T10:52:11.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.316+0000 7f00a7e00640 1 -- 172.21.15.47:0/4166372242 learned_addr learned my addr 172.21.15.47:0/4166372242 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:11.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.317+0000 7f00a6a00640 1 --2- 172.21.15.47:0/4166372242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00a00530a0 0x7f00a00d2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.318+0000 7f00a7e00640 1 -- 172.21.15.47:0/4166372242 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00a0050180 msgr2=0x7f00a00ceaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.318+0000 7f00a7e00640 1 --2- 172.21.15.47:0/4166372242 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00a0050180 0x7f00a00ceaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.318+0000 7f00a7e00640 1 -- 172.21.15.47:0/4166372242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00a00530a0 msgr2=0x7f00a00d2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.318+0000 7f00a7e00640 1 --2- 172.21.15.47:0/4166372242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00a00530a0 0x7f00a00d2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.318+0000 7f00a7e00640 1 -- 172.21.15.47:0/4166372242 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a00d2120 con 0x7f00a00df100 2024-05-27T10:52:11.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.319+0000 7f00a6a00640 1 --2- 172.21.15.47:0/4166372242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00a00530a0 0x7f00a00d2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:11.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.319+0000 7f00a7400640 1 --2- 172.21.15.47:0/4166372242 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00a0050180 0x7f00a00ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:52:11.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.320+0000 7f00a7e00640 1 --2- 172.21.15.47:0/4166372242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a00df100 0x7f00a00d3d50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f00940090b0 tx=0x7f00940046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.320+0000 7f009b400640 1 -- 172.21.15.47:0/4166372242 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0094041020 con 0x7f00a00df100 2024-05-27T10:52:11.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.320+0000 7f009b400640 1 -- 172.21.15.47:0/4166372242 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f009403d640 con 0x7f00a00df100 2024-05-27T10:52:11.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.320+0000 7f009b400640 1 -- 172.21.15.47:0/4166372242 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0094037040 con 0x7f00a00df100 2024-05-27T10:52:11.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.321+0000 7f00ace00640 1 -- 172.21.15.47:0/4166372242 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a00ce010 con 0x7f00a00df100 2024-05-27T10:52:11.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.321+0000 7f00ace00640 1 -- 172.21.15.47:0/4166372242 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a00d3120 con 0x7f00a00df100 2024-05-27T10:52:11.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.322+0000 7f0098c00640 1 -- 172.21.15.47:0/4166372242 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00a00052c0 con 0x7f00a00df100 2024-05-27T10:52:11.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.326+0000 7f009b400640 1 -- 172.21.15.47:0/4166372242 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0094044020 con 0x7f00a00df100 2024-05-27T10:52:11.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.328+0000 7f009b400640 1 --2- 172.21.15.47:0/4166372242 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f008806c920 0x7f008806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.329+0000 7f00a7400640 1 --2- 172.21.15.47:0/4166372242 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f008806c920 0x7f008806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.329+0000 7f009b400640 1 -- 172.21.15.47:0/4166372242 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0094031e50 con 0x7f00a00df100 2024-05-27T10:52:11.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.330+0000 7f00a7400640 1 --2- 172.21.15.47:0/4166372242 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f008806c920 0x7f008806ede0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f009c007fd0 tx=0x7f009c007d60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.338+0000 7f5ed1800640 1 Processor -- start 2024-05-27T10:52:11.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.338+0000 7f5ed1800640 1 -- start start 2024-05-27T10:52:11.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.339+0000 7f5ed1800640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ecc160090 0x7f5ecc160470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.339+0000 7f5ed1800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5ecc0cfed0 0x7f5ecc15ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.340+0000 7f5ed1800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5ecc0d0330 0x7f5ecc15cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.340+0000 7f5ed1800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f5ecc0cdc30 con 0x7f5ecc0d0330 2024-05-27T10:52:11.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.340+0000 7f5ed1800640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f5ecc0ccda0 con 0x7f5ecc160090 2024-05-27T10:52:11.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.340+0000 7f5ed1800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5ecc1609b0 con 0x7f5ecc0cfed0 2024-05-27T10:52:11.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.340+0000 7f5ed0e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5ecc0d0330 0x7f5ecc15cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.340+0000 7f5ed0e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5ecc0d0330 0x7f5ecc15cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34208/0 (socket says 172.21.15.47:34208) 2024-05-27T10:52:11.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.340+0000 7f5ed0e00640 1 -- 172.21.15.47:0/3083807969 learned_addr learned my addr 172.21.15.47:0/3083807969 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:11.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.340+0000 7f5ecb400640 1 --2- 172.21.15.47:0/3083807969 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5ecc0cfed0 0x7f5ecc15ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.340+0000 7f5ecbe00640 1 --2- 172.21.15.47:0/3083807969 >> v2:172.21.15.53:3300/0 conn(0x7f5ecc160090 0x7f5ecc160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.341+0000 7f5ed0e00640 1 -- 172.21.15.47:0/3083807969 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5ecc0cfed0 msgr2=0x7f5ecc15ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:11.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.341+0000 7f5ed0e00640 1 --2- 172.21.15.47:0/3083807969 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5ecc0cfed0 0x7f5ecc15ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.341+0000 7f5ed0e00640 1 -- 172.21.15.47:0/3083807969 >> v2:172.21.15.53:3300/0 conn(0x7f5ecc160090 msgr2=0x7f5ecc160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:11.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.341+0000 7f5ed0e00640 1 --2- 172.21.15.47:0/3083807969 >> v2:172.21.15.53:3300/0 conn(0x7f5ecc160090 0x7f5ecc160470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.341+0000 7f5ed0e00640 1 -- 172.21.15.47:0/3083807969 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ecc0cd020 con 0x7f5ecc0d0330 2024-05-27T10:52:11.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.342+0000 7f5ed0e00640 1 --2- 172.21.15.47:0/3083807969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ecc0d0330 0x7f5ecc15cfa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc06fb80 tx=0x7f5ec40331f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bddca08c47f11e0e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.343+0000 7f5ecaa00640 1 -- 172.21.15.47:0/3083807969 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec40110d0 con 0x7f5ecc0d0330 2024-05-27T10:52:11.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.343+0000 7f5ecaa00640 1 -- 172.21.15.47:0/3083807969 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec4011270 con 0x7f5ecc0d0330 2024-05-27T10:52:11.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.343+0000 7f5ecaa00640 1 -- 172.21.15.47:0/3083807969 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4011680 con 0x7f5ecc0d0330 2024-05-27T10:52:11.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.343+0000 7f5ed1800640 1 -- 172.21.15.47:0/3083807969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ecc0d0330 msgr2=0x7f5ecc15cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.343+0000 7f5ed1800640 1 --2- 172.21.15.47:0/3083807969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ecc0d0330 0x7f5ecc15cfa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc06fb80 tx=0x7f5ec40331f0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.344+0000 7f5ed1800640 1 -- 172.21.15.47:0/3083807969 shutdown_connections 2024-05-27T10:52:11.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.344+0000 7f5ed1800640 1 --2- 172.21.15.47:0/3083807969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ecc0d0330 0x7f5ecc15cfa0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.344+0000 7f5ed1800640 1 --2- 172.21.15.47:0/3083807969 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5ecc0cfed0 0x7f5ecc15ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.344+0000 7f5ed1800640 1 --2- 172.21.15.47:0/3083807969 >> v2:172.21.15.53:3300/0 conn(0x7f5ecc160090 0x7f5ecc160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.344+0000 7f5ed1800640 1 -- 172.21.15.47:0/3083807969 >> 172.21.15.47:0/3083807969 conn(0x7f5ecc0b3df0 msgr2=0x7f5ecc0b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:11.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.344+0000 7f5ed1800640 1 -- 172.21.15.47:0/3083807969 shutdown_connections 2024-05-27T10:52:11.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.345+0000 7f009b400640 1 -- 172.21.15.47:0/4166372242 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f009404b030 con 0x7f00a00df100 2024-05-27T10:52:11.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.347+0000 7fbe4f000640 1 Processor -- start 2024-05-27T10:52:11.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.347+0000 7fbe4f000640 1 -- start start 2024-05-27T10:52:11.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.345+0000 7f5ed1800640 1 -- 172.21.15.47:0/3083807969 wait complete. 2024-05-27T10:52:11.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.347+0000 7f5ed1800640 1 Processor -- start 2024-05-27T10:52:11.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.348+0000 7fbbe4a00640 1 Processor -- start 2024-05-27T10:52:11.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.348+0000 7f5ed1800640 1 -- start start 2024-05-27T10:52:11.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.348+0000 7fbbe4a00640 1 -- start start 2024-05-27T10:52:11.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.349+0000 7f5ed1800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ecc0cfed0 0x7f5ecc0b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.349+0000 7f5ed1800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ecc0d0330 0x7f5ecc15f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.349+0000 7f5ed1800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5ecc160090 0x7f5ecc06fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.349+0000 7f5ed1800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc0cd8c0 con 0x7f5ecc0cfed0 2024-05-27T10:52:11.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.349+0000 7f5ed1800640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc0cd5e0 con 0x7f5ecc0d0330 2024-05-27T10:52:11.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.349+0000 7f5ed1800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5ecc0ce0c0 con 0x7f5ecc160090 2024-05-27T10:52:11.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.350+0000 7f5ecbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ecc0cfed0 0x7f5ecc0b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.350+0000 7f5ecbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ecc0cfed0 0x7f5ecc0b58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34212/0 (socket says 172.21.15.47:34212) 2024-05-27T10:52:11.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.350+0000 7f5ecbe00640 1 -- 172.21.15.47:0/1801821857 learned_addr learned my addr 172.21.15.47:0/1801821857 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:11.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.350+0000 7f5ecb400640 1 --2- 172.21.15.47:0/1801821857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ecc0d0330 0x7f5ecc15f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.350+0000 7fbbe4a00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbbe0161df0 0x7fbbe00b1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.350+0000 7fbbe4a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbbe00b69a0 0x7fbbe00cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.350+0000 7fbbe4a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbe01621d0 con 0x7fbbe00cecc0 2024-05-27T10:52:11.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.350+0000 7fbbe4a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fbbe00d20d0 con 0x7fbbe00b69a0 2024-05-27T10:52:11.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.350+0000 7fbbe4a00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fbbe00d2370 con 0x7fbbe0161df0 2024-05-27T10:52:11.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.351+0000 7fbbde800640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbbe0161df0 0x7fbbe00b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.351+0000 7fbbde800640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbbe0161df0 0x7fbbe00b1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:47848/0 (socket says 172.21.15.47:47848) 2024-05-27T10:52:11.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.351+0000 7fbbde800640 1 -- 172.21.15.47:0/3645962037 learned_addr learned my addr 172.21.15.47:0/3645962037 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:11.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.351+0000 7f5ecbe00640 1 -- 172.21.15.47:0/1801821857 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5ecc160090 msgr2=0x7f5ecc06fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.350+0000 7f5ed0e00640 1 --2- 172.21.15.47:0/1801821857 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5ecc160090 0x7f5ecc06fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.351+0000 7fbbdde00640 1 --2- 172.21.15.47:0/3645962037 >> v2:172.21.15.47:3300/0 conn(0x7fbbe00b69a0 0x7fbbe00cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.352+0000 7fbbdd400640 1 -- 172.21.15.47:0/3645962037 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2451056681 0 0) 0x7fbbe01621d0 con 0x7fbbe00cecc0 2024-05-27T10:52:11.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.352+0000 7f5ecbe00640 1 --2- 172.21.15.47:0/1801821857 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5ecc160090 0x7f5ecc06fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.352+0000 7fbbdd400640 1 -- 172.21.15.47:0/3645962037 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbc4003520 con 0x7fbbe00cecc0 2024-05-27T10:52:11.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.352+0000 7fbbdd400640 1 -- 172.21.15.47:0/3645962037 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2902344125 0 0) 0x7fbbc4003520 con 0x7fbbe00cecc0 2024-05-27T10:52:11.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.352+0000 7fbbdd400640 1 -- 172.21.15.47:0/3645962037 >> v2:172.21.15.53:3300/0 conn(0x7fbbe0161df0 msgr2=0x7fbbe00b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:11.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.352+0000 7fbbdd400640 1 --2- 172.21.15.47:0/3645962037 >> v2:172.21.15.53:3300/0 conn(0x7fbbe0161df0 0x7fbbe00b1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.352+0000 7fbbdd400640 1 -- 172.21.15.47:0/3645962037 >> v2:172.21.15.47:3300/0 conn(0x7fbbe00b69a0 msgr2=0x7fbbe00cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.352+0000 7fbbdd400640 1 --2- 172.21.15.47:0/3645962037 >> v2:172.21.15.47:3300/0 conn(0x7fbbe00b69a0 0x7fbbe00cf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.352+0000 7fbbdd400640 1 -- 172.21.15.47:0/3645962037 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe00d2650 con 0x7fbbe00cecc0 2024-05-27T10:52:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.352+0000 7f5ecbe00640 1 -- 172.21.15.47:0/1801821857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ecc0d0330 msgr2=0x7f5ecc15f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.352+0000 7f5ecbe00640 1 --2- 172.21.15.47:0/1801821857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ecc0d0330 0x7f5ecc15f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.352+0000 7f5ecbe00640 1 -- 172.21.15.47:0/1801821857 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ecc0b6b10 con 0x7f5ecc0cfed0 2024-05-27T10:52:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.353+0000 7f5ecbe00640 1 --2- 172.21.15.47:0/1801821857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ecc0cfed0 0x7f5ecc0b58f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc00c7f0 tx=0x7f5ebc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.353+0000 7f5ed0e00640 1 --2- 172.21.15.47:0/1801821857 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5ecc160090 0x7f5ecc06fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:11.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.353+0000 7f5ecb400640 1 --2- 172.21.15.47:0/1801821857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ecc0d0330 0x7f5ecc15f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T10:52:11.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.352+0000 7fbbdd400640 1 -- 172.21.15.47:0/3645962037 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7fbbcc001650 con 0x7fbbe00cecc0 2024-05-27T10:52:11.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.353+0000 7fbbdd400640 1 -- 172.21.15.47:0/3645962037 >> v1:172.21.15.47:6789/0 conn(0x7fbbe00cecc0 legacy=0x7fbbe00d3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.353+0000 7fbbdd400640 1 --2- 172.21.15.47:0/3645962037 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbc4003a20 0x7fbbc4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.353+0000 7fbbdd400640 1 --2- 172.21.15.47:0/3645962037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc4004800 0x7fbbc4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.353+0000 7fbbdd400640 1 --2- 172.21.15.47:0/3645962037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbc40051c0 0x7fbbc400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.353+0000 7fbbdd400640 1 -- 172.21.15.47:0/3645962037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe00d20d0 con 0x7fbbc4004800 2024-05-27T10:52:11.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.353+0000 7fbbdd400640 1 -- 172.21.15.47:0/3645962037 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe00d2370 con 0x7fbbc40051c0 2024-05-27T10:52:11.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.353+0000 7fbbdd400640 1 -- 172.21.15.47:0/3645962037 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc4014a10 con 0x7fbbc4003a20 2024-05-27T10:52:11.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.354+0000 7fbbdf200640 1 --2- 172.21.15.47:0/3645962037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbc40051c0 0x7fbbc400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.350+0000 7fbe4f000640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbe480b5fd0 0x7fbe480cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.353+0000 7fbe4f000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbe480b63b0 0x7fbe4815f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.353+0000 7fbe4f000640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe480ceba0 con 0x7fbe480d4c60 2024-05-27T10:52:11.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.353+0000 7fbe4f000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fbe480cf790 con 0x7fbe480b63b0 2024-05-27T10:52:11.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.353+0000 7fbe4f000640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fbe4815fd00 con 0x7fbe480b5fd0 2024-05-27T10:52:11.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.353+0000 7fbe4dc00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbe480b5fd0 0x7fbe480cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.353+0000 7fbe4dc00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbe480b5fd0 0x7fbe480cfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:47860/0 (socket says 172.21.15.47:47860) 2024-05-27T10:52:11.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.353+0000 7fbe4dc00640 1 -- 172.21.15.47:0/646414455 learned_addr learned my addr 172.21.15.47:0/646414455 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:11.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.354+0000 7fbe4d200640 1 --2- 172.21.15.47:0/646414455 >> v2:172.21.15.47:3300/0 conn(0x7fbe480b63b0 0x7fbe4815f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.354+0000 7f5ec3e00640 1 -- 172.21.15.47:0/1801821857 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc015070 con 0x7f5ecc0cfed0 2024-05-27T10:52:11.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.354+0000 7f5ec3e00640 1 -- 172.21.15.47:0/1801821857 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ebc004220 con 0x7f5ecc0cfed0 2024-05-27T10:52:11.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.354+0000 7f5ec3e00640 1 -- 172.21.15.47:0/1801821857 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc007620 con 0x7f5ecc0cfed0 2024-05-27T10:52:11.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.354+0000 7f5ed1800640 1 -- 172.21.15.47:0/1801821857 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ecc0b6df0 con 0x7f5ecc0cfed0 2024-05-27T10:52:11.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.354+0000 7f5ed1800640 1 -- 172.21.15.47:0/1801821857 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ecc0b73b0 con 0x7f5ecc0cfed0 2024-05-27T10:52:11.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.355+0000 7fbbdf200640 1 -- 172.21.15.47:0/3645962037 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbc4003a20 msgr2=0x7fbbc4003e60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-27T10:52:11.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.354+0000 7fbe4dc00640 1 -- 172.21.15.47:0/646414455 >> v2:172.21.15.47:3300/0 conn(0x7fbe480b63b0 msgr2=0x7fbe4815f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:11.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.354+0000 7fbe4dc00640 1 --2- 172.21.15.47:0/646414455 >> v2:172.21.15.47:3300/0 conn(0x7fbe480b63b0 0x7fbe4815f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.355+0000 7fbe4dc00640 1 -- 172.21.15.47:0/646414455 >> v1:172.21.15.53:6789/0 conn(0x7fbe480d4c60 legacy=0x7fbe480d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:11.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.355+0000 7fbe4dc00640 1 -- 172.21.15.47:0/646414455 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe480cee60 con 0x7fbe480b5fd0 2024-05-27T10:52:11.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.357+0000 7fbbde800640 1 --2- 172.21.15.47:0/3645962037 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbc4003a20 0x7fbbc4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.357+0000 7fbbdf200640 1 --2- 172.21.15.47:0/3645962037 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbc4003a20 0x7fbbc4003e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.357+0000 7fbbdde00640 1 --2- 172.21.15.47:0/3645962037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc4004800 0x7fbbc4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.357+0000 7fbbdf200640 1 -- 172.21.15.47:0/3645962037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc4004800 msgr2=0x7fbbc4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:11.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.357+0000 7fbbdf200640 1 --2- 172.21.15.47:0/3645962037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc4004800 0x7fbbc4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.357+0000 7fbbdf200640 1 -- 172.21.15.47:0/3645962037 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc4003520 con 0x7fbbc40051c0 2024-05-27T10:52:11.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.357+0000 7fbbdde00640 1 --2- 172.21.15.47:0/3645962037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc4004800 0x7fbbc4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:11.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.357+0000 7fbe4dc00640 1 --2- 172.21.15.47:0/646414455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe480b5fd0 0x7fbe480cfc20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe480d0f30 tx=0x7fbe3402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=786b7078c99e31be server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.358+0000 7fbbdf200640 1 -- 172.21.15.47:0/3645962037 reap_dead start 2024-05-27T10:52:11.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.358+0000 7fbe47e00640 1 -- 172.21.15.47:0/646414455 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe34037070 con 0x7fbe480b5fd0 2024-05-27T10:52:11.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.359+0000 7fbe47e00640 1 -- 172.21.15.47:0/646414455 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe34032440 con 0x7fbe480b5fd0 2024-05-27T10:52:11.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.359+0000 7fbbdf200640 1 --2- 172.21.15.47:0/3645962037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbc40051c0 0x7fbbc400b9c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc001eb0 tx=0x7fbbc4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fed206b522533b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.359+0000 7fbe47e00640 1 -- 172.21.15.47:0/646414455 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe34037070 con 0x7fbe480b5fd0 2024-05-27T10:52:11.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.360+0000 7f5ed1800640 1 -- 172.21.15.47:0/1801821857 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ecc04fce0 con 0x7f5ecc0cfed0 2024-05-27T10:52:11.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.360+0000 7fbbdd400640 1 -- 172.21.15.47:0/3645962037 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc007b30 con 0x7fbbc40051c0 2024-05-27T10:52:11.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.361+0000 7f5ec3e00640 1 -- 172.21.15.47:0/1801821857 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5ebc0077c0 con 0x7f5ecc0cfed0 2024-05-27T10:52:11.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.360+0000 7fbbdd400640 1 -- 172.21.15.47:0/3645962037 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbcc005290 con 0x7fbbc40051c0 2024-05-27T10:52:11.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.360+0000 7fbbdd400640 1 -- 172.21.15.47:0/3645962037 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc003830 con 0x7fbbc40051c0 2024-05-27T10:52:11.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.361+0000 7fbbe4a00640 1 -- 172.21.15.47:0/3645962037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbc40051c0 msgr2=0x7fbbc400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.361+0000 7fbbe4a00640 1 --2- 172.21.15.47:0/3645962037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbc40051c0 0x7fbbc400b9c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc001eb0 tx=0x7fbbc4005830 comp rx=0 tx=0).stop 2024-05-27T10:52:11.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.362+0000 7fbbe4a00640 1 -- 172.21.15.47:0/3645962037 shutdown_connections 2024-05-27T10:52:11.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.362+0000 7fbbe4a00640 1 --2- 172.21.15.47:0/3645962037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbc40051c0 0x7fbbc400b9c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.362+0000 7fbbe4a00640 1 -- 172.21.15.47:0/3645962037 >> 172.21.15.47:0/3645962037 conn(0x7fbbe008bfd0 msgr2=0x7fbbe00d44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:11.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.363+0000 7f5ec3e00640 1 --2- 172.21.15.47:0/1801821857 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5eac06c940 0x7f5eac06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.360+0000 7fbe4f000640 1 -- 172.21.15.47:0/646414455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe480b5fd0 msgr2=0x7fbe480cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.360+0000 7fbe4f000640 1 --2- 172.21.15.47:0/646414455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe480b5fd0 0x7fbe480cfc20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe480d0f30 tx=0x7fbe3402a230 comp rx=0 tx=0).stop 2024-05-27T10:52:11.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.360+0000 7fbe4f000640 1 -- 172.21.15.47:0/646414455 shutdown_connections 2024-05-27T10:52:11.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.360+0000 7fbe4f000640 1 --2- 172.21.15.47:0/646414455 >> v2:172.21.15.47:3300/0 conn(0x7fbe480b63b0 0x7fbe4815f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.360+0000 7fbe4f000640 1 --2- 172.21.15.47:0/646414455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe480b5fd0 0x7fbe480cfc20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.360+0000 7fbe4f000640 1 -- 172.21.15.47:0/646414455 >> 172.21.15.47:0/646414455 conn(0x7fbe4808bfd0 msgr2=0x7fbe480d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:11.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.360+0000 7fbe4f000640 1 -- 172.21.15.47:0/646414455 shutdown_connections 2024-05-27T10:52:11.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.360+0000 7fbe4f000640 1 -- 172.21.15.47:0/646414455 wait complete. 2024-05-27T10:52:11.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.363+0000 7fbe4f000640 1 Processor -- start 2024-05-27T10:52:11.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.364+0000 7fbe4f000640 1 -- start start 2024-05-27T10:52:11.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.365+0000 7fbbe4a00640 1 -- 172.21.15.47:0/3645962037 shutdown_connections 2024-05-27T10:52:11.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.366+0000 7fbe4f000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbe480b5fd0 0x7fbe480b81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.366+0000 7fbe4f000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe480b63b0 0x7fbe48153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.366+0000 7fbe4f000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe480d4c60 0x7fbe480c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.365+0000 7fbbe4a00640 1 -- 172.21.15.47:0/3645962037 wait complete. 2024-05-27T10:52:11.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.367+0000 7f5ecb400640 1 --2- 172.21.15.47:0/1801821857 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5eac06c940 0x7f5eac06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.367+0000 7f5ec3e00640 1 -- 172.21.15.47:0/1801821857 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5ebc057760 con 0x7f5ecc0cfed0 2024-05-27T10:52:11.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.367+0000 7fbe4f000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbe480b67f0 con 0x7fbe480b63b0 2024-05-27T10:52:11.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.367+0000 7fbe4f000640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbe480cf420 con 0x7fbe480d4c60 2024-05-27T10:52:11.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.367+0000 7fbe4f000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbe480b87a0 con 0x7fbe480b5fd0 2024-05-27T10:52:11.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.367+0000 7fbe4e600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe480d4c60 0x7fbe480c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.368+0000 7fbbe4a00640 1 Processor -- start 2024-05-27T10:52:11.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.368+0000 7fbe4e600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe480d4c60 0x7fbe480c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:47880/0 (socket says 172.21.15.47:47880) 2024-05-27T10:52:11.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.368+0000 7fbbe4a00640 1 -- start start 2024-05-27T10:52:11.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.368+0000 7fbe4e600640 1 -- 172.21.15.47:0/2738011250 learned_addr learned my addr 172.21.15.47:0/2738011250 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:11.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.369+0000 7f5ecb400640 1 --2- 172.21.15.47:0/1801821857 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5eac06c940 0x7f5eac06ee00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc0c8b80 tx=0x7f5eb8009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.368+0000 7fbe4dc00640 1 --2- 172.21.15.47:0/2738011250 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbe480b5fd0 0x7fbe480b81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.369+0000 7fbe4e600640 1 -- 172.21.15.47:0/2738011250 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbe480b5fd0 msgr2=0x7fbe480b81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.369+0000 7fbe4e600640 1 --2- 172.21.15.47:0/2738011250 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbe480b5fd0 0x7fbe480b81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.369+0000 7fbe4e600640 1 -- 172.21.15.47:0/2738011250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe480b63b0 msgr2=0x7fbe48153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.369+0000 7fbe4e600640 1 --2- 172.21.15.47:0/2738011250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe480b63b0 0x7fbe48153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.369+0000 7fbe4e600640 1 -- 172.21.15.47:0/2738011250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe480b8a80 con 0x7fbe480d4c60 2024-05-27T10:52:11.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.369+0000 7fbe4e600640 1 --2- 172.21.15.47:0/2738011250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe480d4c60 0x7fbe480c9c70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000b970 tx=0x7fbe4000be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.370+0000 7fbe45600640 1 -- 172.21.15.47:0/2738011250 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe40019070 con 0x7fbe480d4c60 2024-05-27T10:52:11.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.370+0000 7fbe45600640 1 -- 172.21.15.47:0/2738011250 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe4000cb40 con 0x7fbe480d4c60 2024-05-27T10:52:11.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.370+0000 7fbe45600640 1 -- 172.21.15.47:0/2738011250 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe40014440 con 0x7fbe480d4c60 2024-05-27T10:52:11.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.370+0000 7fbe4f000640 1 -- 172.21.15.47:0/2738011250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe480b8d60 con 0x7fbe480d4c60 2024-05-27T10:52:11.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.370+0000 7fbe4f000640 1 -- 172.21.15.47:0/2738011250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe480b9320 con 0x7fbe480d4c60 2024-05-27T10:52:11.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.372+0000 7fbbe4a00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbc40051c0 0x7fbbe015d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.372+0000 7fbbe4a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbe015de30 0x7fbbe015fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.372+0000 7fbbe4a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbe015d800 0x7fbbe006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.373+0000 7fbbe4a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe00b1140 con 0x7fbbe015de30 2024-05-27T10:52:11.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.373+0000 7fbbde800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbc40051c0 0x7fbbe015d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.373+0000 7fbbe4a00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe00d2c10 con 0x7fbbc40051c0 2024-05-27T10:52:11.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.373+0000 7fbbe4a00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbbe00b12c0 con 0x7fbbe015d800 2024-05-27T10:52:11.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.374+0000 7fbbde800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbc40051c0 0x7fbbe015d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:47888/0 (socket says 172.21.15.47:47888) 2024-05-27T10:52:11.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.374+0000 7fbbdf200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbe015d800 0x7fbbe006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.374+0000 7fbbdf200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbe015d800 0x7fbbe006ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:51864/0 (socket says 172.21.15.47:51864) 2024-05-27T10:52:11.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.374+0000 7fbbdf200640 1 -- 172.21.15.47:0/3411405558 learned_addr learned my addr 172.21.15.47:0/3411405558 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:11.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.374+0000 7fbbdde00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbe015de30 0x7fbbe015fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.376+0000 7f5ec3e00640 1 -- 172.21.15.47:0/1801821857 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5ebc0596c0 con 0x7f5ecc0cfed0 2024-05-27T10:52:11.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.376+0000 7fbbde800640 1 -- 172.21.15.47:0/3411405558 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbe015d800 msgr2=0x7fbbe006ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.376+0000 7fbbde800640 1 --2- 172.21.15.47:0/3411405558 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbe015d800 0x7fbbe006ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.376+0000 7fbbde800640 1 -- 172.21.15.47:0/3411405558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbe015de30 msgr2=0x7fbbe015fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.376+0000 7fbbde800640 1 --2- 172.21.15.47:0/3411405558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbe015de30 0x7fbbe015fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.376+0000 7fbbde800640 1 -- 172.21.15.47:0/3411405558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe01600c0 con 0x7fbbc40051c0 2024-05-27T10:52:11.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.376+0000 7fbbdde00640 1 --2- 172.21.15.47:0/3411405558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbe015de30 0x7fbbe015fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:52:11.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.375+0000 7fbe45600640 1 -- 172.21.15.47:0/2738011250 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbe4001c070 con 0x7fbe480d4c60 2024-05-27T10:52:11.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.375+0000 7fbe4f000640 1 -- 172.21.15.47:0/2738011250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe24005290 con 0x7fbe480d4c60 2024-05-27T10:52:11.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.376+0000 7fbe45600640 1 --2- 172.21.15.47:0/2738011250 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbe2806c8f0 0x7fbe2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.376+0000 7fbe45600640 1 -- 172.21.15.47:0/2738011250 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbe4008b810 con 0x7fbe480d4c60 2024-05-27T10:52:11.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.377+0000 7fbbdf200640 1 --2- 172.21.15.47:0/3411405558 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbe015d800 0x7fbbe006ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:52:11.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.377+0000 7fbe4dc00640 1 --2- 172.21.15.47:0/2738011250 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbe2806c8f0 0x7fbe2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.377+0000 7fbbde800640 1 --2- 172.21.15.47:0/3411405558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbc40051c0 0x7fbbe015d0f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0010860 tx=0x7fbbd0010d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.379+0000 7fbe4dc00640 1 --2- 172.21.15.47:0/2738011250 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbe2806c8f0 0x7fbe2806edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbe34034000 tx=0x7fbe3402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.389+0000 7fbbd6a00640 1 -- 172.21.15.47:0/3411405558 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0018070 con 0x7fbbc40051c0 2024-05-27T10:52:11.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.390+0000 7fbbe4a00640 1 -- 172.21.15.47:0/3411405558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe015eae0 con 0x7fbbc40051c0 2024-05-27T10:52:11.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.390+0000 7fbbe4a00640 1 -- 172.21.15.47:0/3411405558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe015f0a0 con 0x7fbbc40051c0 2024-05-27T10:52:11.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.390+0000 7fbe45600640 1 -- 172.21.15.47:0/2738011250 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbe40059ba0 con 0x7fbe480d4c60 2024-05-27T10:52:11.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.390+0000 7fbbd6a00640 1 -- 172.21.15.47:0/3411405558 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd0004440 con 0x7fbbc40051c0 2024-05-27T10:52:11.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.390+0000 7fbbd6a00640 1 -- 172.21.15.47:0/3411405558 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0018070 con 0x7fbbc40051c0 2024-05-27T10:52:11.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.392+0000 7fbbcbe00640 1 -- 172.21.15.47:0/3411405558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbb4005290 con 0x7fbbc40051c0 2024-05-27T10:52:11.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.394+0000 7fbbd6a00640 1 -- 172.21.15.47:0/3411405558 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbbd001b070 con 0x7fbbc40051c0 2024-05-27T10:52:11.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.396+0000 7fbbd6a00640 1 --2- 172.21.15.47:0/3411405558 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbbc006caf0 0x7fbbc006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.396+0000 7fbbd6a00640 1 -- 172.21.15.47:0/3411405558 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbbd008b810 con 0x7fbbc40051c0 2024-05-27T10:52:11.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.397+0000 7fbbdde00640 1 --2- 172.21.15.47:0/3411405558 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbbc006caf0 0x7fbbc006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.399+0000 7fbbdde00640 1 --2- 172.21.15.47:0/3411405558 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbbc006caf0 0x7fbbc006efb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbbe015e250 tx=0x7fbbd8007670 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.409+0000 7fbbd6a00640 1 -- 172.21.15.47:0/3411405558 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbbd0059cd0 con 0x7fbbc40051c0 2024-05-27T10:52:11.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.409+0000 7f4e61400640 1 Processor -- start 2024-05-27T10:52:11.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.409+0000 7f4e61400640 1 -- start start 2024-05-27T10:52:11.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.411+0000 7f4e61400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4e540e3040 0x7f4e5403c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.412+0000 7f4e61400640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4e540e3420 0x7f4e540e78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.412+0000 7f4e61400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4e54058130 0x7f4e54053d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.412+0000 7f4e5be00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4e540e3040 0x7f4e5403c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.413+0000 7f4e5be00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4e540e3040 0x7f4e5403c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:51872/0 (socket says 172.21.15.47:51872) 2024-05-27T10:52:11.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.413+0000 7f4e5b400640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4e540e3420 0x7f4e540e78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.413+0000 7f4e5b400640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4e540e3420 0x7f4e540e78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:47896/0 (socket says 172.21.15.47:47896) 2024-05-27T10:52:11.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.414+0000 7f4e61400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f4e54006860 con 0x7f4e54058130 2024-05-27T10:52:11.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.414+0000 7f4e5be00640 1 -- 172.21.15.47:0/3082971766 learned_addr learned my addr 172.21.15.47:0/3082971766 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:11.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.414+0000 7f3f09a00640 1 Processor -- start 2024-05-27T10:52:11.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.414+0000 7f4e61400640 1 -- 172.21.15.47:0/3082971766 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f4e54058980 con 0x7f4e540e3420 2024-05-27T10:52:11.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.414+0000 7f4e61400640 1 -- 172.21.15.47:0/3082971766 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f4e54058c60 con 0x7f4e540e3040 2024-05-27T10:52:11.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.414+0000 7f3f09a00640 1 -- start start 2024-05-27T10:52:11.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.414+0000 7f4e60a00640 1 --2- 172.21.15.47:0/3082971766 >> v2:172.21.15.47:3300/0 conn(0x7f4e54058130 0x7f4e54053d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.416+0000 7f3f09a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0415e870 0x7f3f04162560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.416+0000 7f3f09a00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3f040b6970 0x7f3f040d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.415+0000 7f4e5b400640 1 -- 172.21.15.47:0/3082971766 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4e540e3040 msgr2=0x7f4e5403c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.415+0000 7f4e5b400640 1 --2- 172.21.15.47:0/3082971766 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4e540e3040 0x7f4e5403c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.415+0000 7f4e5b400640 1 -- 172.21.15.47:0/3082971766 >> v2:172.21.15.47:3300/0 conn(0x7f4e54058130 msgr2=0x7f4e54053d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.415+0000 7f4e5b400640 1 --2- 172.21.15.47:0/3082971766 >> v2:172.21.15.47:3300/0 conn(0x7f4e54058130 0x7f4e54053d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.415+0000 7f4e5b400640 1 -- 172.21.15.47:0/3082971766 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e54006210 con 0x7f4e540e3420 2024-05-27T10:52:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.417+0000 7f4e60a00640 1 --2- 172.21.15.47:0/3082971766 >> v2:172.21.15.47:3300/0 conn(0x7f4e54058130 0x7f4e54053d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:52:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.417+0000 7f3f09a00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f04162b40 con 0x7f3f0415ec50 2024-05-27T10:52:11.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.417+0000 7f3f09a00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f3f040b6dd0 con 0x7f3f040b6970 2024-05-27T10:52:11.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.417+0000 7f3f09a00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3f04162e20 con 0x7f3f0415e870 2024-05-27T10:52:11.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.417+0000 7f4e5b400640 1 --2- 172.21.15.47:0/3082971766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e540e3420 0x7f4e540e78d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4e54008540 tx=0x7f4e4802a0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c29c2ec12d159ee6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.417+0000 7f3f02a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0415e870 0x7f3f04162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.417+0000 7f3f02a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0415e870 0x7f3f04162560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:51876/0 (socket says 172.21.15.47:51876) 2024-05-27T10:52:11.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.417+0000 7f3f02a00640 1 -- 172.21.15.47:0/3207099281 learned_addr learned my addr 172.21.15.47:0/3207099281 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:11.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.418+0000 7f3f03400640 1 --2- 172.21.15.47:0/3207099281 >> v2:172.21.15.53:3300/0 conn(0x7f3f040b6970 0x7f3f040d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.419+0000 7f4e5aa00640 1 -- 172.21.15.47:0/3082971766 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e48037070 con 0x7f4e540e3420 2024-05-27T10:52:11.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.419+0000 7f4e5aa00640 1 -- 172.21.15.47:0/3082971766 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e4802ae00 con 0x7f4e540e3420 2024-05-27T10:52:11.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.420+0000 7f4e5aa00640 1 -- 172.21.15.47:0/3082971766 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e48032660 con 0x7f4e540e3420 2024-05-27T10:52:11.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.420+0000 7ff2fd200640 1 Processor -- start 2024-05-27T10:52:11.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.419+0000 7f3f02a00640 1 -- 172.21.15.47:0/3207099281 >> v2:172.21.15.53:3300/0 conn(0x7f3f040b6970 msgr2=0x7f3f040d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:11.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.419+0000 7f3f02a00640 1 --2- 172.21.15.47:0/3207099281 >> v2:172.21.15.53:3300/0 conn(0x7f3f040b6970 0x7f3f040d0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.419+0000 7f3f02a00640 1 -- 172.21.15.47:0/3207099281 >> v1:172.21.15.53:6789/0 conn(0x7f3f0415ec50 legacy=0x7f3f040ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.419+0000 7f3f02a00640 1 -- 172.21.15.47:0/3207099281 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f04163100 con 0x7f3f0415e870 2024-05-27T10:52:11.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.420+0000 7ff2fd200640 1 -- start start 2024-05-27T10:52:11.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.421+0000 7f3f02a00640 1 --2- 172.21.15.47:0/3207099281 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0415e870 0x7f3f04162560 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009870 tx=0x7f3eec02a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=867e1534e54e542c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.421+0000 7f3f01600640 1 -- 172.21.15.47:0/3207099281 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eec037070 con 0x7f3f0415e870 2024-05-27T10:52:11.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.421+0000 7f4e61400640 1 -- 172.21.15.47:0/3082971766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e540e3420 msgr2=0x7f4e540e78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.421+0000 7f4e61400640 1 --2- 172.21.15.47:0/3082971766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e540e3420 0x7f4e540e78d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4e54008540 tx=0x7f4e4802a0b0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.421+0000 7f3f01600640 1 -- 172.21.15.47:0/3207099281 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eec032440 con 0x7f3f0415e870 2024-05-27T10:52:11.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.421+0000 7f4e61400640 1 -- 172.21.15.47:0/3082971766 shutdown_connections 2024-05-27T10:52:11.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.421+0000 7f4e61400640 1 --2- 172.21.15.47:0/3082971766 >> v2:172.21.15.47:3300/0 conn(0x7f4e54058130 0x7f4e54053d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.421+0000 7f4e61400640 1 --2- 172.21.15.47:0/3082971766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e540e3420 0x7f4e540e78d0 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4e54008540 tx=0x7f4e4802a0b0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.421+0000 7f4e61400640 1 --2- 172.21.15.47:0/3082971766 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4e540e3040 0x7f4e5403c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.421+0000 7f4e61400640 1 -- 172.21.15.47:0/3082971766 >> 172.21.15.47:0/3082971766 conn(0x7f4e5403aa40 msgr2=0x7f4e5403ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:11.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.422+0000 7f3f09a00640 1 -- 172.21.15.47:0/3207099281 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0415e870 msgr2=0x7f3f04162560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.422+0000 7f3f09a00640 1 --2- 172.21.15.47:0/3207099281 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0415e870 0x7f3f04162560 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009870 tx=0x7f3eec02a1e0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.422+0000 7ff2fd200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff2f0009da0 0x7ff2f00e2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.422+0000 7ff2fd200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff2f00e3490 0x7ff2f00e3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.422+0000 7ff2fd200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2f0051e80 con 0x7ff2f0051690 2024-05-27T10:52:11.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.422+0000 7ff2fd200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff2f0052160 con 0x7ff2f00e3490 2024-05-27T10:52:11.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.422+0000 7ff2fd200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f00e2c90 con 0x7ff2f0009da0 2024-05-27T10:52:11.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.423+0000 7f3f09a00640 1 -- 172.21.15.47:0/3207099281 shutdown_connections 2024-05-27T10:52:11.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.423+0000 7f3f09a00640 1 --2- 172.21.15.47:0/3207099281 >> v2:172.21.15.53:3300/0 conn(0x7f3f040b6970 0x7f3f040d0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.423+0000 7f3f09a00640 1 --2- 172.21.15.47:0/3207099281 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0415e870 0x7f3f04162560 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.423+0000 7f3f09a00640 1 -- 172.21.15.47:0/3207099281 >> 172.21.15.47:0/3207099281 conn(0x7f3f0409d870 msgr2=0x7f3f0408bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:11.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.423+0000 7f4e61400640 1 -- 172.21.15.47:0/3082971766 shutdown_connections 2024-05-27T10:52:11.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.423+0000 7f4e61400640 1 -- 172.21.15.47:0/3082971766 wait complete. 2024-05-27T10:52:11.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.423+0000 7ff2f6a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff2f0051690 0x7ff2f000a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60322/0 (socket says 172.21.15.47:60322) 2024-05-27T10:52:11.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.423+0000 7ff2f6a00640 1 -- 172.21.15.47:0/1299132450 learned_addr learned my addr 172.21.15.47:0/1299132450 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:11.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.423+0000 7ff2f7e00640 1 --2- 172.21.15.47:0/1299132450 >> v2:172.21.15.47:3300/0 conn(0x7ff2f00e3490 0x7ff2f00e3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.424+0000 7f3f09a00640 1 -- 172.21.15.47:0/3207099281 shutdown_connections 2024-05-27T10:52:11.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.424+0000 7ff2f7400640 1 --2- 172.21.15.47:0/1299132450 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff2f0009da0 0x7ff2f00e2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.424+0000 7ff2f6000640 1 -- 172.21.15.47:0/1299132450 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1492937274 0 0) 0x7ff2f0051e80 con 0x7ff2f0051690 2024-05-27T10:52:11.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.424+0000 7ff2f7e00640 1 -- 172.21.15.47:0/1299132450 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff2f0009da0 msgr2=0x7ff2f00e2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:11.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.424+0000 7ff2f7e00640 1 --2- 172.21.15.47:0/1299132450 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff2f0009da0 0x7ff2f00e2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.424+0000 7ff2f7e00640 1 -- 172.21.15.47:0/1299132450 >> v1:172.21.15.47:6789/0 conn(0x7ff2f0051690 legacy=0x7ff2f000a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.424+0000 7ff2f7e00640 1 -- 172.21.15.47:0/1299132450 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f00e2f70 con 0x7ff2f00e3490 2024-05-27T10:52:11.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.424+0000 7f3f09a00640 1 -- 172.21.15.47:0/3207099281 wait complete. 2024-05-27T10:52:11.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.425+0000 7ff2f7e00640 1 --2- 172.21.15.47:0/1299132450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2f00e3490 0x7ff2f00e3920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff2f806aee0 tx=0x7ff2f8074400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57c61d0bc0552d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.426+0000 7ff2f6000640 1 -- 172.21.15.47:0/1299132450 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80a7940 con 0x7ff2f00e3490 2024-05-27T10:52:11.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.426+0000 7ff2f6000640 1 -- 172.21.15.47:0/1299132450 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f80a7ae0 con 0x7ff2f00e3490 2024-05-27T10:52:11.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.426+0000 7ff2f6000640 1 -- 172.21.15.47:0/1299132450 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80b1480 con 0x7ff2f00e3490 2024-05-27T10:52:11.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.426+0000 7f4e61400640 1 Processor -- start 2024-05-27T10:52:11.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.426+0000 7f3f09a00640 1 Processor -- start 2024-05-27T10:52:11.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.427+0000 7ff2fd200640 1 -- 172.21.15.47:0/1299132450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2f00e3490 msgr2=0x7ff2f00e3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.427+0000 7ff2fd200640 1 --2- 172.21.15.47:0/1299132450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2f00e3490 0x7ff2f00e3920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff2f806aee0 tx=0x7ff2f8074400 comp rx=0 tx=0).stop 2024-05-27T10:52:11.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.428+0000 7ff2fd200640 1 -- 172.21.15.47:0/1299132450 shutdown_connections 2024-05-27T10:52:11.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.428+0000 7ff2fd200640 1 --2- 172.21.15.47:0/1299132450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2f00e3490 0x7ff2f00e3920 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.428+0000 7ff2fd200640 1 --2- 172.21.15.47:0/1299132450 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff2f0009da0 0x7ff2f00e2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.428+0000 7ff2fd200640 1 -- 172.21.15.47:0/1299132450 >> 172.21.15.47:0/1299132450 conn(0x7ff2f00537b0 msgr2=0x7ff2f0053b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:11.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.428+0000 7ff2fd200640 1 -- 172.21.15.47:0/1299132450 shutdown_connections 2024-05-27T10:52:11.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.428+0000 7ff2fd200640 1 -- 172.21.15.47:0/1299132450 wait complete. 2024-05-27T10:52:11.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.427+0000 7f3f09a00640 1 -- start start 2024-05-27T10:52:11.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.428+0000 7f3f09a00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f040b6970 0x7f3f0414d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.428+0000 7f3f09a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f0415e870 0x7f3f040b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.428+0000 7f3f09a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0415ec50 0x7f3f040b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.428+0000 7f3f09a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3f040cf700 con 0x7f3f0415e870 2024-05-27T10:52:11.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.428+0000 7f3f09a00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3f040d2480 con 0x7f3f040b6970 2024-05-27T10:52:11.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.428+0000 7f3f09a00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3f040d1410 con 0x7f3f0415ec50 2024-05-27T10:52:11.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.427+0000 7f4e61400640 1 -- start start 2024-05-27T10:52:11.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.428+0000 7f4e61400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e54058130 0x7f4e5404d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.428+0000 7f4e61400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e540e3040 0x7f4e540e5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.428+0000 7f4e61400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4e5404eff0 0x7f4e5404f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.428+0000 7f4e61400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4e54058720 con 0x7f4e540e3040 2024-05-27T10:52:11.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.428+0000 7f4e61400640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4e540585a0 con 0x7f4e54058130 2024-05-27T10:52:11.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.428+0000 7f4e61400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f4e540542d0 con 0x7f4e5404eff0 2024-05-27T10:52:11.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.429+0000 7f3f02a00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f040b6970 0x7f3f0414d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.429+0000 7f3f03400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0415ec50 0x7f3f040b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.429+0000 7f3f02a00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f040b6970 0x7f3f0414d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.47:47916/0 (socket says 172.21.15.47:47916) 2024-05-27T10:52:11.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.429+0000 7f3f02000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f0415e870 0x7f3f040b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.430+0000 7f3f02000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f0415e870 0x7f3f040b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34308/0 (socket says 172.21.15.47:34308) 2024-05-27T10:52:11.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.430+0000 7f3f02000640 1 -- 172.21.15.47:0/43494628 learned_addr learned my addr 172.21.15.47:0/43494628 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:11.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.430+0000 7f3f03400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0415ec50 0x7f3f040b36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:51900/0 (socket says 172.21.15.47:51900) 2024-05-27T10:52:11.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.431+0000 7f3f02000640 1 -- 172.21.15.47:0/43494628 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0415ec50 msgr2=0x7f3f040b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.431+0000 7f3f02000640 1 --2- 172.21.15.47:0/43494628 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0415ec50 0x7f3f040b36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.431+0000 7f3f02000640 1 -- 172.21.15.47:0/43494628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f040b6970 msgr2=0x7f3f0414d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.431+0000 7f3f02000640 1 --2- 172.21.15.47:0/43494628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f040b6970 0x7f3f0414d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.431+0000 7f3f02000640 1 -- 172.21.15.47:0/43494628 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f04161830 con 0x7f3f0415e870 2024-05-27T10:52:11.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.429+0000 7f4e60a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4e5404eff0 0x7f4e5404f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.429+0000 7f4e60a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4e5404eff0 0x7f4e5404f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:51902/0 (socket says 172.21.15.47:51902) 2024-05-27T10:52:11.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.429+0000 7f4e60a00640 1 -- 172.21.15.47:0/2122027542 learned_addr learned my addr 172.21.15.47:0/2122027542 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:11.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.430+0000 7f4e5be00640 1 --2- 172.21.15.47:0/2122027542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e54058130 0x7f4e5404d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.431+0000 7f4e5b400640 1 --2- 172.21.15.47:0/2122027542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e540e3040 0x7f4e540e5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.431+0000 7f4e60a00640 1 -- 172.21.15.47:0/2122027542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e54058130 msgr2=0x7f4e5404d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.432+0000 7f4e60a00640 1 --2- 172.21.15.47:0/2122027542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e54058130 0x7f4e5404d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.432+0000 7f3f02000640 1 --2- 172.21.15.47:0/43494628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f0415e870 0x7f3f040b3180 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400caf0 tx=0x7f3ef40020a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.432+0000 7f4e60a00640 1 -- 172.21.15.47:0/2122027542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e540e3040 msgr2=0x7f4e540e5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.432+0000 7f4e5be00640 1 --2- 172.21.15.47:0/2122027542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e54058130 0x7f4e5404d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:11.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.432+0000 7f4e60a00640 1 --2- 172.21.15.47:0/2122027542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e540e3040 0x7f4e540e5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.431+0000 7ff2fd200640 1 Processor -- start 2024-05-27T10:52:11.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.432+0000 7f3efaa00640 1 -- 172.21.15.47:0/43494628 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4003b70 con 0x7f3f0415e870 2024-05-27T10:52:11.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.432+0000 7f3efaa00640 1 -- 172.21.15.47:0/43494628 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef4003d10 con 0x7f3f0415e870 2024-05-27T10:52:11.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.432+0000 7f3efaa00640 1 -- 172.21.15.47:0/43494628 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4005310 con 0x7f3f0415e870 2024-05-27T10:52:11.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.432+0000 7f3f09a00640 1 -- 172.21.15.47:0/43494628 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f04161b10 con 0x7f3f0415e870 2024-05-27T10:52:11.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.432+0000 7f3f09a00640 1 -- 172.21.15.47:0/43494628 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f041620d0 con 0x7f3f0415e870 2024-05-27T10:52:11.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.434+0000 7f3f09a00640 1 -- 172.21.15.47:0/43494628 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f0404fce0 con 0x7f3f0415e870 2024-05-27T10:52:11.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.434+0000 7f2582400640 1 Processor -- start 2024-05-27T10:52:11.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.434+0000 7f4e60a00640 1 -- 172.21.15.47:0/2122027542 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e540e4af0 con 0x7f4e5404eff0 2024-05-27T10:52:11.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.434+0000 7f4e5b400640 1 --2- 172.21.15.47:0/2122027542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e540e3040 0x7f4e540e5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:11.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.432+0000 7ff2fd200640 1 -- start start 2024-05-27T10:52:11.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.434+0000 7ff2fd200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2f0009da0 0x7ff2f00d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.434+0000 7ff2fd200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff2f0051690 0x7ff2f0036ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.434+0000 7ff2fd200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2f00e3490 0x7ff2f00dfc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.434+0000 7ff2fd200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f00e3fe0 con 0x7ff2f0009da0 2024-05-27T10:52:11.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.434+0000 7ff2fd200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f00e3e60 con 0x7ff2f00e3490 2024-05-27T10:52:11.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.434+0000 7ff2fd200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f00e4160 con 0x7ff2f0051690 2024-05-27T10:52:11.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.435+0000 7f4e60a00640 1 --2- 172.21.15.47:0/2122027542 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4e5404eff0 0x7f4e5404f4a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c051690 tx=0x7f4e5c06cd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.434+0000 7f2582400640 1 -- start start 2024-05-27T10:52:11.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.435+0000 7f4e4fe00640 1 -- 172.21.15.47:0/2122027542 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c098070 con 0x7f4e5404eff0 2024-05-27T10:52:11.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.435+0000 7ff2f7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2f0009da0 0x7ff2f00d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.435+0000 7ff2f7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2f0009da0 0x7ff2f00d0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34332/0 (socket says 172.21.15.47:34332) 2024-05-27T10:52:11.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.435+0000 7ff2f7400640 1 -- 172.21.15.47:0/2343614811 learned_addr learned my addr 172.21.15.47:0/2343614811 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:11.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.435+0000 7f4e4fe00640 1 -- 172.21.15.47:0/2122027542 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e5c071830 con 0x7f4e5404eff0 2024-05-27T10:52:11.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.435+0000 7f4e4fe00640 1 -- 172.21.15.47:0/2122027542 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c071be0 con 0x7f4e5404eff0 2024-05-27T10:52:11.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.436+0000 7ff2f7400640 1 -- 172.21.15.47:0/2343614811 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff2f0051690 msgr2=0x7ff2f0036ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-27T10:52:11.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.436+0000 7ff2f7400640 1 --2- 172.21.15.47:0/2343614811 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff2f0051690 0x7ff2f0036ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.436+0000 7ff2f7400640 1 -- 172.21.15.47:0/2343614811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2f00e3490 msgr2=0x7ff2f00dfc90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-27T10:52:11.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.436+0000 7ff2f7400640 1 --2- 172.21.15.47:0/2343614811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2f00e3490 0x7ff2f00dfc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.436+0000 7f2582400640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f257c1638c0 0x7f257c071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.436+0000 7ff2f7400640 1 -- 172.21.15.47:0/2343614811 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f00d3470 con 0x7ff2f0009da0 2024-05-27T10:52:11.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.436+0000 7f2582400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f257c0d0a70 0x7f257c0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.436+0000 7f2582400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f257c0b3370 con 0x7f257c072120 2024-05-27T10:52:11.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.436+0000 7f2582400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f257c0726a0 con 0x7f257c0d0a70 2024-05-27T10:52:11.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.436+0000 7f2582400640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f257c0b3610 con 0x7f257c1638c0 2024-05-27T10:52:11.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.437+0000 7ff2f7400640 1 --2- 172.21.15.47:0/2343614811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2f0009da0 0x7ff2f00d0db0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400d800 tx=0x7ff2e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.437+0000 7f4e61400640 1 -- 172.21.15.47:0/2122027542 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e540e4dd0 con 0x7f4e5404eff0 2024-05-27T10:52:11.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.437+0000 7f4e61400640 1 -- 172.21.15.47:0/2122027542 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e540e5390 con 0x7f4e5404eff0 2024-05-27T10:52:11.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.438+0000 7f2581000640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f257c1638c0 0x7f257c071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.438+0000 7f2573e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f257c072120 0x7f257c0d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60330/0 (socket says 172.21.15.47:60330) 2024-05-27T10:52:11.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.438+0000 7f2573e00640 1 -- 172.21.15.47:0/53573210 learned_addr learned my addr 172.21.15.47:0/53573210 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:11.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.437+0000 7f3efaa00640 1 -- 172.21.15.47:0/43494628 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3ef40054b0 con 0x7f3f0415e870 2024-05-27T10:52:11.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.438+0000 7f3efaa00640 1 --2- 172.21.15.47:0/43494628 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3ee006c9c0 0x7f3ee006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.439+0000 7f3efaa00640 1 -- 172.21.15.47:0/43494628 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3ef408b920 con 0x7f3f0415e870 2024-05-27T10:52:11.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.439+0000 7f2581a00640 1 --2- 172.21.15.47:0/53573210 >> v2:172.21.15.47:3300/0 conn(0x7f257c0d0a70 0x7f257c0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.439+0000 7f3f02a00640 1 --2- 172.21.15.47:0/43494628 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3ee006c9c0 0x7f3ee006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.440+0000 7f4e61400640 1 -- 172.21.15.47:0/2122027542 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e54054c70 con 0x7f4e5404eff0 2024-05-27T10:52:11.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.440+0000 7f2581a00640 1 -- 172.21.15.47:0/53573210 >> v2:172.21.15.53:3300/0 conn(0x7f257c1638c0 msgr2=0x7f257c071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:11.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.440+0000 7f2581a00640 1 --2- 172.21.15.47:0/53573210 >> v2:172.21.15.53:3300/0 conn(0x7f257c1638c0 0x7f257c071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.440+0000 7f2581a00640 1 -- 172.21.15.47:0/53573210 >> v1:172.21.15.47:6789/0 conn(0x7f257c072120 legacy=0x7f257c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.440+0000 7f2581a00640 1 -- 172.21.15.47:0/53573210 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f257c0b38f0 con 0x7f257c0d0a70 2024-05-27T10:52:11.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.441+0000 7f3f02a00640 1 --2- 172.21.15.47:0/43494628 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3ee006c9c0 0x7f3ee006ee80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3eec034000 tx=0x7f3eec02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.442+0000 7f2581a00640 1 --2- 172.21.15.47:0/53573210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f257c0d0a70 0x7f257c0ad1b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f257c0718a0 tx=0x7f257402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93a13c442eb1615 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.443+0000 7f4e4fe00640 1 -- 172.21.15.47:0/2122027542 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e5c093430 con 0x7f4e5404eff0 2024-05-27T10:52:11.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.444+0000 7ff2eb400640 1 -- 172.21.15.47:0/2343614811 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e400b6c0 con 0x7ff2f0009da0 2024-05-27T10:52:11.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.444+0000 7f257be00640 1 -- 172.21.15.47:0/53573210 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2574007740 con 0x7f257c0d0a70 2024-05-27T10:52:11.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.444+0000 7f257be00640 1 -- 172.21.15.47:0/53573210 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25740078e0 con 0x7f257c0d0a70 2024-05-27T10:52:11.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.444+0000 7f257be00640 1 -- 172.21.15.47:0/53573210 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2574007740 con 0x7f257c0d0a70 2024-05-27T10:52:11.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.444+0000 7ff2eb400640 1 -- 172.21.15.47:0/2343614811 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e4019070 con 0x7ff2f0009da0 2024-05-27T10:52:11.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.445+0000 7f3efaa00640 1 -- 172.21.15.47:0/43494628 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3ef4059dc0 con 0x7f3f0415e870 2024-05-27T10:52:11.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.444+0000 7ff2eb400640 1 -- 172.21.15.47:0/2343614811 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e400ba60 con 0x7ff2f0009da0 2024-05-27T10:52:11.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.444+0000 7ff2fd200640 1 -- 172.21.15.47:0/2343614811 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f004e950 con 0x7ff2f0009da0 2024-05-27T10:52:11.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.445+0000 7f4e4fe00640 1 --2- 172.21.15.47:0/2122027542 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f4e3c06c8f0 0x7f4e3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.445+0000 7f2582400640 1 -- 172.21.15.47:0/53573210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f257c0d0a70 msgr2=0x7f257c0ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.445+0000 7f2582400640 1 --2- 172.21.15.47:0/53573210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f257c0d0a70 0x7f257c0ad1b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f257c0718a0 tx=0x7f257402a680 comp rx=0 tx=0).stop 2024-05-27T10:52:11.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.444+0000 7ff2fd200640 1 -- 172.21.15.47:0/2343614811 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f00d15c0 con 0x7ff2f0009da0 2024-05-27T10:52:11.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.445+0000 7f4e4fe00640 1 -- 172.21.15.47:0/2122027542 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4e5c106ce0 con 0x7f4e5404eff0 2024-05-27T10:52:11.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.446+0000 7f2582400640 1 -- 172.21.15.47:0/53573210 shutdown_connections 2024-05-27T10:52:11.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.446+0000 7f2582400640 1 --2- 172.21.15.47:0/53573210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f257c0d0a70 0x7f257c0ad1b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.446+0000 7f2582400640 1 --2- 172.21.15.47:0/53573210 >> v2:172.21.15.53:3300/0 conn(0x7f257c1638c0 0x7f257c071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.446+0000 7f2582400640 1 -- 172.21.15.47:0/53573210 >> 172.21.15.47:0/53573210 conn(0x7f257c06bb20 msgr2=0x7f257c06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:11.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.447+0000 7f4e5be00640 1 --2- 172.21.15.47:0/2122027542 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f4e3c06c8f0 0x7f4e3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.447+0000 7ff2fd200640 1 -- 172.21.15.47:0/2343614811 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d4005290 con 0x7ff2f0009da0 2024-05-27T10:52:11.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.448+0000 7f2582400640 1 -- 172.21.15.47:0/53573210 shutdown_connections 2024-05-27T10:52:11.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.448+0000 7ff2eb400640 1 -- 172.21.15.47:0/2343614811 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2e400bc00 con 0x7ff2f0009da0 2024-05-27T10:52:11.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.448+0000 7f4e5be00640 1 --2- 172.21.15.47:0/2122027542 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f4e3c06c8f0 0x7f4e3c06edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009aa0 tx=0x7f4e50008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.448+0000 7f2582400640 1 -- 172.21.15.47:0/53573210 wait complete. 2024-05-27T10:52:11.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.450+0000 7ff2eb400640 1 --2- 172.21.15.47:0/2343614811 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff2d806c940 0x7ff2d806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.450+0000 7ff2eb400640 1 -- 172.21.15.47:0/2343614811 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff2e408be40 con 0x7ff2f0009da0 2024-05-27T10:52:11.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.451+0000 7ff2f6a00640 1 --2- 172.21.15.47:0/2343614811 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff2d806c940 0x7ff2d806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.451+0000 7f2582400640 1 Processor -- start 2024-05-27T10:52:11.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.452+0000 7f2582400640 1 -- start start 2024-05-27T10:52:11.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.453+0000 7ff2f6a00640 1 --2- 172.21.15.47:0/2343614811 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff2d806c940 0x7ff2d806ee00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec000c00 tx=0x7ff2ec007890 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.454+0000 7f2582400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f257c072120 0x7f257c14c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.454+0000 7f2582400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f257c0d0a70 0x7f257c09c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.454+0000 7f2582400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f257c1638c0 0x7f257c098dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.454+0000 7f2582400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f257c0b4270 con 0x7f257c1638c0 2024-05-27T10:52:11.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.454+0000 7f2582400640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f257c0b40f0 con 0x7f257c0d0a70 2024-05-27T10:52:11.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.454+0000 7f2582400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f257c163ca0 con 0x7f257c072120 2024-05-27T10:52:11.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.454+0000 7f2581000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f257c072120 0x7f257c14c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.454+0000 7f2581000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f257c072120 0x7f257c14c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:51916/0 (socket says 172.21.15.47:51916) 2024-05-27T10:52:11.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.454+0000 7f2581000640 1 -- 172.21.15.47:0/1771771868 learned_addr learned my addr 172.21.15.47:0/1771771868 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:11.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.454+0000 7f2573e00640 1 --2- 172.21.15.47:0/1771771868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f257c0d0a70 0x7f257c09c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.455+0000 7f2581a00640 1 --2- 172.21.15.47:0/1771771868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f257c1638c0 0x7f257c098dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.455+0000 7f2581000640 1 -- 172.21.15.47:0/1771771868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f257c0d0a70 msgr2=0x7f257c09c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.455+0000 7f2581000640 1 --2- 172.21.15.47:0/1771771868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f257c0d0a70 0x7f257c09c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.455+0000 7f2581000640 1 -- 172.21.15.47:0/1771771868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f257c1638c0 msgr2=0x7f257c098dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.455+0000 7f2581000640 1 --2- 172.21.15.47:0/1771771868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f257c1638c0 0x7f257c098dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.455+0000 7f2581000640 1 -- 172.21.15.47:0/1771771868 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f257c09ccd0 con 0x7f257c072120 2024-05-27T10:52:11.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.456+0000 7f2581000640 1 --2- 172.21.15.47:0/1771771868 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f257c072120 0x7f257c14c6c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f256400e8a0 tx=0x7f256400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.458+0000 7f2579600640 1 -- 172.21.15.47:0/1771771868 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2564017070 con 0x7f257c072120 2024-05-27T10:52:11.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.458+0000 7f2582400640 1 -- 172.21.15.47:0/1771771868 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f257c09b6f0 con 0x7f257c072120 2024-05-27T10:52:11.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.459+0000 7f2582400640 1 -- 172.21.15.47:0/1771771868 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f257c09bcb0 con 0x7f257c072120 2024-05-27T10:52:11.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.459+0000 7f2579600640 1 -- 172.21.15.47:0/1771771868 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f256400c940 con 0x7f257c072120 2024-05-27T10:52:11.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.459+0000 7f4e4fe00640 1 -- 172.21.15.47:0/2122027542 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4e54054c70 con 0x7f4e5404eff0 2024-05-27T10:52:11.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.459+0000 7f2579600640 1 -- 172.21.15.47:0/1771771868 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2564017070 con 0x7f257c072120 2024-05-27T10:52:11.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.459+0000 7ff2eb400640 1 -- 172.21.15.47:0/2343614811 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff2f00d3470 con 0x7ff2f0009da0 2024-05-27T10:52:11.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.460+0000 7f2582400640 1 -- 172.21.15.47:0/1771771868 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2550005290 con 0x7f257c072120 2024-05-27T10:52:11.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.463+0000 7f2579600640 1 -- 172.21.15.47:0/1771771868 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f256401a070 con 0x7f257c072120 2024-05-27T10:52:11.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.464+0000 7f2579600640 1 --2- 172.21.15.47:0/1771771868 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f255806caf0 0x7f255806efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:11.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.465+0000 7f2579600640 1 -- 172.21.15.47:0/1771771868 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f256408b5b0 con 0x7f257c072120 2024-05-27T10:52:11.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.465+0000 7f2573e00640 1 --2- 172.21.15.47:0/1771771868 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f255806caf0 0x7f255806efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:11.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.467+0000 7f2573e00640 1 --2- 172.21.15.47:0/1771771868 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f255806caf0 0x7f255806efb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f257c156d70 tx=0x7f256c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:11.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.476+0000 7f2579600640 1 -- 172.21.15.47:0/1771771868 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2564059370 con 0x7f257c072120 2024-05-27T10:52:11.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.805+0000 7f0098c00640 1 -- 172.21.15.47:0/4166372242 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f00a00379a0 con 0x7f00a00df100 2024-05-27T10:52:11.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.806+0000 7f009b400640 1 -- 172.21.15.47:0/4166372242 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f009407a6c0 con 0x7f00a00df100 2024-05-27T10:52:11.804 INFO:teuthology.orchestra.run.smithi047.stdout:55834574853 2024-05-27T10:52:11.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.810+0000 7f0098c00640 1 -- 172.21.15.47:0/4166372242 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f008806c920 msgr2=0x7f008806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.810+0000 7f0098c00640 1 --2- 172.21.15.47:0/4166372242 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f008806c920 0x7f008806ede0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f009c007fd0 tx=0x7f009c007d60 comp rx=0 tx=0).stop 2024-05-27T10:52:11.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.810+0000 7f0098c00640 1 -- 172.21.15.47:0/4166372242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a00df100 msgr2=0x7f00a00d3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.810+0000 7f0098c00640 1 --2- 172.21.15.47:0/4166372242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a00df100 0x7f00a00d3d50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f00940090b0 tx=0x7f00940046c0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.811+0000 7f0098c00640 1 -- 172.21.15.47:0/4166372242 shutdown_connections 2024-05-27T10:52:11.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.811+0000 7f0098c00640 1 --2- 172.21.15.47:0/4166372242 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f008806c920 0x7f008806ede0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.811+0000 7f0098c00640 1 --2- 172.21.15.47:0/4166372242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a00df100 0x7f00a00d3d50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.811+0000 7f0098c00640 1 --2- 172.21.15.47:0/4166372242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00a00530a0 0x7f00a00d2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.811+0000 7f0098c00640 1 --2- 172.21.15.47:0/4166372242 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00a0050180 0x7f00a00ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.811+0000 7f0098c00640 1 -- 172.21.15.47:0/4166372242 >> 172.21.15.47:0/4166372242 conn(0x7f00a0009fb0 msgr2=0x7f00a0005fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:11.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.811+0000 7f0098c00640 1 -- 172.21.15.47:0/4166372242 shutdown_connections 2024-05-27T10:52:11.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.811+0000 7f0098c00640 1 -- 172.21.15.47:0/4166372242 wait complete. 2024-05-27T10:52:11.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.828+0000 7f5ed1800640 1 -- 172.21.15.47:0/1801821857 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f5ecc0b4a50 con 0x7f5ecc0cfed0 2024-05-27T10:52:11.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.828+0000 7fbe4f000640 1 -- 172.21.15.47:0/2738011250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fbe24005580 con 0x7fbe480d4c60 2024-05-27T10:52:11.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.829+0000 7f5ec3e00640 1 -- 172.21.15.47:0/1801821857 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5ebc05d9c0 con 0x7f5ecc0cfed0 2024-05-27T10:52:11.828 INFO:teuthology.orchestra.run.smithi047.stdout:55834574853 2024-05-27T10:52:11.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.829+0000 7fbe45600640 1 -- 172.21.15.47:0/2738011250 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbe400594a0 con 0x7fbe480d4c60 2024-05-27T10:52:11.829 INFO:teuthology.orchestra.run.smithi047.stdout:55834574853 2024-05-27T10:52:11.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.832+0000 7f5ed1800640 1 -- 172.21.15.47:0/1801821857 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5eac06c940 msgr2=0x7f5eac06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.832+0000 7f5ed1800640 1 --2- 172.21.15.47:0/1801821857 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5eac06c940 0x7f5eac06ee00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc0c8b80 tx=0x7f5eb8009190 comp rx=0 tx=0).stop 2024-05-27T10:52:11.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.832+0000 7f5ed1800640 1 -- 172.21.15.47:0/1801821857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ecc0cfed0 msgr2=0x7f5ecc0b58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.833+0000 7f5ed1800640 1 --2- 172.21.15.47:0/1801821857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ecc0cfed0 0x7f5ecc0b58f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc00c7f0 tx=0x7f5ebc00ccb0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.833+0000 7f5ed1800640 1 -- 172.21.15.47:0/1801821857 shutdown_connections 2024-05-27T10:52:11.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.833+0000 7f5ed1800640 1 --2- 172.21.15.47:0/1801821857 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5eac06c940 0x7f5eac06ee00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.834+0000 7f5ed1800640 1 --2- 172.21.15.47:0/1801821857 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5ecc160090 0x7f5ecc06fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.834+0000 7f5ed1800640 1 --2- 172.21.15.47:0/1801821857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ecc0d0330 0x7f5ecc15f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.834+0000 7f5ed1800640 1 --2- 172.21.15.47:0/1801821857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ecc0cfed0 0x7f5ecc0b58f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.834+0000 7f5ed1800640 1 -- 172.21.15.47:0/1801821857 >> 172.21.15.47:0/1801821857 conn(0x7f5ecc0b3df0 msgr2=0x7f5ecc15b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:11.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.834+0000 7f5ed1800640 1 -- 172.21.15.47:0/1801821857 shutdown_connections 2024-05-27T10:52:11.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.834+0000 7fbe4f000640 1 -- 172.21.15.47:0/2738011250 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbe2806c8f0 msgr2=0x7fbe2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.834+0000 7fbe4f000640 1 --2- 172.21.15.47:0/2738011250 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbe2806c8f0 0x7fbe2806edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbe34034000 tx=0x7fbe3402e000 comp rx=0 tx=0).stop 2024-05-27T10:52:11.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.835+0000 7f5ed1800640 1 -- 172.21.15.47:0/1801821857 wait complete. 2024-05-27T10:52:11.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.835+0000 7fbe4f000640 1 -- 172.21.15.47:0/2738011250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe480d4c60 msgr2=0x7fbe480c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.835+0000 7fbe4f000640 1 --2- 172.21.15.47:0/2738011250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe480d4c60 0x7fbe480c9c70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000b970 tx=0x7fbe4000be30 comp rx=0 tx=0).stop 2024-05-27T10:52:11.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.835+0000 7fbe4f000640 1 -- 172.21.15.47:0/2738011250 shutdown_connections 2024-05-27T10:52:11.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.835+0000 7fbe4f000640 1 --2- 172.21.15.47:0/2738011250 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbe2806c8f0 0x7fbe2806edb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.835+0000 7fbe4f000640 1 --2- 172.21.15.47:0/2738011250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe480d4c60 0x7fbe480c9c70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.835+0000 7fbe4f000640 1 --2- 172.21.15.47:0/2738011250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe480b63b0 0x7fbe48153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.835+0000 7fbe4f000640 1 --2- 172.21.15.47:0/2738011250 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbe480b5fd0 0x7fbe480b81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.835+0000 7fbe4f000640 1 -- 172.21.15.47:0/2738011250 >> 172.21.15.47:0/2738011250 conn(0x7fbe4808bfd0 msgr2=0x7fbe480b4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:11.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.836+0000 7fbe4f000640 1 -- 172.21.15.47:0/2738011250 shutdown_connections 2024-05-27T10:52:11.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.836+0000 7fbe4f000640 1 -- 172.21.15.47:0/2738011250 wait complete. 2024-05-27T10:52:11.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-05-27T10:52:11.837 DEBUG:teuthology.parallel:result is None 2024-05-27T10:52:11.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-05-27T10:52:11.853 DEBUG:teuthology.parallel:result is None 2024-05-27T10:52:11.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.862+0000 7fbbcbe00640 1 -- 172.21.15.47:0/3411405558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fbbb4005850 con 0x7fbbc40051c0 2024-05-27T10:52:11.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.863+0000 7fbbd6a00640 1 -- 172.21.15.47:0/3411405558 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbbd00595d0 con 0x7fbbc40051c0 2024-05-27T10:52:11.861 INFO:teuthology.orchestra.run.smithi047.stdout:55834574855 2024-05-27T10:52:11.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-05-27T10:52:11.863 DEBUG:teuthology.parallel:result is None 2024-05-27T10:52:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.866+0000 7fbbcbe00640 1 -- 172.21.15.47:0/3411405558 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbbc006caf0 msgr2=0x7fbbc006efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.866+0000 7fbbcbe00640 1 --2- 172.21.15.47:0/3411405558 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbbc006caf0 0x7fbbc006efb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbbe015e250 tx=0x7fbbd8007670 comp rx=0 tx=0).stop 2024-05-27T10:52:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.866+0000 7fbbcbe00640 1 -- 172.21.15.47:0/3411405558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbc40051c0 msgr2=0x7fbbe015d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.866+0000 7fbbcbe00640 1 --2- 172.21.15.47:0/3411405558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbc40051c0 0x7fbbe015d0f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0010860 tx=0x7fbbd0010d20 comp rx=0 tx=0).stop 2024-05-27T10:52:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.867+0000 7fbbcbe00640 1 -- 172.21.15.47:0/3411405558 shutdown_connections 2024-05-27T10:52:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.867+0000 7fbbcbe00640 1 --2- 172.21.15.47:0/3411405558 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbbc006caf0 0x7fbbc006efb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.867+0000 7fbbcbe00640 1 --2- 172.21.15.47:0/3411405558 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbe015d800 0x7fbbe006ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.867+0000 7fbbcbe00640 1 --2- 172.21.15.47:0/3411405558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbe015de30 0x7fbbe015fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.867+0000 7fbbcbe00640 1 --2- 172.21.15.47:0/3411405558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbc40051c0 0x7fbbe015d0f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.867+0000 7fbbcbe00640 1 -- 172.21.15.47:0/3411405558 >> 172.21.15.47:0/3411405558 conn(0x7fbbe008bfd0 msgr2=0x7fbbe006e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:11.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.867+0000 7fbbcbe00640 1 -- 172.21.15.47:0/3411405558 shutdown_connections 2024-05-27T10:52:11.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.867+0000 7fbbcbe00640 1 -- 172.21.15.47:0/3411405558 wait complete. 2024-05-27T10:52:11.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.883+0000 7ff2fd200640 1 -- 172.21.15.47:0/2343614811 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff2d4005850 con 0x7ff2f0009da0 2024-05-27T10:52:11.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.884+0000 7ff2eb400640 1 -- 172.21.15.47:0/2343614811 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff2e405a3e0 con 0x7ff2f0009da0 2024-05-27T10:52:11.882 INFO:teuthology.orchestra.run.smithi047.stdout:55834574854 2024-05-27T10:52:11.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.884+0000 7f4e61400640 1 -- 172.21.15.47:0/2122027542 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4e540052c0 con 0x7f4e5404eff0 2024-05-27T10:52:11.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.885+0000 7f4e4fe00640 1 -- 172.21.15.47:0/2122027542 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4e5c0d5070 con 0x7f4e5404eff0 2024-05-27T10:52:11.883 INFO:teuthology.orchestra.run.smithi047.stdout:55834574853 2024-05-27T10:52:11.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7ff2fd200640 1 -- 172.21.15.47:0/2343614811 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff2d806c940 msgr2=0x7ff2d806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7ff2fd200640 1 --2- 172.21.15.47:0/2343614811 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff2d806c940 0x7ff2d806ee00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec000c00 tx=0x7ff2ec007890 comp rx=0 tx=0).stop 2024-05-27T10:52:11.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7ff2fd200640 1 -- 172.21.15.47:0/2343614811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2f0009da0 msgr2=0x7ff2f00d0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7ff2fd200640 1 --2- 172.21.15.47:0/2343614811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2f0009da0 0x7ff2f00d0db0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400d800 tx=0x7ff2e400dcc0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7f4e61400640 1 -- 172.21.15.47:0/2122027542 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f4e3c06c8f0 msgr2=0x7f4e3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7f4e61400640 1 --2- 172.21.15.47:0/2122027542 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f4e3c06c8f0 0x7f4e3c06edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009aa0 tx=0x7f4e50008040 comp rx=0 tx=0).stop 2024-05-27T10:52:11.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7f4e61400640 1 -- 172.21.15.47:0/2122027542 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4e5404eff0 msgr2=0x7f4e5404f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7f4e61400640 1 --2- 172.21.15.47:0/2122027542 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4e5404eff0 0x7f4e5404f4a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c051690 tx=0x7f4e5c06cd20 comp rx=0 tx=0).stop 2024-05-27T10:52:11.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7ff2fd200640 1 -- 172.21.15.47:0/2343614811 shutdown_connections 2024-05-27T10:52:11.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7ff2fd200640 1 --2- 172.21.15.47:0/2343614811 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff2d806c940 0x7ff2d806ee00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7ff2fd200640 1 --2- 172.21.15.47:0/2343614811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2f00e3490 0x7ff2f00dfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7ff2fd200640 1 --2- 172.21.15.47:0/2343614811 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff2f0051690 0x7ff2f0036ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7ff2fd200640 1 --2- 172.21.15.47:0/2343614811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2f0009da0 0x7ff2f00d0db0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7ff2fd200640 1 -- 172.21.15.47:0/2343614811 >> 172.21.15.47:0/2343614811 conn(0x7ff2f00537b0 msgr2=0x7ff2f00551a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:11.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7f4e61400640 1 -- 172.21.15.47:0/2122027542 shutdown_connections 2024-05-27T10:52:11.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7f4e61400640 1 --2- 172.21.15.47:0/2122027542 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f4e3c06c8f0 0x7f4e3c06edb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7f4e61400640 1 --2- 172.21.15.47:0/2122027542 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4e5404eff0 0x7f4e5404f4a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7f4e61400640 1 --2- 172.21.15.47:0/2122027542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e540e3040 0x7f4e540e5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7f4e61400640 1 --2- 172.21.15.47:0/2122027542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e54058130 0x7f4e5404d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7f4e61400640 1 -- 172.21.15.47:0/2122027542 >> 172.21.15.47:0/2122027542 conn(0x7f4e5403aa40 msgr2=0x7f4e5403c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:11.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7ff2fd200640 1 -- 172.21.15.47:0/2343614811 shutdown_connections 2024-05-27T10:52:11.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7ff2fd200640 1 -- 172.21.15.47:0/2343614811 wait complete. 2024-05-27T10:52:11.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7f4e61400640 1 -- 172.21.15.47:0/2122027542 shutdown_connections 2024-05-27T10:52:11.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.888+0000 7f4e61400640 1 -- 172.21.15.47:0/2122027542 wait complete. 2024-05-27T10:52:11.891 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-05-27T10:52:11.892 DEBUG:teuthology.parallel:result is None 2024-05-27T10:52:11.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.896+0000 7f3f09a00640 1 -- 172.21.15.47:0/43494628 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f3f040d0cb0 con 0x7f3f0415e870 2024-05-27T10:52:11.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.896+0000 7f3efaa00640 1 -- 172.21.15.47:0/43494628 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3ef40596c0 con 0x7f3f0415e870 2024-05-27T10:52:11.894 INFO:teuthology.orchestra.run.smithi047.stdout:55834574854 2024-05-27T10:52:11.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.899+0000 7f3f09a00640 1 -- 172.21.15.47:0/43494628 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3ee006c9c0 msgr2=0x7f3ee006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.899+0000 7f3f09a00640 1 --2- 172.21.15.47:0/43494628 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3ee006c9c0 0x7f3ee006ee80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3eec034000 tx=0x7f3eec02e000 comp rx=0 tx=0).stop 2024-05-27T10:52:11.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.899+0000 7f3f09a00640 1 -- 172.21.15.47:0/43494628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f0415e870 msgr2=0x7f3f040b3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.899+0000 7f3f09a00640 1 --2- 172.21.15.47:0/43494628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f0415e870 0x7f3f040b3180 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400caf0 tx=0x7f3ef40020a0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.899+0000 7f3f09a00640 1 -- 172.21.15.47:0/43494628 shutdown_connections 2024-05-27T10:52:11.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.899+0000 7f3f09a00640 1 --2- 172.21.15.47:0/43494628 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3ee006c9c0 0x7f3ee006ee80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.899+0000 7f3f09a00640 1 --2- 172.21.15.47:0/43494628 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0415ec50 0x7f3f040b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.899+0000 7f3f09a00640 1 --2- 172.21.15.47:0/43494628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f0415e870 0x7f3f040b3180 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.899+0000 7f3f09a00640 1 --2- 172.21.15.47:0/43494628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f040b6970 0x7f3f0414d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.899+0000 7f3f09a00640 1 -- 172.21.15.47:0/43494628 >> 172.21.15.47:0/43494628 conn(0x7f3f0409d870 msgr2=0x7f3f040d28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:11.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.899+0000 7f3f09a00640 1 -- 172.21.15.47:0/43494628 shutdown_connections 2024-05-27T10:52:11.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.900+0000 7f3f09a00640 1 -- 172.21.15.47:0/43494628 wait complete. 2024-05-27T10:52:11.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.901+0000 7f2582400640 1 -- 172.21.15.47:0/1771771868 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f2550005850 con 0x7f257c072120 2024-05-27T10:52:11.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.902+0000 7f2579600640 1 -- 172.21.15.47:0/1771771868 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f256405d670 con 0x7f257c072120 2024-05-27T10:52:11.900 INFO:teuthology.orchestra.run.smithi047.stdout:55834574855 2024-05-27T10:52:11.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-05-27T10:52:11.904 DEBUG:teuthology.parallel:result is None 2024-05-27T10:52:11.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.906+0000 7f2582400640 1 -- 172.21.15.47:0/1771771868 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f255806caf0 msgr2=0x7f255806efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.906+0000 7f2582400640 1 --2- 172.21.15.47:0/1771771868 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f255806caf0 0x7f255806efb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f257c156d70 tx=0x7f256c009040 comp rx=0 tx=0).stop 2024-05-27T10:52:11.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.906+0000 7f2582400640 1 -- 172.21.15.47:0/1771771868 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f257c072120 msgr2=0x7f257c14c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:11.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.906+0000 7f2582400640 1 --2- 172.21.15.47:0/1771771868 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f257c072120 0x7f257c14c6c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f256400e8a0 tx=0x7f256400ed60 comp rx=0 tx=0).stop 2024-05-27T10:52:11.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.906+0000 7f2582400640 1 -- 172.21.15.47:0/1771771868 shutdown_connections 2024-05-27T10:52:11.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.906+0000 7f2582400640 1 --2- 172.21.15.47:0/1771771868 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f255806caf0 0x7f255806efb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.906+0000 7f2582400640 1 --2- 172.21.15.47:0/1771771868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f257c1638c0 0x7f257c098dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.906+0000 7f2582400640 1 --2- 172.21.15.47:0/1771771868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f257c0d0a70 0x7f257c09c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.906+0000 7f2582400640 1 --2- 172.21.15.47:0/1771771868 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f257c072120 0x7f257c14c6c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:11.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.906+0000 7f2582400640 1 -- 172.21.15.47:0/1771771868 >> 172.21.15.47:0/1771771868 conn(0x7f257c06bb20 msgr2=0x7f257c0b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:11.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.906+0000 7f2582400640 1 -- 172.21.15.47:0/1771771868 shutdown_connections 2024-05-27T10:52:11.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:11.906+0000 7f2582400640 1 -- 172.21.15.47:0/1771771868 wait complete. 2024-05-27T10:52:11.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-05-27T10:52:11.907 DEBUG:teuthology.parallel:result is None 2024-05-27T10:52:11.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-05-27T10:52:11.916 DEBUG:teuthology.parallel:result is None 2024-05-27T10:52:11.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-05-27T10:52:11.921 DEBUG:teuthology.parallel:result is None 2024-05-27T10:52:11.921 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-27T10:52:11.921 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T10:52:12.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.156+0000 7f5530c00640 1 Processor -- start 2024-05-27T10:52:12.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.156+0000 7f5530c00640 1 -- start start 2024-05-27T10:52:12.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.158+0000 7f5530c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f552c15c840 0x7f552c0d0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:12.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.158+0000 7f5530c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f552c160140 con 0x7f552c15c460 2024-05-27T10:52:12.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.158+0000 7f5530c00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f552c160420 con 0x7f552c0d0c40 2024-05-27T10:52:12.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.158+0000 7f5530c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f552c160700 con 0x7f552c15c840 2024-05-27T10:52:12.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.158+0000 7f5529e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f552c15c460 0x7f552c0ad300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60340/0 (socket says 172.21.15.47:60340) 2024-05-27T10:52:12.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.158+0000 7f5529e00640 1 -- 172.21.15.47:0/2553509222 learned_addr learned my addr 172.21.15.47:0/2553509222 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:12.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.159+0000 7f5523e00640 1 --2- 172.21.15.47:0/2553509222 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f552c15c840 0x7f552c0d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:12.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.159+0000 7f5529400640 1 -- 172.21.15.47:0/2553509222 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4083090962 0 0) 0x7f552c160140 con 0x7f552c15c460 2024-05-27T10:52:12.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.159+0000 7f5529400640 1 -- 172.21.15.47:0/2553509222 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5510003520 con 0x7f552c15c460 2024-05-27T10:52:12.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.159+0000 7f5523e00640 1 -- 172.21.15.47:0/2553509222 >> v1:172.21.15.53:6789/0 conn(0x7f552c0d0c40 legacy=0x7f552c06def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:12.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.159+0000 7f5523e00640 1 -- 172.21.15.47:0/2553509222 >> v1:172.21.15.47:6789/0 conn(0x7f552c15c460 legacy=0x7f552c0ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:12.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.159+0000 7f5523e00640 1 -- 172.21.15.47:0/2553509222 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552c1609e0 con 0x7f552c15c840 2024-05-27T10:52:12.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.161+0000 7f5523e00640 1 --2- 172.21.15.47:0/2553509222 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f552c15c840 0x7f552c0d0700 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f55140097d0 tx=0x7f551402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cba395b192e67b2e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:12.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.161+0000 7f5529400640 1 -- 172.21.15.47:0/2553509222 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514037070 con 0x7f552c15c840 2024-05-27T10:52:12.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.161+0000 7f5529400640 1 -- 172.21.15.47:0/2553509222 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5514032440 con 0x7f552c15c840 2024-05-27T10:52:12.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.161+0000 7f5529400640 1 -- 172.21.15.47:0/2553509222 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514032810 con 0x7f552c15c840 2024-05-27T10:52:12.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.162+0000 7f5530c00640 1 -- 172.21.15.47:0/2553509222 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f552c15c840 msgr2=0x7f552c0d0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:12.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.162+0000 7f5530c00640 1 --2- 172.21.15.47:0/2553509222 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f552c15c840 0x7f552c0d0700 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f55140097d0 tx=0x7f551402a210 comp rx=0 tx=0).stop 2024-05-27T10:52:12.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.162+0000 7f5530c00640 1 -- 172.21.15.47:0/2553509222 shutdown_connections 2024-05-27T10:52:12.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.162+0000 7f5530c00640 1 --2- 172.21.15.47:0/2553509222 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f552c15c840 0x7f552c0d0700 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:12.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.162+0000 7f5530c00640 1 -- 172.21.15.47:0/2553509222 >> 172.21.15.47:0/2553509222 conn(0x7f552c06bd60 msgr2=0x7f552c06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:12.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.162+0000 7f5530c00640 1 -- 172.21.15.47:0/2553509222 shutdown_connections 2024-05-27T10:52:12.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.162+0000 7f5530c00640 1 -- 172.21.15.47:0/2553509222 wait complete. 2024-05-27T10:52:12.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.164+0000 7f5530c00640 1 Processor -- start 2024-05-27T10:52:12.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.164+0000 7f5530c00640 1 -- start start 2024-05-27T10:52:12.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.165+0000 7f5530c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f552c0d0c40 0x7f552c071c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:12.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.165+0000 7f5530c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f552c15c460 0x7f552c152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:12.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.166+0000 7f5530c00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f552c15c840 0x7f552c153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:12.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.166+0000 7f5530c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f552c0ada10 con 0x7f552c15c460 2024-05-27T10:52:12.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.166+0000 7f5530c00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f552c160fa0 con 0x7f552c15c840 2024-05-27T10:52:12.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.166+0000 7f5530c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f552c0adb90 con 0x7f552c0d0c40 2024-05-27T10:52:12.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.166+0000 7f5523e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f552c15c460 0x7f552c152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:12.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.166+0000 7f5523e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f552c15c460 0x7f552c152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34360/0 (socket says 172.21.15.47:34360) 2024-05-27T10:52:12.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.166+0000 7f5523e00640 1 -- 172.21.15.47:0/1801361082 learned_addr learned my addr 172.21.15.47:0/1801361082 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:12.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.166+0000 7f5529e00640 1 --2- 172.21.15.47:0/1801361082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f552c0d0c40 0x7f552c071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:12.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.166+0000 7f5523e00640 1 -- 172.21.15.47:0/1801361082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f552c0d0c40 msgr2=0x7f552c071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:12.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.166+0000 7f5523e00640 1 --2- 172.21.15.47:0/1801361082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f552c0d0c40 0x7f552c071c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:12.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.166+0000 7f5523e00640 1 -- 172.21.15.47:0/1801361082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f552c15c840 msgr2=0x7f552c153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:12.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.166+0000 7f5523e00640 1 --2- 172.21.15.47:0/1801361082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f552c15c840 0x7f552c153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:12.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.166+0000 7f5523e00640 1 -- 172.21.15.47:0/1801361082 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552c073630 con 0x7f552c15c460 2024-05-27T10:52:12.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.167+0000 7f5523e00640 1 --2- 172.21.15.47:0/1801361082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f552c15c460 0x7f552c152f50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5514035040 tx=0x7f55140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:12.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.167+0000 7f5522000640 1 -- 172.21.15.47:0/1801361082 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514037040 con 0x7f552c15c460 2024-05-27T10:52:12.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.167+0000 7f5522000640 1 -- 172.21.15.47:0/1801361082 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5514030500 con 0x7f552c15c460 2024-05-27T10:52:12.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.167+0000 7f5522000640 1 -- 172.21.15.47:0/1801361082 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55140308f0 con 0x7f552c15c460 2024-05-27T10:52:12.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.167+0000 7f5530c00640 1 -- 172.21.15.47:0/1801361082 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f552c072590 con 0x7f552c15c460 2024-05-27T10:52:12.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.167+0000 7f5530c00640 1 -- 172.21.15.47:0/1801361082 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f552c072b50 con 0x7f552c15c460 2024-05-27T10:52:12.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.168+0000 7f5530c00640 1 -- 172.21.15.47:0/1801361082 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f552c0689e0 con 0x7f552c15c460 2024-05-27T10:52:12.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.169+0000 7f5522000640 1 -- 172.21.15.47:0/1801361082 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5514044020 con 0x7f552c15c460 2024-05-27T10:52:12.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.170+0000 7f5522000640 1 --2- 172.21.15.47:0/1801361082 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f550806c8f0 0x7f550806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:12.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.170+0000 7f5522000640 1 -- 172.21.15.47:0/1801361082 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f55140abec0 con 0x7f552c15c460 2024-05-27T10:52:12.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.170+0000 7f5529e00640 1 --2- 172.21.15.47:0/1801361082 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f550806c8f0 0x7f550806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:12.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.171+0000 7f5529e00640 1 --2- 172.21.15.47:0/1801361082 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f550806c8f0 0x7f550806edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f551c0011e0 tx=0x7f551c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:12.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.175+0000 7f5522000640 1 -- 172.21.15.47:0/1801361082 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f551407a250 con 0x7f552c15c460 2024-05-27T10:52:12.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.371+0000 7f5530c00640 1 -- 172.21.15.47:0/1801361082 --> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f552c1f4890 con 0x7f550806c8f0 2024-05-27T10:52:12.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.382+0000 7f5522000640 1 -- 172.21.15.47:0/1801361082 <== mgr.4108 v2:172.21.15.47:6832/3679485934 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f552c1f4890 con 0x7f550806c8f0 2024-05-27T10:52:12.383 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:12.385 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-27T10:52:12.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.386+0000 7f5530c00640 1 -- 172.21.15.47:0/1801361082 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f550806c8f0 msgr2=0x7f550806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:12.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.386+0000 7f5530c00640 1 --2- 172.21.15.47:0/1801361082 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f550806c8f0 0x7f550806edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f551c0011e0 tx=0x7f551c009040 comp rx=0 tx=0).stop 2024-05-27T10:52:12.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.386+0000 7f5530c00640 1 -- 172.21.15.47:0/1801361082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f552c15c460 msgr2=0x7f552c152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:12.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.386+0000 7f5530c00640 1 --2- 172.21.15.47:0/1801361082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f552c15c460 0x7f552c152f50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5514035040 tx=0x7f55140046c0 comp rx=0 tx=0).stop 2024-05-27T10:52:12.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.387+0000 7f5530c00640 1 -- 172.21.15.47:0/1801361082 shutdown_connections 2024-05-27T10:52:12.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.387+0000 7f5530c00640 1 --2- 172.21.15.47:0/1801361082 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f550806c8f0 0x7f550806edb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:12.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.387+0000 7f5530c00640 1 --2- 172.21.15.47:0/1801361082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f552c15c840 0x7f552c153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:12.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.387+0000 7f5530c00640 1 --2- 172.21.15.47:0/1801361082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f552c15c460 0x7f552c152f50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:12.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.387+0000 7f5530c00640 1 --2- 172.21.15.47:0/1801361082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f552c0d0c40 0x7f552c071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:12.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.387+0000 7f5530c00640 1 -- 172.21.15.47:0/1801361082 >> 172.21.15.47:0/1801361082 conn(0x7f552c06bd60 msgr2=0x7f552c159a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:12.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.387+0000 7f5530c00640 1 -- 172.21.15.47:0/1801361082 shutdown_connections 2024-05-27T10:52:12.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.387+0000 7f5530c00640 1 -- 172.21.15.47:0/1801361082 wait complete. 2024-05-27T10:52:12.403 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-27T10:52:11.041291+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252288,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722432,"statfs":{"total":773094113280,"available":772835770368,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.800720"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.515993+0000","last_change":"2024-05-27T10:52:02.284644+0000","last_active":"2024-05-27T10:52:04.515993+0000","last_peered":"2024-05-27T10:52:04.515993+0000","last_clean":"2024-05-27T10:52:04.515993+0000","last_became_active":"2024-05-27T10:52:02.284277+0000","last_became_peered":"2024-05-27T10:52:02.284277+0000","last_unstale":"2024-05-27T10:52:04.515993+0000","last_undegraded":"2024-05-27T10:52:04.515993+0000","last_fullsized":"2024-05-27T10:52:04.515993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:22:27.833163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.259114+0000","last_change":"2024-05-27T10:52:02.274156+0000","last_active":"2024-05-27T10:52:04.259114+0000","last_peered":"2024-05-27T10:52:04.259114+0000","last_clean":"2024-05-27T10:52:04.259114+0000","last_became_active":"2024-05-27T10:52:02.273895+0000","last_became_peered":"2024-05-27T10:52:02.273895+0000","last_unstale":"2024-05-27T10:52:04.259114+0000","last_undegraded":"2024-05-27T10:52:04.259114+0000","last_fullsized":"2024-05-27T10:52:04.259114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:00.463147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277856+0000","last_change":"2024-05-27T10:52:02.259214+0000","last_active":"2024-05-27T10:52:03.277856+0000","last_peered":"2024-05-27T10:52:03.277856+0000","last_clean":"2024-05-27T10:52:03.277856+0000","last_became_active":"2024-05-27T10:52:02.258890+0000","last_became_peered":"2024-05-27T10:52:02.258890+0000","last_unstale":"2024-05-27T10:52:03.277856+0000","last_undegraded":"2024-05-27T10:52:03.277856+0000","last_fullsized":"2024-05-27T10:52:03.277856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:44:14.946437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.732787+0000","last_change":"2024-05-27T10:52:02.280689+0000","last_active":"2024-05-27T10:52:04.732787+0000","last_peered":"2024-05-27T10:52:04.732787+0000","last_clean":"2024-05-27T10:52:04.732787+0000","last_became_active":"2024-05-27T10:52:02.279605+0000","last_became_peered":"2024-05-27T10:52:02.279605+0000","last_unstale":"2024-05-27T10:52:04.732787+0000","last_undegraded":"2024-05-27T10:52:04.732787+0000","last_fullsized":"2024-05-27T10:52:04.732787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:54:56.167515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.514897+0000","last_change":"2024-05-27T10:52:02.275103+0000","last_active":"2024-05-27T10:52:04.514897+0000","last_peered":"2024-05-27T10:52:04.514897+0000","last_clean":"2024-05-27T10:52:04.514897+0000","last_became_active":"2024-05-27T10:52:02.274768+0000","last_became_peered":"2024-05-27T10:52:02.274768+0000","last_unstale":"2024-05-27T10:52:04.514897+0000","last_undegraded":"2024-05-27T10:52:04.514897+0000","last_fullsized":"2024-05-27T10:52:04.514897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:28:35.769753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.732101+0000","last_change":"2024-05-27T10:52:02.275374+0000","last_active":"2024-05-27T10:52:04.732101+0000","last_peered":"2024-05-27T10:52:04.732101+0000","last_clean":"2024-05-27T10:52:04.732101+0000","last_became_active":"2024-05-27T10:52:02.270621+0000","last_became_peered":"2024-05-27T10:52:02.270621+0000","last_unstale":"2024-05-27T10:52:04.732101+0000","last_undegraded":"2024-05-27T10:52:04.732101+0000","last_fullsized":"2024-05-27T10:52:04.732101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:16.695502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.514731+0000","last_change":"2024-05-27T10:52:02.277391+0000","last_active":"2024-05-27T10:52:04.514731+0000","last_peered":"2024-05-27T10:52:04.514731+0000","last_clean":"2024-05-27T10:52:04.514731+0000","last_became_active":"2024-05-27T10:52:02.275623+0000","last_became_peered":"2024-05-27T10:52:02.275623+0000","last_unstale":"2024-05-27T10:52:04.514731+0000","last_undegraded":"2024-05-27T10:52:04.514731+0000","last_fullsized":"2024-05-27T10:52:04.514731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:31.231464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.278627+0000","last_change":"2024-05-27T10:52:02.278913+0000","last_active":"2024-05-27T10:52:03.278627+0000","last_peered":"2024-05-27T10:52:03.278627+0000","last_clean":"2024-05-27T10:52:03.278627+0000","last_became_active":"2024-05-27T10:52:02.278319+0000","last_became_peered":"2024-05-27T10:52:02.278319+0000","last_unstale":"2024-05-27T10:52:03.278627+0000","last_undegraded":"2024-05-27T10:52:03.278627+0000","last_fullsized":"2024-05-27T10:52:03.278627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:40:53.386645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.516097+0000","last_change":"2024-05-27T10:52:02.283688+0000","last_active":"2024-05-27T10:52:04.516097+0000","last_peered":"2024-05-27T10:52:04.516097+0000","last_clean":"2024-05-27T10:52:04.516097+0000","last_became_active":"2024-05-27T10:52:02.283284+0000","last_became_peered":"2024-05-27T10:52:02.283284+0000","last_unstale":"2024-05-27T10:52:04.516097+0000","last_undegraded":"2024-05-27T10:52:04.516097+0000","last_fullsized":"2024-05-27T10:52:04.516097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:13:00.624444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.265591+0000","last_change":"2024-05-27T10:52:02.272971+0000","last_active":"2024-05-27T10:52:04.265591+0000","last_peered":"2024-05-27T10:52:04.265591+0000","last_clean":"2024-05-27T10:52:04.265591+0000","last_became_active":"2024-05-27T10:52:02.272634+0000","last_became_peered":"2024-05-27T10:52:02.272634+0000","last_unstale":"2024-05-27T10:52:04.265591+0000","last_undegraded":"2024-05-27T10:52:04.265591+0000","last_fullsized":"2024-05-27T10:52:04.265591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:42:51.939151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.265184+0000","last_change":"2024-05-27T10:52:02.278290+0000","last_active":"2024-05-27T10:52:04.265184+0000","last_peered":"2024-05-27T10:52:04.265184+0000","last_clean":"2024-05-27T10:52:04.265184+0000","last_became_active":"2024-05-27T10:52:02.277971+0000","last_became_peered":"2024-05-27T10:52:02.277971+0000","last_unstale":"2024-05-27T10:52:04.265184+0000","last_undegraded":"2024-05-27T10:52:04.265184+0000","last_fullsized":"2024-05-27T10:52:04.265184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:16.695502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277196+0000","last_change":"2024-05-27T10:52:02.262321+0000","last_active":"2024-05-27T10:52:03.277196+0000","last_peered":"2024-05-27T10:52:03.277196+0000","last_clean":"2024-05-27T10:52:03.277196+0000","last_became_active":"2024-05-27T10:52:02.262012+0000","last_became_peered":"2024-05-27T10:52:02.262012+0000","last_unstale":"2024-05-27T10:52:03.277196+0000","last_undegraded":"2024-05-27T10:52:03.277196+0000","last_fullsized":"2024-05-27T10:52:03.277196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:27:26.831178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280146+0000","last_change":"2024-05-27T10:52:02.289470+0000","last_active":"2024-05-27T10:52:03.280146+0000","last_peered":"2024-05-27T10:52:03.280146+0000","last_clean":"2024-05-27T10:52:03.280146+0000","last_became_active":"2024-05-27T10:52:02.288616+0000","last_became_peered":"2024-05-27T10:52:02.288616+0000","last_unstale":"2024-05-27T10:52:03.280146+0000","last_undegraded":"2024-05-27T10:52:03.280146+0000","last_fullsized":"2024-05-27T10:52:03.280146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:42:51.939151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.276301+0000","last_change":"2024-05-27T10:52:02.282027+0000","last_active":"2024-05-27T10:52:03.276301+0000","last_peered":"2024-05-27T10:52:03.276301+0000","last_clean":"2024-05-27T10:52:03.276301+0000","last_became_active":"2024-05-27T10:52:02.281747+0000","last_became_peered":"2024-05-27T10:52:02.281747+0000","last_unstale":"2024-05-27T10:52:03.276301+0000","last_undegraded":"2024-05-27T10:52:03.276301+0000","last_fullsized":"2024-05-27T10:52:03.276301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:53:57.446525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.258570+0000","last_change":"2024-05-27T10:52:02.280351+0000","last_active":"2024-05-27T10:52:04.258570+0000","last_peered":"2024-05-27T10:52:04.258570+0000","last_clean":"2024-05-27T10:52:04.258570+0000","last_became_active":"2024-05-27T10:52:02.278207+0000","last_became_peered":"2024-05-27T10:52:02.278207+0000","last_unstale":"2024-05-27T10:52:04.258570+0000","last_undegraded":"2024-05-27T10:52:04.258570+0000","last_fullsized":"2024-05-27T10:52:04.258570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:44:14.946437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.732105+0000","last_change":"2024-05-27T10:52:02.280012+0000","last_active":"2024-05-27T10:52:04.732105+0000","last_peered":"2024-05-27T10:52:04.732105+0000","last_clean":"2024-05-27T10:52:04.732105+0000","last_became_active":"2024-05-27T10:52:02.279500+0000","last_became_peered":"2024-05-27T10:52:02.279500+0000","last_unstale":"2024-05-27T10:52:04.732105+0000","last_undegraded":"2024-05-27T10:52:04.732105+0000","last_fullsized":"2024-05-27T10:52:04.732105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:42:51.939151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.734125+0000","last_change":"2024-05-27T10:52:02.276006+0000","last_active":"2024-05-27T10:52:04.734125+0000","last_peered":"2024-05-27T10:52:04.734125+0000","last_clean":"2024-05-27T10:52:04.734125+0000","last_became_active":"2024-05-27T10:52:02.275602+0000","last_became_peered":"2024-05-27T10:52:02.275602+0000","last_unstale":"2024-05-27T10:52:04.734125+0000","last_undegraded":"2024-05-27T10:52:04.734125+0000","last_fullsized":"2024-05-27T10:52:04.734125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:28:50.347363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.731676+0000","last_change":"2024-05-27T10:52:02.287428+0000","last_active":"2024-05-27T10:52:04.731676+0000","last_peered":"2024-05-27T10:52:04.731676+0000","last_clean":"2024-05-27T10:52:04.731676+0000","last_became_active":"2024-05-27T10:52:02.285853+0000","last_became_peered":"2024-05-27T10:52:02.285853+0000","last_unstale":"2024-05-27T10:52:04.731676+0000","last_undegraded":"2024-05-27T10:52:04.731676+0000","last_fullsized":"2024-05-27T10:52:04.731676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:27:26.831178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.515417+0000","last_change":"2024-05-27T10:52:02.284355+0000","last_active":"2024-05-27T10:52:04.515417+0000","last_peered":"2024-05-27T10:52:04.515417+0000","last_clean":"2024-05-27T10:52:04.515417+0000","last_became_active":"2024-05-27T10:52:02.281949+0000","last_became_peered":"2024-05-27T10:52:02.281949+0000","last_unstale":"2024-05-27T10:52:04.515417+0000","last_undegraded":"2024-05-27T10:52:04.515417+0000","last_fullsized":"2024-05-27T10:52:04.515417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:58:41.336092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.264697+0000","last_change":"2024-05-27T10:52:02.274651+0000","last_active":"2024-05-27T10:52:04.264697+0000","last_peered":"2024-05-27T10:52:04.264697+0000","last_clean":"2024-05-27T10:52:04.264697+0000","last_became_active":"2024-05-27T10:52:02.273814+0000","last_became_peered":"2024-05-27T10:52:02.273814+0000","last_unstale":"2024-05-27T10:52:04.264697+0000","last_undegraded":"2024-05-27T10:52:04.264697+0000","last_fullsized":"2024-05-27T10:52:04.264697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:44:14.946437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.276941+0000","last_change":"2024-05-27T10:52:02.282039+0000","last_active":"2024-05-27T10:52:03.276941+0000","last_peered":"2024-05-27T10:52:03.276941+0000","last_clean":"2024-05-27T10:52:03.276941+0000","last_became_active":"2024-05-27T10:52:02.281761+0000","last_became_peered":"2024-05-27T10:52:02.281761+0000","last_unstale":"2024-05-27T10:52:03.276941+0000","last_undegraded":"2024-05-27T10:52:03.276941+0000","last_fullsized":"2024-05-27T10:52:03.276941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:45.783380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.732360+0000","last_change":"2024-05-27T10:52:02.276287+0000","last_active":"2024-05-27T10:52:04.732360+0000","last_peered":"2024-05-27T10:52:04.732360+0000","last_clean":"2024-05-27T10:52:04.732360+0000","last_became_active":"2024-05-27T10:52:02.275681+0000","last_became_peered":"2024-05-27T10:52:02.275681+0000","last_unstale":"2024-05-27T10:52:04.732360+0000","last_undegraded":"2024-05-27T10:52:04.732360+0000","last_fullsized":"2024-05-27T10:52:04.732360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:21:45.050385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.278852+0000","last_change":"2024-05-27T10:52:02.282775+0000","last_active":"2024-05-27T10:52:03.278852+0000","last_peered":"2024-05-27T10:52:03.278852+0000","last_clean":"2024-05-27T10:52:03.278852+0000","last_became_active":"2024-05-27T10:52:02.282279+0000","last_became_peered":"2024-05-27T10:52:02.282279+0000","last_unstale":"2024-05-27T10:52:03.278852+0000","last_undegraded":"2024-05-27T10:52:03.278852+0000","last_fullsized":"2024-05-27T10:52:03.278852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:44:14.946437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.732270+0000","last_change":"2024-05-27T10:52:02.281520+0000","last_active":"2024-05-27T10:52:04.732270+0000","last_peered":"2024-05-27T10:52:04.732270+0000","last_clean":"2024-05-27T10:52:04.732270+0000","last_became_active":"2024-05-27T10:52:02.281199+0000","last_became_peered":"2024-05-27T10:52:02.281199+0000","last_unstale":"2024-05-27T10:52:04.732270+0000","last_undegraded":"2024-05-27T10:52:04.732270+0000","last_fullsized":"2024-05-27T10:52:04.732270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:00.463147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280858+0000","last_change":"2024-05-27T10:52:02.280042+0000","last_active":"2024-05-27T10:52:03.280858+0000","last_peered":"2024-05-27T10:52:03.280858+0000","last_clean":"2024-05-27T10:52:03.280858+0000","last_became_active":"2024-05-27T10:52:02.279664+0000","last_became_peered":"2024-05-27T10:52:02.279664+0000","last_unstale":"2024-05-27T10:52:03.280858+0000","last_undegraded":"2024-05-27T10:52:03.280858+0000","last_fullsized":"2024-05-27T10:52:03.280858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:31.231464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.265779+0000","last_change":"2024-05-27T10:52:02.286086+0000","last_active":"2024-05-27T10:52:04.265779+0000","last_peered":"2024-05-27T10:52:04.265779+0000","last_clean":"2024-05-27T10:52:04.265779+0000","last_became_active":"2024-05-27T10:52:02.285764+0000","last_became_peered":"2024-05-27T10:52:02.285764+0000","last_unstale":"2024-05-27T10:52:04.265779+0000","last_undegraded":"2024-05-27T10:52:04.265779+0000","last_fullsized":"2024-05-27T10:52:04.265779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:00.463147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.259023+0000","last_change":"2024-05-27T10:52:02.291922+0000","last_active":"2024-05-27T10:52:04.259023+0000","last_peered":"2024-05-27T10:52:04.259023+0000","last_clean":"2024-05-27T10:52:04.259023+0000","last_became_active":"2024-05-27T10:52:02.291600+0000","last_became_peered":"2024-05-27T10:52:02.291600+0000","last_unstale":"2024-05-27T10:52:04.259023+0000","last_undegraded":"2024-05-27T10:52:04.259023+0000","last_fullsized":"2024-05-27T10:52:04.259023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:42:51.939151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280251+0000","last_change":"2024-05-27T10:52:02.283531+0000","last_active":"2024-05-27T10:52:03.280251+0000","last_peered":"2024-05-27T10:52:03.280251+0000","last_clean":"2024-05-27T10:52:03.280251+0000","last_became_active":"2024-05-27T10:52:02.283298+0000","last_became_peered":"2024-05-27T10:52:02.283298+0000","last_unstale":"2024-05-27T10:52:03.280251+0000","last_undegraded":"2024-05-27T10:52:03.280251+0000","last_fullsized":"2024-05-27T10:52:03.280251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:00.463147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277113+0000","last_change":"2024-05-27T10:52:02.290718+0000","last_active":"2024-05-27T10:52:03.277113+0000","last_peered":"2024-05-27T10:52:03.277113+0000","last_clean":"2024-05-27T10:52:03.277113+0000","last_became_active":"2024-05-27T10:52:02.290410+0000","last_became_peered":"2024-05-27T10:52:02.290410+0000","last_unstale":"2024-05-27T10:52:03.277113+0000","last_undegraded":"2024-05-27T10:52:03.277113+0000","last_fullsized":"2024-05-27T10:52:03.277113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:40:53.386645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.732845+0000","last_change":"2024-05-27T10:52:02.282494+0000","last_active":"2024-05-27T10:52:04.732845+0000","last_peered":"2024-05-27T10:52:04.732845+0000","last_clean":"2024-05-27T10:52:04.732845+0000","last_became_active":"2024-05-27T10:52:02.280254+0000","last_became_peered":"2024-05-27T10:52:02.280254+0000","last_unstale":"2024-05-27T10:52:04.732845+0000","last_undegraded":"2024-05-27T10:52:04.732845+0000","last_fullsized":"2024-05-27T10:52:04.732845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:31.231464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.731448+0000","last_change":"2024-05-27T10:52:02.267415+0000","last_active":"2024-05-27T10:52:04.731448+0000","last_peered":"2024-05-27T10:52:04.731448+0000","last_clean":"2024-05-27T10:52:04.731448+0000","last_became_active":"2024-05-27T10:52:02.266959+0000","last_became_peered":"2024-05-27T10:52:02.266959+0000","last_unstale":"2024-05-27T10:52:04.731448+0000","last_undegraded":"2024-05-27T10:52:04.731448+0000","last_fullsized":"2024-05-27T10:52:04.731448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:33:58.197155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.264365+0000","last_change":"2024-05-27T10:52:02.285006+0000","last_active":"2024-05-27T10:52:04.264365+0000","last_peered":"2024-05-27T10:52:04.264365+0000","last_clean":"2024-05-27T10:52:04.264365+0000","last_became_active":"2024-05-27T10:52:02.284596+0000","last_became_peered":"2024-05-27T10:52:02.284596+0000","last_unstale":"2024-05-27T10:52:04.264365+0000","last_undegraded":"2024-05-27T10:52:04.264365+0000","last_fullsized":"2024-05-27T10:52:04.264365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:40:53.386645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277028+0000","last_change":"2024-05-27T10:52:02.287164+0000","last_active":"2024-05-27T10:52:03.277028+0000","last_peered":"2024-05-27T10:52:03.277028+0000","last_clean":"2024-05-27T10:52:03.277028+0000","last_became_active":"2024-05-27T10:52:02.280960+0000","last_became_peered":"2024-05-27T10:52:02.280960+0000","last_unstale":"2024-05-27T10:52:03.277028+0000","last_undegraded":"2024-05-27T10:52:03.277028+0000","last_fullsized":"2024-05-27T10:52:03.277028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:27:23.976804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280920+0000","last_change":"2024-05-27T10:52:01.235575+0000","last_active":"2024-05-27T10:52:03.280920+0000","last_peered":"2024-05-27T10:52:03.280920+0000","last_clean":"2024-05-27T10:52:03.280920+0000","last_became_active":"2024-05-27T10:52:01.235262+0000","last_became_peered":"2024-05-27T10:52:01.235262+0000","last_unstale":"2024-05-27T10:52:03.280920+0000","last_undegraded":"2024-05-27T10:52:03.280920+0000","last_fullsized":"2024-05-27T10:52:03.280920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:48:32.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277302+0000","last_change":"2024-05-27T10:52:02.280538+0000","last_active":"2024-05-27T10:52:03.277302+0000","last_peered":"2024-05-27T10:52:03.277302+0000","last_clean":"2024-05-27T10:52:03.277302+0000","last_became_active":"2024-05-27T10:52:02.279400+0000","last_became_peered":"2024-05-27T10:52:02.279400+0000","last_unstale":"2024-05-27T10:52:03.277302+0000","last_undegraded":"2024-05-27T10:52:03.277302+0000","last_fullsized":"2024-05-27T10:52:03.277302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:49.993062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.264539+0000","last_change":"2024-05-27T10:52:01.237296+0000","last_active":"2024-05-27T10:52:04.264539+0000","last_peered":"2024-05-27T10:52:04.264539+0000","last_clean":"2024-05-27T10:52:04.264539+0000","last_became_active":"2024-05-27T10:52:01.236981+0000","last_became_peered":"2024-05-27T10:52:01.236981+0000","last_unstale":"2024-05-27T10:52:04.264539+0000","last_undegraded":"2024-05-27T10:52:04.264539+0000","last_fullsized":"2024-05-27T10:52:04.264539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:48:32.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279087+0000","last_change":"2024-05-27T10:52:01.228043+0000","last_active":"2024-05-27T10:52:03.279087+0000","last_peered":"2024-05-27T10:52:03.279087+0000","last_clean":"2024-05-27T10:52:03.279087+0000","last_became_active":"2024-05-27T10:52:01.227737+0000","last_became_peered":"2024-05-27T10:52:01.227737+0000","last_unstale":"2024-05-27T10:52:03.279087+0000","last_undegraded":"2024-05-27T10:52:03.279087+0000","last_fullsized":"2024-05-27T10:52:03.279087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:48:09.492465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.278823+0000","last_change":"2024-05-27T10:52:02.281578+0000","last_active":"2024-05-27T10:52:03.278823+0000","last_peered":"2024-05-27T10:52:03.278823+0000","last_clean":"2024-05-27T10:52:03.278823+0000","last_became_active":"2024-05-27T10:52:02.280978+0000","last_became_peered":"2024-05-27T10:52:02.280978+0000","last_unstale":"2024-05-27T10:52:03.278823+0000","last_undegraded":"2024-05-27T10:52:03.278823+0000","last_fullsized":"2024-05-27T10:52:03.278823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:49.993062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.732465+0000","last_change":"2024-05-27T10:52:01.248022+0000","last_active":"2024-05-27T10:52:04.732465+0000","last_peered":"2024-05-27T10:52:04.732465+0000","last_clean":"2024-05-27T10:52:04.732465+0000","last_became_active":"2024-05-27T10:52:01.244891+0000","last_became_peered":"2024-05-27T10:52:01.244891+0000","last_unstale":"2024-05-27T10:52:04.732465+0000","last_undegraded":"2024-05-27T10:52:04.732465+0000","last_fullsized":"2024-05-27T10:52:04.732465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:48:09.492465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.258547+0000","last_change":"2024-05-27T10:52:02.281087+0000","last_active":"2024-05-27T10:52:04.258547+0000","last_peered":"2024-05-27T10:52:04.258547+0000","last_clean":"2024-05-27T10:52:04.258547+0000","last_became_active":"2024-05-27T10:52:02.280786+0000","last_became_peered":"2024-05-27T10:52:02.280786+0000","last_unstale":"2024-05-27T10:52:04.258547+0000","last_undegraded":"2024-05-27T10:52:04.258547+0000","last_fullsized":"2024-05-27T10:52:04.258547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:49.993062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.265249+0000","last_change":"2024-05-27T10:52:01.245539+0000","last_active":"2024-05-27T10:52:04.265249+0000","last_peered":"2024-05-27T10:52:04.265249+0000","last_clean":"2024-05-27T10:52:04.265249+0000","last_became_active":"2024-05-27T10:52:01.245210+0000","last_became_peered":"2024-05-27T10:52:01.245210+0000","last_unstale":"2024-05-27T10:52:04.265249+0000","last_undegraded":"2024-05-27T10:52:04.265249+0000","last_fullsized":"2024-05-27T10:52:04.265249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:05.650946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.733021+0000","last_change":"2024-05-27T10:52:02.282228+0000","last_active":"2024-05-27T10:52:04.733021+0000","last_peered":"2024-05-27T10:52:04.733021+0000","last_clean":"2024-05-27T10:52:04.733021+0000","last_became_active":"2024-05-27T10:52:02.281907+0000","last_became_peered":"2024-05-27T10:52:02.281907+0000","last_unstale":"2024-05-27T10:52:04.733021+0000","last_undegraded":"2024-05-27T10:52:04.733021+0000","last_fullsized":"2024-05-27T10:52:04.733021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:29:36.704067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.732958+0000","last_change":"2024-05-27T10:52:01.243305+0000","last_active":"2024-05-27T10:52:04.732958+0000","last_peered":"2024-05-27T10:52:04.732958+0000","last_clean":"2024-05-27T10:52:04.732958+0000","last_became_active":"2024-05-27T10:52:01.242940+0000","last_became_peered":"2024-05-27T10:52:01.242940+0000","last_unstale":"2024-05-27T10:52:04.732958+0000","last_undegraded":"2024-05-27T10:52:04.732958+0000","last_fullsized":"2024-05-27T10:52:04.732958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:14.495142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279248+0000","last_change":"2024-05-27T10:52:02.267283+0000","last_active":"2024-05-27T10:52:03.279248+0000","last_peered":"2024-05-27T10:52:03.279248+0000","last_clean":"2024-05-27T10:52:03.279248+0000","last_became_active":"2024-05-27T10:52:02.266747+0000","last_became_peered":"2024-05-27T10:52:02.266747+0000","last_unstale":"2024-05-27T10:52:03.279248+0000","last_undegraded":"2024-05-27T10:52:03.279248+0000","last_fullsized":"2024-05-27T10:52:03.279248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:16.695502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.258960+0000","last_change":"2024-05-27T10:52:01.233507+0000","last_active":"2024-05-27T10:52:04.258960+0000","last_peered":"2024-05-27T10:52:04.258960+0000","last_clean":"2024-05-27T10:52:04.258960+0000","last_became_active":"2024-05-27T10:52:01.233204+0000","last_became_peered":"2024-05-27T10:52:01.233204+0000","last_unstale":"2024-05-27T10:52:04.258960+0000","last_undegraded":"2024-05-27T10:52:04.258960+0000","last_fullsized":"2024-05-27T10:52:04.258960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:27:25.826446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277331+0000","last_change":"2024-05-27T10:52:02.279589+0000","last_active":"2024-05-27T10:52:03.277331+0000","last_peered":"2024-05-27T10:52:03.277331+0000","last_clean":"2024-05-27T10:52:03.277331+0000","last_became_active":"2024-05-27T10:52:02.276985+0000","last_became_peered":"2024-05-27T10:52:02.276985+0000","last_unstale":"2024-05-27T10:52:03.277331+0000","last_undegraded":"2024-05-27T10:52:03.277331+0000","last_fullsized":"2024-05-27T10:52:03.277331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:33:58.197155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.264669+0000","last_change":"2024-05-27T10:52:01.235144+0000","last_active":"2024-05-27T10:52:04.264669+0000","last_peered":"2024-05-27T10:52:04.264669+0000","last_clean":"2024-05-27T10:52:04.264669+0000","last_became_active":"2024-05-27T10:52:01.234380+0000","last_became_peered":"2024-05-27T10:52:01.234380+0000","last_unstale":"2024-05-27T10:52:04.264669+0000","last_undegraded":"2024-05-27T10:52:04.264669+0000","last_fullsized":"2024-05-27T10:52:04.264669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:14.495142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.515273+0000","last_change":"2024-05-27T10:52:02.293987+0000","last_active":"2024-05-27T10:52:04.515273+0000","last_peered":"2024-05-27T10:52:04.515273+0000","last_clean":"2024-05-27T10:52:04.515273+0000","last_became_active":"2024-05-27T10:52:02.293646+0000","last_became_peered":"2024-05-27T10:52:02.293646+0000","last_unstale":"2024-05-27T10:52:04.515273+0000","last_undegraded":"2024-05-27T10:52:04.515273+0000","last_fullsized":"2024-05-27T10:52:04.515273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:57:19.835567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277453+0000","last_change":"2024-05-27T10:52:01.231147+0000","last_active":"2024-05-27T10:52:03.277453+0000","last_peered":"2024-05-27T10:52:03.277453+0000","last_clean":"2024-05-27T10:52:03.277453+0000","last_became_active":"2024-05-27T10:52:01.230902+0000","last_became_peered":"2024-05-27T10:52:01.230902+0000","last_unstale":"2024-05-27T10:52:03.277453+0000","last_undegraded":"2024-05-27T10:52:03.277453+0000","last_fullsized":"2024-05-27T10:52:03.277453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:29:30.495775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.276473+0000","last_change":"2024-05-27T10:52:02.260644+0000","last_active":"2024-05-27T10:52:03.276473+0000","last_peered":"2024-05-27T10:52:03.276473+0000","last_clean":"2024-05-27T10:52:03.276473+0000","last_became_active":"2024-05-27T10:52:02.260329+0000","last_became_peered":"2024-05-27T10:52:02.260329+0000","last_unstale":"2024-05-27T10:52:03.276473+0000","last_undegraded":"2024-05-27T10:52:03.276473+0000","last_fullsized":"2024-05-27T10:52:03.276473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:25:10.287509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.732874+0000","last_change":"2024-05-27T10:52:01.239325+0000","last_active":"2024-05-27T10:52:04.732874+0000","last_peered":"2024-05-27T10:52:04.732874+0000","last_clean":"2024-05-27T10:52:04.732874+0000","last_became_active":"2024-05-27T10:52:01.239049+0000","last_became_peered":"2024-05-27T10:52:01.239049+0000","last_unstale":"2024-05-27T10:52:04.732874+0000","last_undegraded":"2024-05-27T10:52:04.732874+0000","last_fullsized":"2024-05-27T10:52:04.732874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:23:24.648014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.515002+0000","last_change":"2024-05-27T10:52:02.292008+0000","last_active":"2024-05-27T10:52:04.515002+0000","last_peered":"2024-05-27T10:52:04.515002+0000","last_clean":"2024-05-27T10:52:04.515002+0000","last_became_active":"2024-05-27T10:52:02.289668+0000","last_became_peered":"2024-05-27T10:52:02.289668+0000","last_unstale":"2024-05-27T10:52:04.515002+0000","last_undegraded":"2024-05-27T10:52:04.515002+0000","last_fullsized":"2024-05-27T10:52:04.515002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:29:36.704067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.264213+0000","last_change":"2024-05-27T10:52:01.241305+0000","last_active":"2024-05-27T10:52:04.264213+0000","last_peered":"2024-05-27T10:52:04.264213+0000","last_clean":"2024-05-27T10:52:04.264213+0000","last_became_active":"2024-05-27T10:52:01.240944+0000","last_became_peered":"2024-05-27T10:52:01.240944+0000","last_unstale":"2024-05-27T10:52:04.264213+0000","last_undegraded":"2024-05-27T10:52:04.264213+0000","last_fullsized":"2024-05-27T10:52:04.264213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:23:24.648014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.264380+0000","last_change":"2024-05-27T10:52:02.283944+0000","last_active":"2024-05-27T10:52:04.264380+0000","last_peered":"2024-05-27T10:52:04.264380+0000","last_clean":"2024-05-27T10:52:04.264380+0000","last_became_active":"2024-05-27T10:52:02.283395+0000","last_became_peered":"2024-05-27T10:52:02.283395+0000","last_unstale":"2024-05-27T10:52:04.264380+0000","last_undegraded":"2024-05-27T10:52:04.264380+0000","last_fullsized":"2024-05-27T10:52:04.264380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:49.993062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.731241+0000","last_change":"2024-05-27T10:52:01.219153+0000","last_active":"2024-05-27T10:52:04.731241+0000","last_peered":"2024-05-27T10:52:04.731241+0000","last_clean":"2024-05-27T10:52:04.731241+0000","last_became_active":"2024-05-27T10:52:01.218818+0000","last_became_peered":"2024-05-27T10:52:01.218818+0000","last_unstale":"2024-05-27T10:52:04.731241+0000","last_undegraded":"2024-05-27T10:52:04.731241+0000","last_fullsized":"2024-05-27T10:52:04.731241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:48:09.492465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.514717+0000","last_change":"2024-05-27T10:52:02.292446+0000","last_active":"2024-05-27T10:52:04.514717+0000","last_peered":"2024-05-27T10:52:04.514717+0000","last_clean":"2024-05-27T10:52:04.514717+0000","last_became_active":"2024-05-27T10:52:02.289784+0000","last_became_peered":"2024-05-27T10:52:02.289784+0000","last_unstale":"2024-05-27T10:52:04.514717+0000","last_undegraded":"2024-05-27T10:52:04.514717+0000","last_fullsized":"2024-05-27T10:52:04.514717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:54:56.167515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277731+0000","last_change":"2024-05-27T10:52:01.222520+0000","last_active":"2024-05-27T10:52:03.277731+0000","last_peered":"2024-05-27T10:52:03.277731+0000","last_clean":"2024-05-27T10:52:03.277731+0000","last_became_active":"2024-05-27T10:52:01.220852+0000","last_became_peered":"2024-05-27T10:52:01.220852+0000","last_unstale":"2024-05-27T10:52:03.277731+0000","last_undegraded":"2024-05-27T10:52:03.277731+0000","last_fullsized":"2024-05-27T10:52:03.277731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:29:30.495775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.515709+0000","last_change":"2024-05-27T10:52:02.288608+0000","last_active":"2024-05-27T10:52:04.515709+0000","last_peered":"2024-05-27T10:52:04.515709+0000","last_clean":"2024-05-27T10:52:04.515709+0000","last_became_active":"2024-05-27T10:52:02.288214+0000","last_became_peered":"2024-05-27T10:52:02.288214+0000","last_unstale":"2024-05-27T10:52:04.515709+0000","last_undegraded":"2024-05-27T10:52:04.515709+0000","last_fullsized":"2024-05-27T10:52:04.515709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:28:50.347363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.731913+0000","last_change":"2024-05-27T10:52:01.225974+0000","last_active":"2024-05-27T10:52:04.731913+0000","last_peered":"2024-05-27T10:52:04.731913+0000","last_clean":"2024-05-27T10:52:04.731913+0000","last_became_active":"2024-05-27T10:52:01.225654+0000","last_became_peered":"2024-05-27T10:52:01.225654+0000","last_unstale":"2024-05-27T10:52:04.731913+0000","last_undegraded":"2024-05-27T10:52:04.731913+0000","last_fullsized":"2024-05-27T10:52:04.731913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:05.650946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.516270+0000","last_change":"2024-05-27T10:52:02.290951+0000","last_active":"2024-05-27T10:52:04.516270+0000","last_peered":"2024-05-27T10:52:04.516270+0000","last_clean":"2024-05-27T10:52:04.516270+0000","last_became_active":"2024-05-27T10:52:02.290085+0000","last_became_peered":"2024-05-27T10:52:02.290085+0000","last_unstale":"2024-05-27T10:52:04.516270+0000","last_undegraded":"2024-05-27T10:52:04.516270+0000","last_fullsized":"2024-05-27T10:52:04.516270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:24:59.656630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.259413+0000","last_change":"2024-05-27T10:52:01.225320+0000","last_active":"2024-05-27T10:52:04.259413+0000","last_peered":"2024-05-27T10:52:04.259413+0000","last_clean":"2024-05-27T10:52:04.259413+0000","last_became_active":"2024-05-27T10:52:01.224972+0000","last_became_peered":"2024-05-27T10:52:01.224972+0000","last_unstale":"2024-05-27T10:52:04.259413+0000","last_undegraded":"2024-05-27T10:52:04.259413+0000","last_fullsized":"2024-05-27T10:52:04.259413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:33:57.192424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.733258+0000","last_change":"2024-05-27T10:52:02.287807+0000","last_active":"2024-05-27T10:52:04.733258+0000","last_peered":"2024-05-27T10:52:04.733258+0000","last_clean":"2024-05-27T10:52:04.733258+0000","last_became_active":"2024-05-27T10:52:02.279989+0000","last_became_peered":"2024-05-27T10:52:02.279989+0000","last_unstale":"2024-05-27T10:52:04.733258+0000","last_undegraded":"2024-05-27T10:52:04.733258+0000","last_fullsized":"2024-05-27T10:52:04.733258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:57:19.835567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.731751+0000","last_change":"2024-05-27T10:52:01.232798+0000","last_active":"2024-05-27T10:52:04.731751+0000","last_peered":"2024-05-27T10:52:04.731751+0000","last_clean":"2024-05-27T10:52:04.731751+0000","last_became_active":"2024-05-27T10:52:01.232491+0000","last_became_peered":"2024-05-27T10:52:01.232491+0000","last_unstale":"2024-05-27T10:52:04.731751+0000","last_undegraded":"2024-05-27T10:52:04.731751+0000","last_fullsized":"2024-05-27T10:52:04.731751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:23:24.648014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.515209+0000","last_change":"2024-05-27T10:52:02.282343+0000","last_active":"2024-05-27T10:52:04.515209+0000","last_peered":"2024-05-27T10:52:04.515209+0000","last_clean":"2024-05-27T10:52:04.515209+0000","last_became_active":"2024-05-27T10:52:02.276307+0000","last_became_peered":"2024-05-27T10:52:02.276307+0000","last_unstale":"2024-05-27T10:52:04.515209+0000","last_undegraded":"2024-05-27T10:52:04.515209+0000","last_fullsized":"2024-05-27T10:52:04.515209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:51:20.034826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.514340+0000","last_change":"2024-05-27T10:51:56.473671+0000","last_active":"2024-05-27T10:52:04.514340+0000","last_peered":"2024-05-27T10:52:04.514340+0000","last_clean":"2024-05-27T10:52:04.514340+0000","last_became_active":"2024-05-27T10:51:56.470561+0000","last_became_peered":"2024-05-27T10:51:56.470561+0000","last_unstale":"2024-05-27T10:52:04.514340+0000","last_undegraded":"2024-05-27T10:52:04.514340+0000","last_fullsized":"2024-05-27T10:52:04.514340+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:51:55.105404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:51:55.105404+0000","last_clean_scrub_stamp":"2024-05-27T10:51:55.105404+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:20:59.737450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.731982+0000","last_change":"2024-05-27T10:52:01.233385+0000","last_active":"2024-05-27T10:52:04.731982+0000","last_peered":"2024-05-27T10:52:04.731982+0000","last_clean":"2024-05-27T10:52:04.731982+0000","last_became_active":"2024-05-27T10:52:01.233015+0000","last_became_peered":"2024-05-27T10:52:01.233015+0000","last_unstale":"2024-05-27T10:52:04.731982+0000","last_undegraded":"2024-05-27T10:52:04.731982+0000","last_fullsized":"2024-05-27T10:52:04.731982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:48:32.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279697+0000","last_change":"2024-05-27T10:52:02.280478+0000","last_active":"2024-05-27T10:52:03.279697+0000","last_peered":"2024-05-27T10:52:03.279697+0000","last_clean":"2024-05-27T10:52:03.279697+0000","last_became_active":"2024-05-27T10:52:02.280072+0000","last_became_peered":"2024-05-27T10:52:02.280072+0000","last_unstale":"2024-05-27T10:52:03.279697+0000","last_undegraded":"2024-05-27T10:52:03.279697+0000","last_fullsized":"2024-05-27T10:52:03.279697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:16.695502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.514592+0000","last_change":"2024-05-27T10:52:01.236067+0000","last_active":"2024-05-27T10:52:04.514592+0000","last_peered":"2024-05-27T10:52:04.514592+0000","last_clean":"2024-05-27T10:52:04.514592+0000","last_became_active":"2024-05-27T10:52:01.235753+0000","last_became_peered":"2024-05-27T10:52:01.235753+0000","last_unstale":"2024-05-27T10:52:04.514592+0000","last_undegraded":"2024-05-27T10:52:04.514592+0000","last_fullsized":"2024-05-27T10:52:04.514592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:27:22.972073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.276349+0000","last_change":"2024-05-27T10:52:02.273061+0000","last_active":"2024-05-27T10:52:03.276349+0000","last_peered":"2024-05-27T10:52:03.276349+0000","last_clean":"2024-05-27T10:52:03.276349+0000","last_became_active":"2024-05-27T10:52:02.272736+0000","last_became_peered":"2024-05-27T10:52:02.272736+0000","last_unstale":"2024-05-27T10:52:03.276349+0000","last_undegraded":"2024-05-27T10:52:03.276349+0000","last_fullsized":"2024-05-27T10:52:03.276349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:09:36.642477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.731453+0000","last_change":"2024-05-27T10:52:01.226812+0000","last_active":"2024-05-27T10:52:04.731453+0000","last_peered":"2024-05-27T10:52:04.731453+0000","last_clean":"2024-05-27T10:52:04.731453+0000","last_became_active":"2024-05-27T10:52:01.226522+0000","last_became_peered":"2024-05-27T10:52:01.226522+0000","last_unstale":"2024-05-27T10:52:04.731453+0000","last_undegraded":"2024-05-27T10:52:04.731453+0000","last_fullsized":"2024-05-27T10:52:04.731453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:48:32.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.258693+0000","last_change":"2024-05-27T10:52:02.276340+0000","last_active":"2024-05-27T10:52:04.258693+0000","last_peered":"2024-05-27T10:52:04.258693+0000","last_clean":"2024-05-27T10:52:04.258693+0000","last_became_active":"2024-05-27T10:52:02.271466+0000","last_became_peered":"2024-05-27T10:52:02.271466+0000","last_unstale":"2024-05-27T10:52:04.258693+0000","last_undegraded":"2024-05-27T10:52:04.258693+0000","last_fullsized":"2024-05-27T10:52:04.258693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:16:52.089775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.733239+0000","last_change":"2024-05-27T10:52:01.235283+0000","last_active":"2024-05-27T10:52:04.733239+0000","last_peered":"2024-05-27T10:52:04.733239+0000","last_clean":"2024-05-27T10:52:04.733239+0000","last_became_active":"2024-05-27T10:52:01.233138+0000","last_became_peered":"2024-05-27T10:52:01.233138+0000","last_unstale":"2024-05-27T10:52:04.733239+0000","last_undegraded":"2024-05-27T10:52:04.733239+0000","last_fullsized":"2024-05-27T10:52:04.733239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:05.650946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.276992+0000","last_change":"2024-05-27T10:52:02.264256+0000","last_active":"2024-05-27T10:52:03.276992+0000","last_peered":"2024-05-27T10:52:03.276992+0000","last_clean":"2024-05-27T10:52:03.276992+0000","last_became_active":"2024-05-27T10:52:02.263953+0000","last_became_peered":"2024-05-27T10:52:02.263953+0000","last_unstale":"2024-05-27T10:52:03.276992+0000","last_undegraded":"2024-05-27T10:52:03.276992+0000","last_fullsized":"2024-05-27T10:52:03.276992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:15.499873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.259273+0000","last_change":"2024-05-27T10:52:01.222208+0000","last_active":"2024-05-27T10:52:04.259273+0000","last_peered":"2024-05-27T10:52:04.259273+0000","last_clean":"2024-05-27T10:52:04.259273+0000","last_became_active":"2024-05-27T10:52:01.221874+0000","last_became_peered":"2024-05-27T10:52:01.221874+0000","last_unstale":"2024-05-27T10:52:04.259273+0000","last_undegraded":"2024-05-27T10:52:04.259273+0000","last_fullsized":"2024-05-27T10:52:04.259273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:05.650946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.733228+0000","last_change":"2024-05-27T10:52:02.295182+0000","last_active":"2024-05-27T10:52:04.733228+0000","last_peered":"2024-05-27T10:52:04.733228+0000","last_clean":"2024-05-27T10:52:04.733228+0000","last_became_active":"2024-05-27T10:52:02.294854+0000","last_became_peered":"2024-05-27T10:52:02.294854+0000","last_unstale":"2024-05-27T10:52:04.733228+0000","last_undegraded":"2024-05-27T10:52:04.733228+0000","last_fullsized":"2024-05-27T10:52:04.733228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:51:20.034826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.515449+0000","last_change":"2024-05-27T10:52:01.239554+0000","last_active":"2024-05-27T10:52:04.515449+0000","last_peered":"2024-05-27T10:52:04.515449+0000","last_clean":"2024-05-27T10:52:04.515449+0000","last_became_active":"2024-05-27T10:52:01.239267+0000","last_became_peered":"2024-05-27T10:52:01.239267+0000","last_unstale":"2024-05-27T10:52:04.515449+0000","last_undegraded":"2024-05-27T10:52:04.515449+0000","last_fullsized":"2024-05-27T10:52:04.515449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:53:56.441794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.258942+0000","last_change":"2024-05-27T10:52:02.262458+0000","last_active":"2024-05-27T10:52:04.258942+0000","last_peered":"2024-05-27T10:52:04.258942+0000","last_clean":"2024-05-27T10:52:04.258942+0000","last_became_active":"2024-05-27T10:52:02.262132+0000","last_became_peered":"2024-05-27T10:52:02.262132+0000","last_unstale":"2024-05-27T10:52:04.258942+0000","last_undegraded":"2024-05-27T10:52:04.258942+0000","last_fullsized":"2024-05-27T10:52:04.258942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:16.695502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.259243+0000","last_change":"2024-05-27T10:52:01.236168+0000","last_active":"2024-05-27T10:52:04.259243+0000","last_peered":"2024-05-27T10:52:04.259243+0000","last_clean":"2024-05-27T10:52:04.259243+0000","last_became_active":"2024-05-27T10:52:01.235905+0000","last_became_peered":"2024-05-27T10:52:01.235905+0000","last_unstale":"2024-05-27T10:52:04.259243+0000","last_undegraded":"2024-05-27T10:52:04.259243+0000","last_fullsized":"2024-05-27T10:52:04.259243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:49:03.555502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.281064+0000","last_change":"2024-05-27T10:52:02.293533+0000","last_active":"2024-05-27T10:52:03.281064+0000","last_peered":"2024-05-27T10:52:03.281064+0000","last_clean":"2024-05-27T10:52:03.281064+0000","last_became_active":"2024-05-27T10:52:02.293231+0000","last_became_peered":"2024-05-27T10:52:02.293231+0000","last_unstale":"2024-05-27T10:52:03.281064+0000","last_undegraded":"2024-05-27T10:52:03.281064+0000","last_fullsized":"2024-05-27T10:52:03.281064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:28:35.769753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.265413+0000","last_change":"2024-05-27T10:52:01.246200+0000","last_active":"2024-05-27T10:52:04.265413+0000","last_peered":"2024-05-27T10:52:04.265413+0000","last_clean":"2024-05-27T10:52:04.265413+0000","last_became_active":"2024-05-27T10:52:01.245916+0000","last_became_peered":"2024-05-27T10:52:01.245916+0000","last_unstale":"2024-05-27T10:52:04.265413+0000","last_undegraded":"2024-05-27T10:52:04.265413+0000","last_fullsized":"2024-05-27T10:52:04.265413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:27:22.972073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.278458+0000","last_change":"2024-05-27T10:52:02.265328+0000","last_active":"2024-05-27T10:52:03.278458+0000","last_peered":"2024-05-27T10:52:03.278458+0000","last_clean":"2024-05-27T10:52:03.278458+0000","last_became_active":"2024-05-27T10:52:02.264120+0000","last_became_peered":"2024-05-27T10:52:02.264120+0000","last_unstale":"2024-05-27T10:52:03.278458+0000","last_undegraded":"2024-05-27T10:52:03.278458+0000","last_fullsized":"2024-05-27T10:52:03.278458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:16:52.089775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.514535+0000","last_change":"2024-05-27T10:52:01.238998+0000","last_active":"2024-05-27T10:52:04.514535+0000","last_peered":"2024-05-27T10:52:04.514535+0000","last_clean":"2024-05-27T10:52:04.514535+0000","last_became_active":"2024-05-27T10:52:01.238680+0000","last_became_peered":"2024-05-27T10:52:01.238680+0000","last_unstale":"2024-05-27T10:52:04.514535+0000","last_undegraded":"2024-05-27T10:52:04.514535+0000","last_fullsized":"2024-05-27T10:52:04.514535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:14.495142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277000+0000","last_change":"2024-05-27T10:52:02.269095+0000","last_active":"2024-05-27T10:52:03.277000+0000","last_peered":"2024-05-27T10:52:03.277000+0000","last_clean":"2024-05-27T10:52:03.277000+0000","last_became_active":"2024-05-27T10:52:02.267910+0000","last_became_peered":"2024-05-27T10:52:02.267910+0000","last_unstale":"2024-05-27T10:52:03.277000+0000","last_undegraded":"2024-05-27T10:52:03.277000+0000","last_fullsized":"2024-05-27T10:52:03.277000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:06.655677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.258839+0000","last_change":"2024-05-27T10:52:01.234993+0000","last_active":"2024-05-27T10:52:04.258839+0000","last_peered":"2024-05-27T10:52:04.258839+0000","last_clean":"2024-05-27T10:52:04.258839+0000","last_became_active":"2024-05-27T10:52:01.234648+0000","last_became_peered":"2024-05-27T10:52:01.234648+0000","last_unstale":"2024-05-27T10:52:04.258839+0000","last_undegraded":"2024-05-27T10:52:04.258839+0000","last_fullsized":"2024-05-27T10:52:04.258839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:27:22.972073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279043+0000","last_change":"2024-05-27T10:52:02.288778+0000","last_active":"2024-05-27T10:52:03.279043+0000","last_peered":"2024-05-27T10:52:03.279043+0000","last_clean":"2024-05-27T10:52:03.279043+0000","last_became_active":"2024-05-27T10:52:02.288403+0000","last_became_peered":"2024-05-27T10:52:02.288403+0000","last_unstale":"2024-05-27T10:52:03.279043+0000","last_undegraded":"2024-05-27T10:52:03.279043+0000","last_fullsized":"2024-05-27T10:52:03.279043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:16:52.089775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.258722+0000","last_change":"2024-05-27T10:52:01.206886+0000","last_active":"2024-05-27T10:52:04.258722+0000","last_peered":"2024-05-27T10:52:04.258722+0000","last_clean":"2024-05-27T10:52:04.258722+0000","last_became_active":"2024-05-27T10:52:01.206548+0000","last_became_peered":"2024-05-27T10:52:01.206548+0000","last_unstale":"2024-05-27T10:52:04.258722+0000","last_undegraded":"2024-05-27T10:52:04.258722+0000","last_fullsized":"2024-05-27T10:52:04.258722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:14.495142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280627+0000","last_change":"2024-05-27T10:52:02.288202+0000","last_active":"2024-05-27T10:52:03.280627+0000","last_peered":"2024-05-27T10:52:03.280627+0000","last_clean":"2024-05-27T10:52:03.280627+0000","last_became_active":"2024-05-27T10:52:02.287844+0000","last_became_peered":"2024-05-27T10:52:02.287844+0000","last_unstale":"2024-05-27T10:52:03.280627+0000","last_undegraded":"2024-05-27T10:52:03.280627+0000","last_fullsized":"2024-05-27T10:52:03.280627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:54:56.167515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.515295+0000","last_change":"2024-05-27T10:52:01.243732+0000","last_active":"2024-05-27T10:52:04.515295+0000","last_peered":"2024-05-27T10:52:04.515295+0000","last_clean":"2024-05-27T10:52:04.515295+0000","last_became_active":"2024-05-27T10:52:01.243444+0000","last_became_peered":"2024-05-27T10:52:01.243444+0000","last_unstale":"2024-05-27T10:52:04.515295+0000","last_undegraded":"2024-05-27T10:52:04.515295+0000","last_fullsized":"2024-05-27T10:52:04.515295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:33:57.192424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.264692+0000","last_change":"2024-05-27T10:52:02.270369+0000","last_active":"2024-05-27T10:52:04.264692+0000","last_peered":"2024-05-27T10:52:04.264692+0000","last_clean":"2024-05-27T10:52:04.264692+0000","last_became_active":"2024-05-27T10:52:02.270046+0000","last_became_peered":"2024-05-27T10:52:02.270046+0000","last_unstale":"2024-05-27T10:52:04.264692+0000","last_undegraded":"2024-05-27T10:52:04.264692+0000","last_fullsized":"2024-05-27T10:52:04.264692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:16:52.089775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.732885+0000","last_change":"2024-05-27T10:52:02.282074+0000","last_active":"2024-05-27T10:52:04.732885+0000","last_peered":"2024-05-27T10:52:04.732885+0000","last_clean":"2024-05-27T10:52:04.732885+0000","last_became_active":"2024-05-27T10:52:02.281820+0000","last_became_peered":"2024-05-27T10:52:02.281820+0000","last_unstale":"2024-05-27T10:52:04.732885+0000","last_undegraded":"2024-05-27T10:52:04.732885+0000","last_fullsized":"2024-05-27T10:52:04.732885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:28:35.769753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.515104+0000","last_change":"2024-05-27T10:52:01.246155+0000","last_active":"2024-05-27T10:52:04.515104+0000","last_peered":"2024-05-27T10:52:04.515104+0000","last_clean":"2024-05-27T10:52:04.515104+0000","last_became_active":"2024-05-27T10:52:01.245811+0000","last_became_peered":"2024-05-27T10:52:01.245811+0000","last_unstale":"2024-05-27T10:52:04.515104+0000","last_undegraded":"2024-05-27T10:52:04.515104+0000","last_fullsized":"2024-05-27T10:52:04.515104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:27:25.826446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.733436+0000","last_change":"2024-05-27T10:52:02.280894+0000","last_active":"2024-05-27T10:52:04.733436+0000","last_peered":"2024-05-27T10:52:04.733436+0000","last_clean":"2024-05-27T10:52:04.733436+0000","last_became_active":"2024-05-27T10:52:02.280424+0000","last_became_peered":"2024-05-27T10:52:02.280424+0000","last_unstale":"2024-05-27T10:52:04.733436+0000","last_undegraded":"2024-05-27T10:52:04.733436+0000","last_fullsized":"2024-05-27T10:52:04.733436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:58:41.336092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.515285+0000","last_change":"2024-05-27T10:52:01.245511+0000","last_active":"2024-05-27T10:52:04.515285+0000","last_peered":"2024-05-27T10:52:04.515285+0000","last_clean":"2024-05-27T10:52:04.515285+0000","last_became_active":"2024-05-27T10:52:01.244152+0000","last_became_peered":"2024-05-27T10:52:01.244152+0000","last_unstale":"2024-05-27T10:52:04.515285+0000","last_undegraded":"2024-05-27T10:52:04.515285+0000","last_fullsized":"2024-05-27T10:52:04.515285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:49:03.555502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279831+0000","last_change":"2024-05-27T10:52:02.267004+0000","last_active":"2024-05-27T10:52:03.279831+0000","last_peered":"2024-05-27T10:52:03.279831+0000","last_clean":"2024-05-27T10:52:03.279831+0000","last_became_active":"2024-05-27T10:52:02.266389+0000","last_became_peered":"2024-05-27T10:52:02.266389+0000","last_unstale":"2024-05-27T10:52:03.279831+0000","last_undegraded":"2024-05-27T10:52:03.279831+0000","last_fullsized":"2024-05-27T10:52:03.279831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:42:51.939151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280652+0000","last_change":"2024-05-27T10:52:01.223850+0000","last_active":"2024-05-27T10:52:03.280652+0000","last_peered":"2024-05-27T10:52:03.280652+0000","last_clean":"2024-05-27T10:52:03.280652+0000","last_became_active":"2024-05-27T10:52:01.223551+0000","last_became_peered":"2024-05-27T10:52:01.223551+0000","last_unstale":"2024-05-27T10:52:03.280652+0000","last_undegraded":"2024-05-27T10:52:03.280652+0000","last_fullsized":"2024-05-27T10:52:03.280652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:06:19.471570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280502+0000","last_change":"2024-05-27T10:52:02.291956+0000","last_active":"2024-05-27T10:52:03.280502+0000","last_peered":"2024-05-27T10:52:03.280502+0000","last_clean":"2024-05-27T10:52:03.280502+0000","last_became_active":"2024-05-27T10:52:02.291647+0000","last_became_peered":"2024-05-27T10:52:02.291647+0000","last_unstale":"2024-05-27T10:52:03.280502+0000","last_undegraded":"2024-05-27T10:52:03.280502+0000","last_fullsized":"2024-05-27T10:52:03.280502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:21:45.050385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279431+0000","last_change":"2024-05-27T10:52:01.241871+0000","last_active":"2024-05-27T10:52:03.279431+0000","last_peered":"2024-05-27T10:52:03.279431+0000","last_clean":"2024-05-27T10:52:03.279431+0000","last_became_active":"2024-05-27T10:52:01.241577+0000","last_became_peered":"2024-05-27T10:52:01.241577+0000","last_unstale":"2024-05-27T10:52:03.279431+0000","last_undegraded":"2024-05-27T10:52:03.279431+0000","last_fullsized":"2024-05-27T10:52:03.279431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:17:08.180814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T10:52:12.407 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T10:52:12.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.656+0000 7f632b000640 1 Processor -- start 2024-05-27T10:52:12.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.656+0000 7f632b000640 1 -- start start 2024-05-27T10:52:12.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.658+0000 7f632b000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f632415c420 0x7f6324071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:12.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.658+0000 7f632b000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f632415c800 con 0x7f63240b4ab0 2024-05-27T10:52:12.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.658+0000 7f632b000640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63240ad2e0 con 0x7f63240d0a70 2024-05-27T10:52:12.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.658+0000 7f632b000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f63240afc90 con 0x7f632415c420 2024-05-27T10:52:12.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.658+0000 7f6329c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f632415c420 0x7f6324071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:12.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.658+0000 7f6329c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f632415c420 0x7f6324071fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34376/0 (socket says 172.21.15.47:34376) 2024-05-27T10:52:12.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.658+0000 7f6329c00640 1 -- 172.21.15.47:0/3672619748 learned_addr learned my addr 172.21.15.47:0/3672619748 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:12.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.658+0000 7f6329c00640 1 -- 172.21.15.47:0/3672619748 >> v1:172.21.15.53:6789/0 conn(0x7f63240d0a70 legacy=0x7f63240b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:12.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.658+0000 7f6329c00640 1 -- 172.21.15.47:0/3672619748 >> v1:172.21.15.47:6789/0 conn(0x7f63240b4ab0 legacy=0x7f63240d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:12.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.658+0000 7f6329c00640 1 -- 172.21.15.47:0/3672619748 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63240ad5c0 con 0x7f632415c420 2024-05-27T10:52:12.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.660+0000 7f6329c00640 1 --2- 172.21.15.47:0/3672619748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f632415c420 0x7f6324071fc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6318009870 tx=0x7f631802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158894d79da5a488 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:12.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.660+0000 7f6323e00640 1 -- 172.21.15.47:0/3672619748 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6318037070 con 0x7f632415c420 2024-05-27T10:52:12.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.660+0000 7f6323e00640 1 -- 172.21.15.47:0/3672619748 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6318032440 con 0x7f632415c420 2024-05-27T10:52:12.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.660+0000 7f6323e00640 1 -- 172.21.15.47:0/3672619748 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6318032810 con 0x7f632415c420 2024-05-27T10:52:12.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.660+0000 7f632b000640 1 -- 172.21.15.47:0/3672619748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f632415c420 msgr2=0x7f6324071fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:12.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.660+0000 7f632b000640 1 --2- 172.21.15.47:0/3672619748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f632415c420 0x7f6324071fc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6318009870 tx=0x7f631802a210 comp rx=0 tx=0).stop 2024-05-27T10:52:12.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.661+0000 7f632b000640 1 -- 172.21.15.47:0/3672619748 shutdown_connections 2024-05-27T10:52:12.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.661+0000 7f632b000640 1 --2- 172.21.15.47:0/3672619748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f632415c420 0x7f6324071fc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:12.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.661+0000 7f632b000640 1 -- 172.21.15.47:0/3672619748 >> 172.21.15.47:0/3672619748 conn(0x7f632406bb20 msgr2=0x7f632406bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:12.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.661+0000 7f632b000640 1 -- 172.21.15.47:0/3672619748 shutdown_connections 2024-05-27T10:52:12.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.661+0000 7f632b000640 1 -- 172.21.15.47:0/3672619748 wait complete. 2024-05-27T10:52:12.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.662+0000 7f632b000640 1 Processor -- start 2024-05-27T10:52:12.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.662+0000 7f632b000640 1 -- start start 2024-05-27T10:52:12.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.663+0000 7f632b000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63240b4ab0 0x7f6324073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:12.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.663+0000 7f632b000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63240d0a70 0x7f6324142c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:12.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.663+0000 7f632b000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f632415c420 0x7f632413fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:12.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.663+0000 7f632b000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f63240af8f0 con 0x7f632415c420 2024-05-27T10:52:12.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.663+0000 7f632b000640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f63240ad8a0 con 0x7f63240b4ab0 2024-05-27T10:52:12.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.663+0000 7f632b000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f63240afa70 con 0x7f63240d0a70 2024-05-27T10:52:12.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.664+0000 7f632a600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f632415c420 0x7f632413fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:12.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.664+0000 7f632a600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f632415c420 0x7f632413fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34392/0 (socket says 172.21.15.47:34392) 2024-05-27T10:52:12.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.664+0000 7f632a600640 1 -- 172.21.15.47:0/878121585 learned_addr learned my addr 172.21.15.47:0/878121585 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:12.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.664+0000 7f6329c00640 1 --2- 172.21.15.47:0/878121585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63240b4ab0 0x7f6324073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:12.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.664+0000 7f6329200640 1 --2- 172.21.15.47:0/878121585 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63240d0a70 0x7f6324142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:12.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.664+0000 7f632a600640 1 -- 172.21.15.47:0/878121585 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63240d0a70 msgr2=0x7f6324142c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:12.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.664+0000 7f632a600640 1 --2- 172.21.15.47:0/878121585 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63240d0a70 0x7f6324142c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:12.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.664+0000 7f632a600640 1 -- 172.21.15.47:0/878121585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63240b4ab0 msgr2=0x7f6324073060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:12.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.664+0000 7f632a600640 1 --2- 172.21.15.47:0/878121585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63240b4ab0 0x7f6324073060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:12.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.664+0000 7f632a600640 1 -- 172.21.15.47:0/878121585 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632415d630 con 0x7f632415c420 2024-05-27T10:52:12.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.664+0000 7f6329200640 1 --2- 172.21.15.47:0/878121585 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63240d0a70 0x7f6324142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:12.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.664+0000 7f632a600640 1 --2- 172.21.15.47:0/878121585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f632415c420 0x7f632413fc30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f631c00c6d0 tx=0x7f631c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:12.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.665+0000 7f6321600640 1 -- 172.21.15.47:0/878121585 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c016020 con 0x7f632415c420 2024-05-27T10:52:12.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.665+0000 7f6321600640 1 -- 172.21.15.47:0/878121585 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f631c00a840 con 0x7f632415c420 2024-05-27T10:52:12.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.665+0000 7f632b000640 1 -- 172.21.15.47:0/878121585 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632415d910 con 0x7f632415c420 2024-05-27T10:52:12.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.665+0000 7f6321600640 1 -- 172.21.15.47:0/878121585 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c00ac30 con 0x7f632415c420 2024-05-27T10:52:12.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.665+0000 7f632b000640 1 -- 172.21.15.47:0/878121585 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f632415ded0 con 0x7f632415c420 2024-05-27T10:52:12.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.666+0000 7f632b000640 1 -- 172.21.15.47:0/878121585 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f632404fce0 con 0x7f632415c420 2024-05-27T10:52:12.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.667+0000 7f6321600640 1 -- 172.21.15.47:0/878121585 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f631c019020 con 0x7f632415c420 2024-05-27T10:52:12.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.668+0000 7f6321600640 1 --2- 172.21.15.47:0/878121585 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f630406c8f0 0x7f630406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:12.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.668+0000 7f6321600640 1 -- 172.21.15.47:0/878121585 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f631c08c0f0 con 0x7f632415c420 2024-05-27T10:52:12.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.668+0000 7f6329c00640 1 --2- 172.21.15.47:0/878121585 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f630406c8f0 0x7f630406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:12.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.669+0000 7f6329c00640 1 --2- 172.21.15.47:0/878121585 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f630406c8f0 0x7f630406edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6318034000 tx=0x7f631802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:12.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.672+0000 7f6321600640 1 -- 172.21.15.47:0/878121585 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f631c020020 con 0x7f632415c420 2024-05-27T10:52:12.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.864+0000 7f632b000640 1 -- 172.21.15.47:0/878121585 --> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6324073a30 con 0x7f630406c8f0 2024-05-27T10:52:12.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.877+0000 7f6321600640 1 -- 172.21.15.47:0/878121585 <== mgr.4108 v2:172.21.15.47:6832/3679485934 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f6324073a30 con 0x7f630406c8f0 2024-05-27T10:52:12.880 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:12.881 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-27T10:52:12.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.883+0000 7f632b000640 1 -- 172.21.15.47:0/878121585 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f630406c8f0 msgr2=0x7f630406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:12.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.883+0000 7f632b000640 1 --2- 172.21.15.47:0/878121585 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f630406c8f0 0x7f630406edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6318034000 tx=0x7f631802e000 comp rx=0 tx=0).stop 2024-05-27T10:52:12.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.883+0000 7f632b000640 1 -- 172.21.15.47:0/878121585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f632415c420 msgr2=0x7f632413fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:12.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.883+0000 7f632b000640 1 --2- 172.21.15.47:0/878121585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f632415c420 0x7f632413fc30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f631c00c6d0 tx=0x7f631c00cb90 comp rx=0 tx=0).stop 2024-05-27T10:52:12.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.883+0000 7f632b000640 1 -- 172.21.15.47:0/878121585 shutdown_connections 2024-05-27T10:52:12.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.883+0000 7f632b000640 1 --2- 172.21.15.47:0/878121585 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f630406c8f0 0x7f630406edb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:12.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.883+0000 7f632b000640 1 --2- 172.21.15.47:0/878121585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f632415c420 0x7f632413fc30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:12.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.883+0000 7f632b000640 1 --2- 172.21.15.47:0/878121585 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63240d0a70 0x7f6324142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:12.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.883+0000 7f632b000640 1 --2- 172.21.15.47:0/878121585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63240b4ab0 0x7f6324073060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:12.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.883+0000 7f632b000640 1 -- 172.21.15.47:0/878121585 >> 172.21.15.47:0/878121585 conn(0x7f632406bb20 msgr2=0x7f63240b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:12.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.883+0000 7f632b000640 1 -- 172.21.15.47:0/878121585 shutdown_connections 2024-05-27T10:52:12.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:12.883+0000 7f632b000640 1 -- 172.21.15.47:0/878121585 wait complete. 2024-05-27T10:52:12.898 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-27T10:52:11.041291+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252288,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722432,"statfs":{"total":773094113280,"available":772835770368,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.800720"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.515993+0000","last_change":"2024-05-27T10:52:02.284644+0000","last_active":"2024-05-27T10:52:04.515993+0000","last_peered":"2024-05-27T10:52:04.515993+0000","last_clean":"2024-05-27T10:52:04.515993+0000","last_became_active":"2024-05-27T10:52:02.284277+0000","last_became_peered":"2024-05-27T10:52:02.284277+0000","last_unstale":"2024-05-27T10:52:04.515993+0000","last_undegraded":"2024-05-27T10:52:04.515993+0000","last_fullsized":"2024-05-27T10:52:04.515993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:22:27.833163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.259114+0000","last_change":"2024-05-27T10:52:02.274156+0000","last_active":"2024-05-27T10:52:04.259114+0000","last_peered":"2024-05-27T10:52:04.259114+0000","last_clean":"2024-05-27T10:52:04.259114+0000","last_became_active":"2024-05-27T10:52:02.273895+0000","last_became_peered":"2024-05-27T10:52:02.273895+0000","last_unstale":"2024-05-27T10:52:04.259114+0000","last_undegraded":"2024-05-27T10:52:04.259114+0000","last_fullsized":"2024-05-27T10:52:04.259114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:00.463147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277856+0000","last_change":"2024-05-27T10:52:02.259214+0000","last_active":"2024-05-27T10:52:03.277856+0000","last_peered":"2024-05-27T10:52:03.277856+0000","last_clean":"2024-05-27T10:52:03.277856+0000","last_became_active":"2024-05-27T10:52:02.258890+0000","last_became_peered":"2024-05-27T10:52:02.258890+0000","last_unstale":"2024-05-27T10:52:03.277856+0000","last_undegraded":"2024-05-27T10:52:03.277856+0000","last_fullsized":"2024-05-27T10:52:03.277856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:44:14.946437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.732787+0000","last_change":"2024-05-27T10:52:02.280689+0000","last_active":"2024-05-27T10:52:04.732787+0000","last_peered":"2024-05-27T10:52:04.732787+0000","last_clean":"2024-05-27T10:52:04.732787+0000","last_became_active":"2024-05-27T10:52:02.279605+0000","last_became_peered":"2024-05-27T10:52:02.279605+0000","last_unstale":"2024-05-27T10:52:04.732787+0000","last_undegraded":"2024-05-27T10:52:04.732787+0000","last_fullsized":"2024-05-27T10:52:04.732787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:54:56.167515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.514897+0000","last_change":"2024-05-27T10:52:02.275103+0000","last_active":"2024-05-27T10:52:04.514897+0000","last_peered":"2024-05-27T10:52:04.514897+0000","last_clean":"2024-05-27T10:52:04.514897+0000","last_became_active":"2024-05-27T10:52:02.274768+0000","last_became_peered":"2024-05-27T10:52:02.274768+0000","last_unstale":"2024-05-27T10:52:04.514897+0000","last_undegraded":"2024-05-27T10:52:04.514897+0000","last_fullsized":"2024-05-27T10:52:04.514897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:28:35.769753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.732101+0000","last_change":"2024-05-27T10:52:02.275374+0000","last_active":"2024-05-27T10:52:04.732101+0000","last_peered":"2024-05-27T10:52:04.732101+0000","last_clean":"2024-05-27T10:52:04.732101+0000","last_became_active":"2024-05-27T10:52:02.270621+0000","last_became_peered":"2024-05-27T10:52:02.270621+0000","last_unstale":"2024-05-27T10:52:04.732101+0000","last_undegraded":"2024-05-27T10:52:04.732101+0000","last_fullsized":"2024-05-27T10:52:04.732101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:16.695502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.514731+0000","last_change":"2024-05-27T10:52:02.277391+0000","last_active":"2024-05-27T10:52:04.514731+0000","last_peered":"2024-05-27T10:52:04.514731+0000","last_clean":"2024-05-27T10:52:04.514731+0000","last_became_active":"2024-05-27T10:52:02.275623+0000","last_became_peered":"2024-05-27T10:52:02.275623+0000","last_unstale":"2024-05-27T10:52:04.514731+0000","last_undegraded":"2024-05-27T10:52:04.514731+0000","last_fullsized":"2024-05-27T10:52:04.514731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:31.231464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.278627+0000","last_change":"2024-05-27T10:52:02.278913+0000","last_active":"2024-05-27T10:52:03.278627+0000","last_peered":"2024-05-27T10:52:03.278627+0000","last_clean":"2024-05-27T10:52:03.278627+0000","last_became_active":"2024-05-27T10:52:02.278319+0000","last_became_peered":"2024-05-27T10:52:02.278319+0000","last_unstale":"2024-05-27T10:52:03.278627+0000","last_undegraded":"2024-05-27T10:52:03.278627+0000","last_fullsized":"2024-05-27T10:52:03.278627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:40:53.386645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.516097+0000","last_change":"2024-05-27T10:52:02.283688+0000","last_active":"2024-05-27T10:52:04.516097+0000","last_peered":"2024-05-27T10:52:04.516097+0000","last_clean":"2024-05-27T10:52:04.516097+0000","last_became_active":"2024-05-27T10:52:02.283284+0000","last_became_peered":"2024-05-27T10:52:02.283284+0000","last_unstale":"2024-05-27T10:52:04.516097+0000","last_undegraded":"2024-05-27T10:52:04.516097+0000","last_fullsized":"2024-05-27T10:52:04.516097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:13:00.624444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.265591+0000","last_change":"2024-05-27T10:52:02.272971+0000","last_active":"2024-05-27T10:52:04.265591+0000","last_peered":"2024-05-27T10:52:04.265591+0000","last_clean":"2024-05-27T10:52:04.265591+0000","last_became_active":"2024-05-27T10:52:02.272634+0000","last_became_peered":"2024-05-27T10:52:02.272634+0000","last_unstale":"2024-05-27T10:52:04.265591+0000","last_undegraded":"2024-05-27T10:52:04.265591+0000","last_fullsized":"2024-05-27T10:52:04.265591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:42:51.939151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.265184+0000","last_change":"2024-05-27T10:52:02.278290+0000","last_active":"2024-05-27T10:52:04.265184+0000","last_peered":"2024-05-27T10:52:04.265184+0000","last_clean":"2024-05-27T10:52:04.265184+0000","last_became_active":"2024-05-27T10:52:02.277971+0000","last_became_peered":"2024-05-27T10:52:02.277971+0000","last_unstale":"2024-05-27T10:52:04.265184+0000","last_undegraded":"2024-05-27T10:52:04.265184+0000","last_fullsized":"2024-05-27T10:52:04.265184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:16.695502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277196+0000","last_change":"2024-05-27T10:52:02.262321+0000","last_active":"2024-05-27T10:52:03.277196+0000","last_peered":"2024-05-27T10:52:03.277196+0000","last_clean":"2024-05-27T10:52:03.277196+0000","last_became_active":"2024-05-27T10:52:02.262012+0000","last_became_peered":"2024-05-27T10:52:02.262012+0000","last_unstale":"2024-05-27T10:52:03.277196+0000","last_undegraded":"2024-05-27T10:52:03.277196+0000","last_fullsized":"2024-05-27T10:52:03.277196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:27:26.831178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280146+0000","last_change":"2024-05-27T10:52:02.289470+0000","last_active":"2024-05-27T10:52:03.280146+0000","last_peered":"2024-05-27T10:52:03.280146+0000","last_clean":"2024-05-27T10:52:03.280146+0000","last_became_active":"2024-05-27T10:52:02.288616+0000","last_became_peered":"2024-05-27T10:52:02.288616+0000","last_unstale":"2024-05-27T10:52:03.280146+0000","last_undegraded":"2024-05-27T10:52:03.280146+0000","last_fullsized":"2024-05-27T10:52:03.280146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:42:51.939151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.276301+0000","last_change":"2024-05-27T10:52:02.282027+0000","last_active":"2024-05-27T10:52:03.276301+0000","last_peered":"2024-05-27T10:52:03.276301+0000","last_clean":"2024-05-27T10:52:03.276301+0000","last_became_active":"2024-05-27T10:52:02.281747+0000","last_became_peered":"2024-05-27T10:52:02.281747+0000","last_unstale":"2024-05-27T10:52:03.276301+0000","last_undegraded":"2024-05-27T10:52:03.276301+0000","last_fullsized":"2024-05-27T10:52:03.276301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:53:57.446525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.258570+0000","last_change":"2024-05-27T10:52:02.280351+0000","last_active":"2024-05-27T10:52:04.258570+0000","last_peered":"2024-05-27T10:52:04.258570+0000","last_clean":"2024-05-27T10:52:04.258570+0000","last_became_active":"2024-05-27T10:52:02.278207+0000","last_became_peered":"2024-05-27T10:52:02.278207+0000","last_unstale":"2024-05-27T10:52:04.258570+0000","last_undegraded":"2024-05-27T10:52:04.258570+0000","last_fullsized":"2024-05-27T10:52:04.258570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:44:14.946437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.732105+0000","last_change":"2024-05-27T10:52:02.280012+0000","last_active":"2024-05-27T10:52:04.732105+0000","last_peered":"2024-05-27T10:52:04.732105+0000","last_clean":"2024-05-27T10:52:04.732105+0000","last_became_active":"2024-05-27T10:52:02.279500+0000","last_became_peered":"2024-05-27T10:52:02.279500+0000","last_unstale":"2024-05-27T10:52:04.732105+0000","last_undegraded":"2024-05-27T10:52:04.732105+0000","last_fullsized":"2024-05-27T10:52:04.732105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:42:51.939151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.734125+0000","last_change":"2024-05-27T10:52:02.276006+0000","last_active":"2024-05-27T10:52:04.734125+0000","last_peered":"2024-05-27T10:52:04.734125+0000","last_clean":"2024-05-27T10:52:04.734125+0000","last_became_active":"2024-05-27T10:52:02.275602+0000","last_became_peered":"2024-05-27T10:52:02.275602+0000","last_unstale":"2024-05-27T10:52:04.734125+0000","last_undegraded":"2024-05-27T10:52:04.734125+0000","last_fullsized":"2024-05-27T10:52:04.734125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:28:50.347363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.731676+0000","last_change":"2024-05-27T10:52:02.287428+0000","last_active":"2024-05-27T10:52:04.731676+0000","last_peered":"2024-05-27T10:52:04.731676+0000","last_clean":"2024-05-27T10:52:04.731676+0000","last_became_active":"2024-05-27T10:52:02.285853+0000","last_became_peered":"2024-05-27T10:52:02.285853+0000","last_unstale":"2024-05-27T10:52:04.731676+0000","last_undegraded":"2024-05-27T10:52:04.731676+0000","last_fullsized":"2024-05-27T10:52:04.731676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:27:26.831178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.515417+0000","last_change":"2024-05-27T10:52:02.284355+0000","last_active":"2024-05-27T10:52:04.515417+0000","last_peered":"2024-05-27T10:52:04.515417+0000","last_clean":"2024-05-27T10:52:04.515417+0000","last_became_active":"2024-05-27T10:52:02.281949+0000","last_became_peered":"2024-05-27T10:52:02.281949+0000","last_unstale":"2024-05-27T10:52:04.515417+0000","last_undegraded":"2024-05-27T10:52:04.515417+0000","last_fullsized":"2024-05-27T10:52:04.515417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:58:41.336092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.264697+0000","last_change":"2024-05-27T10:52:02.274651+0000","last_active":"2024-05-27T10:52:04.264697+0000","last_peered":"2024-05-27T10:52:04.264697+0000","last_clean":"2024-05-27T10:52:04.264697+0000","last_became_active":"2024-05-27T10:52:02.273814+0000","last_became_peered":"2024-05-27T10:52:02.273814+0000","last_unstale":"2024-05-27T10:52:04.264697+0000","last_undegraded":"2024-05-27T10:52:04.264697+0000","last_fullsized":"2024-05-27T10:52:04.264697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:44:14.946437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.276941+0000","last_change":"2024-05-27T10:52:02.282039+0000","last_active":"2024-05-27T10:52:03.276941+0000","last_peered":"2024-05-27T10:52:03.276941+0000","last_clean":"2024-05-27T10:52:03.276941+0000","last_became_active":"2024-05-27T10:52:02.281761+0000","last_became_peered":"2024-05-27T10:52:02.281761+0000","last_unstale":"2024-05-27T10:52:03.276941+0000","last_undegraded":"2024-05-27T10:52:03.276941+0000","last_fullsized":"2024-05-27T10:52:03.276941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:45.783380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.732360+0000","last_change":"2024-05-27T10:52:02.276287+0000","last_active":"2024-05-27T10:52:04.732360+0000","last_peered":"2024-05-27T10:52:04.732360+0000","last_clean":"2024-05-27T10:52:04.732360+0000","last_became_active":"2024-05-27T10:52:02.275681+0000","last_became_peered":"2024-05-27T10:52:02.275681+0000","last_unstale":"2024-05-27T10:52:04.732360+0000","last_undegraded":"2024-05-27T10:52:04.732360+0000","last_fullsized":"2024-05-27T10:52:04.732360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:21:45.050385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.278852+0000","last_change":"2024-05-27T10:52:02.282775+0000","last_active":"2024-05-27T10:52:03.278852+0000","last_peered":"2024-05-27T10:52:03.278852+0000","last_clean":"2024-05-27T10:52:03.278852+0000","last_became_active":"2024-05-27T10:52:02.282279+0000","last_became_peered":"2024-05-27T10:52:02.282279+0000","last_unstale":"2024-05-27T10:52:03.278852+0000","last_undegraded":"2024-05-27T10:52:03.278852+0000","last_fullsized":"2024-05-27T10:52:03.278852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:44:14.946437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.732270+0000","last_change":"2024-05-27T10:52:02.281520+0000","last_active":"2024-05-27T10:52:04.732270+0000","last_peered":"2024-05-27T10:52:04.732270+0000","last_clean":"2024-05-27T10:52:04.732270+0000","last_became_active":"2024-05-27T10:52:02.281199+0000","last_became_peered":"2024-05-27T10:52:02.281199+0000","last_unstale":"2024-05-27T10:52:04.732270+0000","last_undegraded":"2024-05-27T10:52:04.732270+0000","last_fullsized":"2024-05-27T10:52:04.732270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:00.463147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280858+0000","last_change":"2024-05-27T10:52:02.280042+0000","last_active":"2024-05-27T10:52:03.280858+0000","last_peered":"2024-05-27T10:52:03.280858+0000","last_clean":"2024-05-27T10:52:03.280858+0000","last_became_active":"2024-05-27T10:52:02.279664+0000","last_became_peered":"2024-05-27T10:52:02.279664+0000","last_unstale":"2024-05-27T10:52:03.280858+0000","last_undegraded":"2024-05-27T10:52:03.280858+0000","last_fullsized":"2024-05-27T10:52:03.280858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:31.231464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.265779+0000","last_change":"2024-05-27T10:52:02.286086+0000","last_active":"2024-05-27T10:52:04.265779+0000","last_peered":"2024-05-27T10:52:04.265779+0000","last_clean":"2024-05-27T10:52:04.265779+0000","last_became_active":"2024-05-27T10:52:02.285764+0000","last_became_peered":"2024-05-27T10:52:02.285764+0000","last_unstale":"2024-05-27T10:52:04.265779+0000","last_undegraded":"2024-05-27T10:52:04.265779+0000","last_fullsized":"2024-05-27T10:52:04.265779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:00.463147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.259023+0000","last_change":"2024-05-27T10:52:02.291922+0000","last_active":"2024-05-27T10:52:04.259023+0000","last_peered":"2024-05-27T10:52:04.259023+0000","last_clean":"2024-05-27T10:52:04.259023+0000","last_became_active":"2024-05-27T10:52:02.291600+0000","last_became_peered":"2024-05-27T10:52:02.291600+0000","last_unstale":"2024-05-27T10:52:04.259023+0000","last_undegraded":"2024-05-27T10:52:04.259023+0000","last_fullsized":"2024-05-27T10:52:04.259023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:42:51.939151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280251+0000","last_change":"2024-05-27T10:52:02.283531+0000","last_active":"2024-05-27T10:52:03.280251+0000","last_peered":"2024-05-27T10:52:03.280251+0000","last_clean":"2024-05-27T10:52:03.280251+0000","last_became_active":"2024-05-27T10:52:02.283298+0000","last_became_peered":"2024-05-27T10:52:02.283298+0000","last_unstale":"2024-05-27T10:52:03.280251+0000","last_undegraded":"2024-05-27T10:52:03.280251+0000","last_fullsized":"2024-05-27T10:52:03.280251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:00.463147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277113+0000","last_change":"2024-05-27T10:52:02.290718+0000","last_active":"2024-05-27T10:52:03.277113+0000","last_peered":"2024-05-27T10:52:03.277113+0000","last_clean":"2024-05-27T10:52:03.277113+0000","last_became_active":"2024-05-27T10:52:02.290410+0000","last_became_peered":"2024-05-27T10:52:02.290410+0000","last_unstale":"2024-05-27T10:52:03.277113+0000","last_undegraded":"2024-05-27T10:52:03.277113+0000","last_fullsized":"2024-05-27T10:52:03.277113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:40:53.386645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.732845+0000","last_change":"2024-05-27T10:52:02.282494+0000","last_active":"2024-05-27T10:52:04.732845+0000","last_peered":"2024-05-27T10:52:04.732845+0000","last_clean":"2024-05-27T10:52:04.732845+0000","last_became_active":"2024-05-27T10:52:02.280254+0000","last_became_peered":"2024-05-27T10:52:02.280254+0000","last_unstale":"2024-05-27T10:52:04.732845+0000","last_undegraded":"2024-05-27T10:52:04.732845+0000","last_fullsized":"2024-05-27T10:52:04.732845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:31.231464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.731448+0000","last_change":"2024-05-27T10:52:02.267415+0000","last_active":"2024-05-27T10:52:04.731448+0000","last_peered":"2024-05-27T10:52:04.731448+0000","last_clean":"2024-05-27T10:52:04.731448+0000","last_became_active":"2024-05-27T10:52:02.266959+0000","last_became_peered":"2024-05-27T10:52:02.266959+0000","last_unstale":"2024-05-27T10:52:04.731448+0000","last_undegraded":"2024-05-27T10:52:04.731448+0000","last_fullsized":"2024-05-27T10:52:04.731448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:33:58.197155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.264365+0000","last_change":"2024-05-27T10:52:02.285006+0000","last_active":"2024-05-27T10:52:04.264365+0000","last_peered":"2024-05-27T10:52:04.264365+0000","last_clean":"2024-05-27T10:52:04.264365+0000","last_became_active":"2024-05-27T10:52:02.284596+0000","last_became_peered":"2024-05-27T10:52:02.284596+0000","last_unstale":"2024-05-27T10:52:04.264365+0000","last_undegraded":"2024-05-27T10:52:04.264365+0000","last_fullsized":"2024-05-27T10:52:04.264365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:40:53.386645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277028+0000","last_change":"2024-05-27T10:52:02.287164+0000","last_active":"2024-05-27T10:52:03.277028+0000","last_peered":"2024-05-27T10:52:03.277028+0000","last_clean":"2024-05-27T10:52:03.277028+0000","last_became_active":"2024-05-27T10:52:02.280960+0000","last_became_peered":"2024-05-27T10:52:02.280960+0000","last_unstale":"2024-05-27T10:52:03.277028+0000","last_undegraded":"2024-05-27T10:52:03.277028+0000","last_fullsized":"2024-05-27T10:52:03.277028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:27:23.976804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280920+0000","last_change":"2024-05-27T10:52:01.235575+0000","last_active":"2024-05-27T10:52:03.280920+0000","last_peered":"2024-05-27T10:52:03.280920+0000","last_clean":"2024-05-27T10:52:03.280920+0000","last_became_active":"2024-05-27T10:52:01.235262+0000","last_became_peered":"2024-05-27T10:52:01.235262+0000","last_unstale":"2024-05-27T10:52:03.280920+0000","last_undegraded":"2024-05-27T10:52:03.280920+0000","last_fullsized":"2024-05-27T10:52:03.280920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:48:32.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277302+0000","last_change":"2024-05-27T10:52:02.280538+0000","last_active":"2024-05-27T10:52:03.277302+0000","last_peered":"2024-05-27T10:52:03.277302+0000","last_clean":"2024-05-27T10:52:03.277302+0000","last_became_active":"2024-05-27T10:52:02.279400+0000","last_became_peered":"2024-05-27T10:52:02.279400+0000","last_unstale":"2024-05-27T10:52:03.277302+0000","last_undegraded":"2024-05-27T10:52:03.277302+0000","last_fullsized":"2024-05-27T10:52:03.277302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:49.993062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.264539+0000","last_change":"2024-05-27T10:52:01.237296+0000","last_active":"2024-05-27T10:52:04.264539+0000","last_peered":"2024-05-27T10:52:04.264539+0000","last_clean":"2024-05-27T10:52:04.264539+0000","last_became_active":"2024-05-27T10:52:01.236981+0000","last_became_peered":"2024-05-27T10:52:01.236981+0000","last_unstale":"2024-05-27T10:52:04.264539+0000","last_undegraded":"2024-05-27T10:52:04.264539+0000","last_fullsized":"2024-05-27T10:52:04.264539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:48:32.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279087+0000","last_change":"2024-05-27T10:52:01.228043+0000","last_active":"2024-05-27T10:52:03.279087+0000","last_peered":"2024-05-27T10:52:03.279087+0000","last_clean":"2024-05-27T10:52:03.279087+0000","last_became_active":"2024-05-27T10:52:01.227737+0000","last_became_peered":"2024-05-27T10:52:01.227737+0000","last_unstale":"2024-05-27T10:52:03.279087+0000","last_undegraded":"2024-05-27T10:52:03.279087+0000","last_fullsized":"2024-05-27T10:52:03.279087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:48:09.492465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.278823+0000","last_change":"2024-05-27T10:52:02.281578+0000","last_active":"2024-05-27T10:52:03.278823+0000","last_peered":"2024-05-27T10:52:03.278823+0000","last_clean":"2024-05-27T10:52:03.278823+0000","last_became_active":"2024-05-27T10:52:02.280978+0000","last_became_peered":"2024-05-27T10:52:02.280978+0000","last_unstale":"2024-05-27T10:52:03.278823+0000","last_undegraded":"2024-05-27T10:52:03.278823+0000","last_fullsized":"2024-05-27T10:52:03.278823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:49.993062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.732465+0000","last_change":"2024-05-27T10:52:01.248022+0000","last_active":"2024-05-27T10:52:04.732465+0000","last_peered":"2024-05-27T10:52:04.732465+0000","last_clean":"2024-05-27T10:52:04.732465+0000","last_became_active":"2024-05-27T10:52:01.244891+0000","last_became_peered":"2024-05-27T10:52:01.244891+0000","last_unstale":"2024-05-27T10:52:04.732465+0000","last_undegraded":"2024-05-27T10:52:04.732465+0000","last_fullsized":"2024-05-27T10:52:04.732465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:48:09.492465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.258547+0000","last_change":"2024-05-27T10:52:02.281087+0000","last_active":"2024-05-27T10:52:04.258547+0000","last_peered":"2024-05-27T10:52:04.258547+0000","last_clean":"2024-05-27T10:52:04.258547+0000","last_became_active":"2024-05-27T10:52:02.280786+0000","last_became_peered":"2024-05-27T10:52:02.280786+0000","last_unstale":"2024-05-27T10:52:04.258547+0000","last_undegraded":"2024-05-27T10:52:04.258547+0000","last_fullsized":"2024-05-27T10:52:04.258547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:49.993062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.265249+0000","last_change":"2024-05-27T10:52:01.245539+0000","last_active":"2024-05-27T10:52:04.265249+0000","last_peered":"2024-05-27T10:52:04.265249+0000","last_clean":"2024-05-27T10:52:04.265249+0000","last_became_active":"2024-05-27T10:52:01.245210+0000","last_became_peered":"2024-05-27T10:52:01.245210+0000","last_unstale":"2024-05-27T10:52:04.265249+0000","last_undegraded":"2024-05-27T10:52:04.265249+0000","last_fullsized":"2024-05-27T10:52:04.265249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:05.650946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.733021+0000","last_change":"2024-05-27T10:52:02.282228+0000","last_active":"2024-05-27T10:52:04.733021+0000","last_peered":"2024-05-27T10:52:04.733021+0000","last_clean":"2024-05-27T10:52:04.733021+0000","last_became_active":"2024-05-27T10:52:02.281907+0000","last_became_peered":"2024-05-27T10:52:02.281907+0000","last_unstale":"2024-05-27T10:52:04.733021+0000","last_undegraded":"2024-05-27T10:52:04.733021+0000","last_fullsized":"2024-05-27T10:52:04.733021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:29:36.704067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.732958+0000","last_change":"2024-05-27T10:52:01.243305+0000","last_active":"2024-05-27T10:52:04.732958+0000","last_peered":"2024-05-27T10:52:04.732958+0000","last_clean":"2024-05-27T10:52:04.732958+0000","last_became_active":"2024-05-27T10:52:01.242940+0000","last_became_peered":"2024-05-27T10:52:01.242940+0000","last_unstale":"2024-05-27T10:52:04.732958+0000","last_undegraded":"2024-05-27T10:52:04.732958+0000","last_fullsized":"2024-05-27T10:52:04.732958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:14.495142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279248+0000","last_change":"2024-05-27T10:52:02.267283+0000","last_active":"2024-05-27T10:52:03.279248+0000","last_peered":"2024-05-27T10:52:03.279248+0000","last_clean":"2024-05-27T10:52:03.279248+0000","last_became_active":"2024-05-27T10:52:02.266747+0000","last_became_peered":"2024-05-27T10:52:02.266747+0000","last_unstale":"2024-05-27T10:52:03.279248+0000","last_undegraded":"2024-05-27T10:52:03.279248+0000","last_fullsized":"2024-05-27T10:52:03.279248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:16.695502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.258960+0000","last_change":"2024-05-27T10:52:01.233507+0000","last_active":"2024-05-27T10:52:04.258960+0000","last_peered":"2024-05-27T10:52:04.258960+0000","last_clean":"2024-05-27T10:52:04.258960+0000","last_became_active":"2024-05-27T10:52:01.233204+0000","last_became_peered":"2024-05-27T10:52:01.233204+0000","last_unstale":"2024-05-27T10:52:04.258960+0000","last_undegraded":"2024-05-27T10:52:04.258960+0000","last_fullsized":"2024-05-27T10:52:04.258960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:27:25.826446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277331+0000","last_change":"2024-05-27T10:52:02.279589+0000","last_active":"2024-05-27T10:52:03.277331+0000","last_peered":"2024-05-27T10:52:03.277331+0000","last_clean":"2024-05-27T10:52:03.277331+0000","last_became_active":"2024-05-27T10:52:02.276985+0000","last_became_peered":"2024-05-27T10:52:02.276985+0000","last_unstale":"2024-05-27T10:52:03.277331+0000","last_undegraded":"2024-05-27T10:52:03.277331+0000","last_fullsized":"2024-05-27T10:52:03.277331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:33:58.197155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.264669+0000","last_change":"2024-05-27T10:52:01.235144+0000","last_active":"2024-05-27T10:52:04.264669+0000","last_peered":"2024-05-27T10:52:04.264669+0000","last_clean":"2024-05-27T10:52:04.264669+0000","last_became_active":"2024-05-27T10:52:01.234380+0000","last_became_peered":"2024-05-27T10:52:01.234380+0000","last_unstale":"2024-05-27T10:52:04.264669+0000","last_undegraded":"2024-05-27T10:52:04.264669+0000","last_fullsized":"2024-05-27T10:52:04.264669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:14.495142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.515273+0000","last_change":"2024-05-27T10:52:02.293987+0000","last_active":"2024-05-27T10:52:04.515273+0000","last_peered":"2024-05-27T10:52:04.515273+0000","last_clean":"2024-05-27T10:52:04.515273+0000","last_became_active":"2024-05-27T10:52:02.293646+0000","last_became_peered":"2024-05-27T10:52:02.293646+0000","last_unstale":"2024-05-27T10:52:04.515273+0000","last_undegraded":"2024-05-27T10:52:04.515273+0000","last_fullsized":"2024-05-27T10:52:04.515273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:57:19.835567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277453+0000","last_change":"2024-05-27T10:52:01.231147+0000","last_active":"2024-05-27T10:52:03.277453+0000","last_peered":"2024-05-27T10:52:03.277453+0000","last_clean":"2024-05-27T10:52:03.277453+0000","last_became_active":"2024-05-27T10:52:01.230902+0000","last_became_peered":"2024-05-27T10:52:01.230902+0000","last_unstale":"2024-05-27T10:52:03.277453+0000","last_undegraded":"2024-05-27T10:52:03.277453+0000","last_fullsized":"2024-05-27T10:52:03.277453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:29:30.495775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.276473+0000","last_change":"2024-05-27T10:52:02.260644+0000","last_active":"2024-05-27T10:52:03.276473+0000","last_peered":"2024-05-27T10:52:03.276473+0000","last_clean":"2024-05-27T10:52:03.276473+0000","last_became_active":"2024-05-27T10:52:02.260329+0000","last_became_peered":"2024-05-27T10:52:02.260329+0000","last_unstale":"2024-05-27T10:52:03.276473+0000","last_undegraded":"2024-05-27T10:52:03.276473+0000","last_fullsized":"2024-05-27T10:52:03.276473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:25:10.287509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.732874+0000","last_change":"2024-05-27T10:52:01.239325+0000","last_active":"2024-05-27T10:52:04.732874+0000","last_peered":"2024-05-27T10:52:04.732874+0000","last_clean":"2024-05-27T10:52:04.732874+0000","last_became_active":"2024-05-27T10:52:01.239049+0000","last_became_peered":"2024-05-27T10:52:01.239049+0000","last_unstale":"2024-05-27T10:52:04.732874+0000","last_undegraded":"2024-05-27T10:52:04.732874+0000","last_fullsized":"2024-05-27T10:52:04.732874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:23:24.648014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.515002+0000","last_change":"2024-05-27T10:52:02.292008+0000","last_active":"2024-05-27T10:52:04.515002+0000","last_peered":"2024-05-27T10:52:04.515002+0000","last_clean":"2024-05-27T10:52:04.515002+0000","last_became_active":"2024-05-27T10:52:02.289668+0000","last_became_peered":"2024-05-27T10:52:02.289668+0000","last_unstale":"2024-05-27T10:52:04.515002+0000","last_undegraded":"2024-05-27T10:52:04.515002+0000","last_fullsized":"2024-05-27T10:52:04.515002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:29:36.704067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.264213+0000","last_change":"2024-05-27T10:52:01.241305+0000","last_active":"2024-05-27T10:52:04.264213+0000","last_peered":"2024-05-27T10:52:04.264213+0000","last_clean":"2024-05-27T10:52:04.264213+0000","last_became_active":"2024-05-27T10:52:01.240944+0000","last_became_peered":"2024-05-27T10:52:01.240944+0000","last_unstale":"2024-05-27T10:52:04.264213+0000","last_undegraded":"2024-05-27T10:52:04.264213+0000","last_fullsized":"2024-05-27T10:52:04.264213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:23:24.648014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.264380+0000","last_change":"2024-05-27T10:52:02.283944+0000","last_active":"2024-05-27T10:52:04.264380+0000","last_peered":"2024-05-27T10:52:04.264380+0000","last_clean":"2024-05-27T10:52:04.264380+0000","last_became_active":"2024-05-27T10:52:02.283395+0000","last_became_peered":"2024-05-27T10:52:02.283395+0000","last_unstale":"2024-05-27T10:52:04.264380+0000","last_undegraded":"2024-05-27T10:52:04.264380+0000","last_fullsized":"2024-05-27T10:52:04.264380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:49.993062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.731241+0000","last_change":"2024-05-27T10:52:01.219153+0000","last_active":"2024-05-27T10:52:04.731241+0000","last_peered":"2024-05-27T10:52:04.731241+0000","last_clean":"2024-05-27T10:52:04.731241+0000","last_became_active":"2024-05-27T10:52:01.218818+0000","last_became_peered":"2024-05-27T10:52:01.218818+0000","last_unstale":"2024-05-27T10:52:04.731241+0000","last_undegraded":"2024-05-27T10:52:04.731241+0000","last_fullsized":"2024-05-27T10:52:04.731241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:48:09.492465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.514717+0000","last_change":"2024-05-27T10:52:02.292446+0000","last_active":"2024-05-27T10:52:04.514717+0000","last_peered":"2024-05-27T10:52:04.514717+0000","last_clean":"2024-05-27T10:52:04.514717+0000","last_became_active":"2024-05-27T10:52:02.289784+0000","last_became_peered":"2024-05-27T10:52:02.289784+0000","last_unstale":"2024-05-27T10:52:04.514717+0000","last_undegraded":"2024-05-27T10:52:04.514717+0000","last_fullsized":"2024-05-27T10:52:04.514717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:54:56.167515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277731+0000","last_change":"2024-05-27T10:52:01.222520+0000","last_active":"2024-05-27T10:52:03.277731+0000","last_peered":"2024-05-27T10:52:03.277731+0000","last_clean":"2024-05-27T10:52:03.277731+0000","last_became_active":"2024-05-27T10:52:01.220852+0000","last_became_peered":"2024-05-27T10:52:01.220852+0000","last_unstale":"2024-05-27T10:52:03.277731+0000","last_undegraded":"2024-05-27T10:52:03.277731+0000","last_fullsized":"2024-05-27T10:52:03.277731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:29:30.495775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.515709+0000","last_change":"2024-05-27T10:52:02.288608+0000","last_active":"2024-05-27T10:52:04.515709+0000","last_peered":"2024-05-27T10:52:04.515709+0000","last_clean":"2024-05-27T10:52:04.515709+0000","last_became_active":"2024-05-27T10:52:02.288214+0000","last_became_peered":"2024-05-27T10:52:02.288214+0000","last_unstale":"2024-05-27T10:52:04.515709+0000","last_undegraded":"2024-05-27T10:52:04.515709+0000","last_fullsized":"2024-05-27T10:52:04.515709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:28:50.347363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.731913+0000","last_change":"2024-05-27T10:52:01.225974+0000","last_active":"2024-05-27T10:52:04.731913+0000","last_peered":"2024-05-27T10:52:04.731913+0000","last_clean":"2024-05-27T10:52:04.731913+0000","last_became_active":"2024-05-27T10:52:01.225654+0000","last_became_peered":"2024-05-27T10:52:01.225654+0000","last_unstale":"2024-05-27T10:52:04.731913+0000","last_undegraded":"2024-05-27T10:52:04.731913+0000","last_fullsized":"2024-05-27T10:52:04.731913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:05.650946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.516270+0000","last_change":"2024-05-27T10:52:02.290951+0000","last_active":"2024-05-27T10:52:04.516270+0000","last_peered":"2024-05-27T10:52:04.516270+0000","last_clean":"2024-05-27T10:52:04.516270+0000","last_became_active":"2024-05-27T10:52:02.290085+0000","last_became_peered":"2024-05-27T10:52:02.290085+0000","last_unstale":"2024-05-27T10:52:04.516270+0000","last_undegraded":"2024-05-27T10:52:04.516270+0000","last_fullsized":"2024-05-27T10:52:04.516270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:24:59.656630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.259413+0000","last_change":"2024-05-27T10:52:01.225320+0000","last_active":"2024-05-27T10:52:04.259413+0000","last_peered":"2024-05-27T10:52:04.259413+0000","last_clean":"2024-05-27T10:52:04.259413+0000","last_became_active":"2024-05-27T10:52:01.224972+0000","last_became_peered":"2024-05-27T10:52:01.224972+0000","last_unstale":"2024-05-27T10:52:04.259413+0000","last_undegraded":"2024-05-27T10:52:04.259413+0000","last_fullsized":"2024-05-27T10:52:04.259413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:33:57.192424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.733258+0000","last_change":"2024-05-27T10:52:02.287807+0000","last_active":"2024-05-27T10:52:04.733258+0000","last_peered":"2024-05-27T10:52:04.733258+0000","last_clean":"2024-05-27T10:52:04.733258+0000","last_became_active":"2024-05-27T10:52:02.279989+0000","last_became_peered":"2024-05-27T10:52:02.279989+0000","last_unstale":"2024-05-27T10:52:04.733258+0000","last_undegraded":"2024-05-27T10:52:04.733258+0000","last_fullsized":"2024-05-27T10:52:04.733258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:57:19.835567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.731751+0000","last_change":"2024-05-27T10:52:01.232798+0000","last_active":"2024-05-27T10:52:04.731751+0000","last_peered":"2024-05-27T10:52:04.731751+0000","last_clean":"2024-05-27T10:52:04.731751+0000","last_became_active":"2024-05-27T10:52:01.232491+0000","last_became_peered":"2024-05-27T10:52:01.232491+0000","last_unstale":"2024-05-27T10:52:04.731751+0000","last_undegraded":"2024-05-27T10:52:04.731751+0000","last_fullsized":"2024-05-27T10:52:04.731751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:23:24.648014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.515209+0000","last_change":"2024-05-27T10:52:02.282343+0000","last_active":"2024-05-27T10:52:04.515209+0000","last_peered":"2024-05-27T10:52:04.515209+0000","last_clean":"2024-05-27T10:52:04.515209+0000","last_became_active":"2024-05-27T10:52:02.276307+0000","last_became_peered":"2024-05-27T10:52:02.276307+0000","last_unstale":"2024-05-27T10:52:04.515209+0000","last_undegraded":"2024-05-27T10:52:04.515209+0000","last_fullsized":"2024-05-27T10:52:04.515209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:51:20.034826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.514340+0000","last_change":"2024-05-27T10:51:56.473671+0000","last_active":"2024-05-27T10:52:04.514340+0000","last_peered":"2024-05-27T10:52:04.514340+0000","last_clean":"2024-05-27T10:52:04.514340+0000","last_became_active":"2024-05-27T10:51:56.470561+0000","last_became_peered":"2024-05-27T10:51:56.470561+0000","last_unstale":"2024-05-27T10:52:04.514340+0000","last_undegraded":"2024-05-27T10:52:04.514340+0000","last_fullsized":"2024-05-27T10:52:04.514340+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:51:55.105404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:51:55.105404+0000","last_clean_scrub_stamp":"2024-05-27T10:51:55.105404+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:20:59.737450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.731982+0000","last_change":"2024-05-27T10:52:01.233385+0000","last_active":"2024-05-27T10:52:04.731982+0000","last_peered":"2024-05-27T10:52:04.731982+0000","last_clean":"2024-05-27T10:52:04.731982+0000","last_became_active":"2024-05-27T10:52:01.233015+0000","last_became_peered":"2024-05-27T10:52:01.233015+0000","last_unstale":"2024-05-27T10:52:04.731982+0000","last_undegraded":"2024-05-27T10:52:04.731982+0000","last_fullsized":"2024-05-27T10:52:04.731982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:48:32.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279697+0000","last_change":"2024-05-27T10:52:02.280478+0000","last_active":"2024-05-27T10:52:03.279697+0000","last_peered":"2024-05-27T10:52:03.279697+0000","last_clean":"2024-05-27T10:52:03.279697+0000","last_became_active":"2024-05-27T10:52:02.280072+0000","last_became_peered":"2024-05-27T10:52:02.280072+0000","last_unstale":"2024-05-27T10:52:03.279697+0000","last_undegraded":"2024-05-27T10:52:03.279697+0000","last_fullsized":"2024-05-27T10:52:03.279697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:16.695502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.514592+0000","last_change":"2024-05-27T10:52:01.236067+0000","last_active":"2024-05-27T10:52:04.514592+0000","last_peered":"2024-05-27T10:52:04.514592+0000","last_clean":"2024-05-27T10:52:04.514592+0000","last_became_active":"2024-05-27T10:52:01.235753+0000","last_became_peered":"2024-05-27T10:52:01.235753+0000","last_unstale":"2024-05-27T10:52:04.514592+0000","last_undegraded":"2024-05-27T10:52:04.514592+0000","last_fullsized":"2024-05-27T10:52:04.514592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:27:22.972073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.276349+0000","last_change":"2024-05-27T10:52:02.273061+0000","last_active":"2024-05-27T10:52:03.276349+0000","last_peered":"2024-05-27T10:52:03.276349+0000","last_clean":"2024-05-27T10:52:03.276349+0000","last_became_active":"2024-05-27T10:52:02.272736+0000","last_became_peered":"2024-05-27T10:52:02.272736+0000","last_unstale":"2024-05-27T10:52:03.276349+0000","last_undegraded":"2024-05-27T10:52:03.276349+0000","last_fullsized":"2024-05-27T10:52:03.276349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:09:36.642477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.731453+0000","last_change":"2024-05-27T10:52:01.226812+0000","last_active":"2024-05-27T10:52:04.731453+0000","last_peered":"2024-05-27T10:52:04.731453+0000","last_clean":"2024-05-27T10:52:04.731453+0000","last_became_active":"2024-05-27T10:52:01.226522+0000","last_became_peered":"2024-05-27T10:52:01.226522+0000","last_unstale":"2024-05-27T10:52:04.731453+0000","last_undegraded":"2024-05-27T10:52:04.731453+0000","last_fullsized":"2024-05-27T10:52:04.731453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:48:32.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.258693+0000","last_change":"2024-05-27T10:52:02.276340+0000","last_active":"2024-05-27T10:52:04.258693+0000","last_peered":"2024-05-27T10:52:04.258693+0000","last_clean":"2024-05-27T10:52:04.258693+0000","last_became_active":"2024-05-27T10:52:02.271466+0000","last_became_peered":"2024-05-27T10:52:02.271466+0000","last_unstale":"2024-05-27T10:52:04.258693+0000","last_undegraded":"2024-05-27T10:52:04.258693+0000","last_fullsized":"2024-05-27T10:52:04.258693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:16:52.089775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.733239+0000","last_change":"2024-05-27T10:52:01.235283+0000","last_active":"2024-05-27T10:52:04.733239+0000","last_peered":"2024-05-27T10:52:04.733239+0000","last_clean":"2024-05-27T10:52:04.733239+0000","last_became_active":"2024-05-27T10:52:01.233138+0000","last_became_peered":"2024-05-27T10:52:01.233138+0000","last_unstale":"2024-05-27T10:52:04.733239+0000","last_undegraded":"2024-05-27T10:52:04.733239+0000","last_fullsized":"2024-05-27T10:52:04.733239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:05.650946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.276992+0000","last_change":"2024-05-27T10:52:02.264256+0000","last_active":"2024-05-27T10:52:03.276992+0000","last_peered":"2024-05-27T10:52:03.276992+0000","last_clean":"2024-05-27T10:52:03.276992+0000","last_became_active":"2024-05-27T10:52:02.263953+0000","last_became_peered":"2024-05-27T10:52:02.263953+0000","last_unstale":"2024-05-27T10:52:03.276992+0000","last_undegraded":"2024-05-27T10:52:03.276992+0000","last_fullsized":"2024-05-27T10:52:03.276992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:15.499873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.259273+0000","last_change":"2024-05-27T10:52:01.222208+0000","last_active":"2024-05-27T10:52:04.259273+0000","last_peered":"2024-05-27T10:52:04.259273+0000","last_clean":"2024-05-27T10:52:04.259273+0000","last_became_active":"2024-05-27T10:52:01.221874+0000","last_became_peered":"2024-05-27T10:52:01.221874+0000","last_unstale":"2024-05-27T10:52:04.259273+0000","last_undegraded":"2024-05-27T10:52:04.259273+0000","last_fullsized":"2024-05-27T10:52:04.259273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:05.650946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.733228+0000","last_change":"2024-05-27T10:52:02.295182+0000","last_active":"2024-05-27T10:52:04.733228+0000","last_peered":"2024-05-27T10:52:04.733228+0000","last_clean":"2024-05-27T10:52:04.733228+0000","last_became_active":"2024-05-27T10:52:02.294854+0000","last_became_peered":"2024-05-27T10:52:02.294854+0000","last_unstale":"2024-05-27T10:52:04.733228+0000","last_undegraded":"2024-05-27T10:52:04.733228+0000","last_fullsized":"2024-05-27T10:52:04.733228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:51:20.034826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.515449+0000","last_change":"2024-05-27T10:52:01.239554+0000","last_active":"2024-05-27T10:52:04.515449+0000","last_peered":"2024-05-27T10:52:04.515449+0000","last_clean":"2024-05-27T10:52:04.515449+0000","last_became_active":"2024-05-27T10:52:01.239267+0000","last_became_peered":"2024-05-27T10:52:01.239267+0000","last_unstale":"2024-05-27T10:52:04.515449+0000","last_undegraded":"2024-05-27T10:52:04.515449+0000","last_fullsized":"2024-05-27T10:52:04.515449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:53:56.441794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.258942+0000","last_change":"2024-05-27T10:52:02.262458+0000","last_active":"2024-05-27T10:52:04.258942+0000","last_peered":"2024-05-27T10:52:04.258942+0000","last_clean":"2024-05-27T10:52:04.258942+0000","last_became_active":"2024-05-27T10:52:02.262132+0000","last_became_peered":"2024-05-27T10:52:02.262132+0000","last_unstale":"2024-05-27T10:52:04.258942+0000","last_undegraded":"2024-05-27T10:52:04.258942+0000","last_fullsized":"2024-05-27T10:52:04.258942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:02:16.695502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.259243+0000","last_change":"2024-05-27T10:52:01.236168+0000","last_active":"2024-05-27T10:52:04.259243+0000","last_peered":"2024-05-27T10:52:04.259243+0000","last_clean":"2024-05-27T10:52:04.259243+0000","last_became_active":"2024-05-27T10:52:01.235905+0000","last_became_peered":"2024-05-27T10:52:01.235905+0000","last_unstale":"2024-05-27T10:52:04.259243+0000","last_undegraded":"2024-05-27T10:52:04.259243+0000","last_fullsized":"2024-05-27T10:52:04.259243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:49:03.555502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.281064+0000","last_change":"2024-05-27T10:52:02.293533+0000","last_active":"2024-05-27T10:52:03.281064+0000","last_peered":"2024-05-27T10:52:03.281064+0000","last_clean":"2024-05-27T10:52:03.281064+0000","last_became_active":"2024-05-27T10:52:02.293231+0000","last_became_peered":"2024-05-27T10:52:02.293231+0000","last_unstale":"2024-05-27T10:52:03.281064+0000","last_undegraded":"2024-05-27T10:52:03.281064+0000","last_fullsized":"2024-05-27T10:52:03.281064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:28:35.769753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.265413+0000","last_change":"2024-05-27T10:52:01.246200+0000","last_active":"2024-05-27T10:52:04.265413+0000","last_peered":"2024-05-27T10:52:04.265413+0000","last_clean":"2024-05-27T10:52:04.265413+0000","last_became_active":"2024-05-27T10:52:01.245916+0000","last_became_peered":"2024-05-27T10:52:01.245916+0000","last_unstale":"2024-05-27T10:52:04.265413+0000","last_undegraded":"2024-05-27T10:52:04.265413+0000","last_fullsized":"2024-05-27T10:52:04.265413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:27:22.972073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.278458+0000","last_change":"2024-05-27T10:52:02.265328+0000","last_active":"2024-05-27T10:52:03.278458+0000","last_peered":"2024-05-27T10:52:03.278458+0000","last_clean":"2024-05-27T10:52:03.278458+0000","last_became_active":"2024-05-27T10:52:02.264120+0000","last_became_peered":"2024-05-27T10:52:02.264120+0000","last_unstale":"2024-05-27T10:52:03.278458+0000","last_undegraded":"2024-05-27T10:52:03.278458+0000","last_fullsized":"2024-05-27T10:52:03.278458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:16:52.089775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.514535+0000","last_change":"2024-05-27T10:52:01.238998+0000","last_active":"2024-05-27T10:52:04.514535+0000","last_peered":"2024-05-27T10:52:04.514535+0000","last_clean":"2024-05-27T10:52:04.514535+0000","last_became_active":"2024-05-27T10:52:01.238680+0000","last_became_peered":"2024-05-27T10:52:01.238680+0000","last_unstale":"2024-05-27T10:52:04.514535+0000","last_undegraded":"2024-05-27T10:52:04.514535+0000","last_fullsized":"2024-05-27T10:52:04.514535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:14.495142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.277000+0000","last_change":"2024-05-27T10:52:02.269095+0000","last_active":"2024-05-27T10:52:03.277000+0000","last_peered":"2024-05-27T10:52:03.277000+0000","last_clean":"2024-05-27T10:52:03.277000+0000","last_became_active":"2024-05-27T10:52:02.267910+0000","last_became_peered":"2024-05-27T10:52:02.267910+0000","last_unstale":"2024-05-27T10:52:03.277000+0000","last_undegraded":"2024-05-27T10:52:03.277000+0000","last_fullsized":"2024-05-27T10:52:03.277000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:24:06.655677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.258839+0000","last_change":"2024-05-27T10:52:01.234993+0000","last_active":"2024-05-27T10:52:04.258839+0000","last_peered":"2024-05-27T10:52:04.258839+0000","last_clean":"2024-05-27T10:52:04.258839+0000","last_became_active":"2024-05-27T10:52:01.234648+0000","last_became_peered":"2024-05-27T10:52:01.234648+0000","last_unstale":"2024-05-27T10:52:04.258839+0000","last_undegraded":"2024-05-27T10:52:04.258839+0000","last_fullsized":"2024-05-27T10:52:04.258839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:27:22.972073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279043+0000","last_change":"2024-05-27T10:52:02.288778+0000","last_active":"2024-05-27T10:52:03.279043+0000","last_peered":"2024-05-27T10:52:03.279043+0000","last_clean":"2024-05-27T10:52:03.279043+0000","last_became_active":"2024-05-27T10:52:02.288403+0000","last_became_peered":"2024-05-27T10:52:02.288403+0000","last_unstale":"2024-05-27T10:52:03.279043+0000","last_undegraded":"2024-05-27T10:52:03.279043+0000","last_fullsized":"2024-05-27T10:52:03.279043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:16:52.089775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.258722+0000","last_change":"2024-05-27T10:52:01.206886+0000","last_active":"2024-05-27T10:52:04.258722+0000","last_peered":"2024-05-27T10:52:04.258722+0000","last_clean":"2024-05-27T10:52:04.258722+0000","last_became_active":"2024-05-27T10:52:01.206548+0000","last_became_peered":"2024-05-27T10:52:01.206548+0000","last_unstale":"2024-05-27T10:52:04.258722+0000","last_undegraded":"2024-05-27T10:52:04.258722+0000","last_fullsized":"2024-05-27T10:52:04.258722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:37:14.495142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280627+0000","last_change":"2024-05-27T10:52:02.288202+0000","last_active":"2024-05-27T10:52:03.280627+0000","last_peered":"2024-05-27T10:52:03.280627+0000","last_clean":"2024-05-27T10:52:03.280627+0000","last_became_active":"2024-05-27T10:52:02.287844+0000","last_became_peered":"2024-05-27T10:52:02.287844+0000","last_unstale":"2024-05-27T10:52:03.280627+0000","last_undegraded":"2024-05-27T10:52:03.280627+0000","last_fullsized":"2024-05-27T10:52:03.280627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:54:56.167515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.515295+0000","last_change":"2024-05-27T10:52:01.243732+0000","last_active":"2024-05-27T10:52:04.515295+0000","last_peered":"2024-05-27T10:52:04.515295+0000","last_clean":"2024-05-27T10:52:04.515295+0000","last_became_active":"2024-05-27T10:52:01.243444+0000","last_became_peered":"2024-05-27T10:52:01.243444+0000","last_unstale":"2024-05-27T10:52:04.515295+0000","last_undegraded":"2024-05-27T10:52:04.515295+0000","last_fullsized":"2024-05-27T10:52:04.515295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:33:57.192424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.264692+0000","last_change":"2024-05-27T10:52:02.270369+0000","last_active":"2024-05-27T10:52:04.264692+0000","last_peered":"2024-05-27T10:52:04.264692+0000","last_clean":"2024-05-27T10:52:04.264692+0000","last_became_active":"2024-05-27T10:52:02.270046+0000","last_became_peered":"2024-05-27T10:52:02.270046+0000","last_unstale":"2024-05-27T10:52:04.264692+0000","last_undegraded":"2024-05-27T10:52:04.264692+0000","last_fullsized":"2024-05-27T10:52:04.264692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:16:52.089775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.732885+0000","last_change":"2024-05-27T10:52:02.282074+0000","last_active":"2024-05-27T10:52:04.732885+0000","last_peered":"2024-05-27T10:52:04.732885+0000","last_clean":"2024-05-27T10:52:04.732885+0000","last_became_active":"2024-05-27T10:52:02.281820+0000","last_became_peered":"2024-05-27T10:52:02.281820+0000","last_unstale":"2024-05-27T10:52:04.732885+0000","last_undegraded":"2024-05-27T10:52:04.732885+0000","last_fullsized":"2024-05-27T10:52:04.732885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:28:35.769753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.515104+0000","last_change":"2024-05-27T10:52:01.246155+0000","last_active":"2024-05-27T10:52:04.515104+0000","last_peered":"2024-05-27T10:52:04.515104+0000","last_clean":"2024-05-27T10:52:04.515104+0000","last_became_active":"2024-05-27T10:52:01.245811+0000","last_became_peered":"2024-05-27T10:52:01.245811+0000","last_unstale":"2024-05-27T10:52:04.515104+0000","last_undegraded":"2024-05-27T10:52:04.515104+0000","last_fullsized":"2024-05-27T10:52:04.515104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:27:25.826446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.733436+0000","last_change":"2024-05-27T10:52:02.280894+0000","last_active":"2024-05-27T10:52:04.733436+0000","last_peered":"2024-05-27T10:52:04.733436+0000","last_clean":"2024-05-27T10:52:04.733436+0000","last_became_active":"2024-05-27T10:52:02.280424+0000","last_became_peered":"2024-05-27T10:52:02.280424+0000","last_unstale":"2024-05-27T10:52:04.733436+0000","last_undegraded":"2024-05-27T10:52:04.733436+0000","last_fullsized":"2024-05-27T10:52:04.733436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:58:41.336092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:04.515285+0000","last_change":"2024-05-27T10:52:01.245511+0000","last_active":"2024-05-27T10:52:04.515285+0000","last_peered":"2024-05-27T10:52:04.515285+0000","last_clean":"2024-05-27T10:52:04.515285+0000","last_became_active":"2024-05-27T10:52:01.244152+0000","last_became_peered":"2024-05-27T10:52:01.244152+0000","last_unstale":"2024-05-27T10:52:04.515285+0000","last_undegraded":"2024-05-27T10:52:04.515285+0000","last_fullsized":"2024-05-27T10:52:04.515285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:49:03.555502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279831+0000","last_change":"2024-05-27T10:52:02.267004+0000","last_active":"2024-05-27T10:52:03.279831+0000","last_peered":"2024-05-27T10:52:03.279831+0000","last_clean":"2024-05-27T10:52:03.279831+0000","last_became_active":"2024-05-27T10:52:02.266389+0000","last_became_peered":"2024-05-27T10:52:02.266389+0000","last_unstale":"2024-05-27T10:52:03.279831+0000","last_undegraded":"2024-05-27T10:52:03.279831+0000","last_fullsized":"2024-05-27T10:52:03.279831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:42:51.939151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280652+0000","last_change":"2024-05-27T10:52:01.223850+0000","last_active":"2024-05-27T10:52:03.280652+0000","last_peered":"2024-05-27T10:52:03.280652+0000","last_clean":"2024-05-27T10:52:03.280652+0000","last_became_active":"2024-05-27T10:52:01.223551+0000","last_became_peered":"2024-05-27T10:52:01.223551+0000","last_unstale":"2024-05-27T10:52:03.280652+0000","last_undegraded":"2024-05-27T10:52:03.280652+0000","last_fullsized":"2024-05-27T10:52:03.280652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:06:19.471570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.280502+0000","last_change":"2024-05-27T10:52:02.291956+0000","last_active":"2024-05-27T10:52:03.280502+0000","last_peered":"2024-05-27T10:52:03.280502+0000","last_clean":"2024-05-27T10:52:03.280502+0000","last_became_active":"2024-05-27T10:52:02.291647+0000","last_became_peered":"2024-05-27T10:52:02.291647+0000","last_unstale":"2024-05-27T10:52:03.280502+0000","last_undegraded":"2024-05-27T10:52:03.280502+0000","last_fullsized":"2024-05-27T10:52:03.280502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:01.187949+0000","last_clean_scrub_stamp":"2024-05-27T10:52:01.187949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:21:45.050385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-27T10:52:03.279431+0000","last_change":"2024-05-27T10:52:01.241871+0000","last_active":"2024-05-27T10:52:03.279431+0000","last_peered":"2024-05-27T10:52:03.279431+0000","last_clean":"2024-05-27T10:52:03.279431+0000","last_became_active":"2024-05-27T10:52:01.241577+0000","last_became_peered":"2024-05-27T10:52:01.241577+0000","last_unstale":"2024-05-27T10:52:03.279431+0000","last_undegraded":"2024-05-27T10:52:03.279431+0000","last_fullsized":"2024-05-27T10:52:03.279431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:52:00.183218+0000","last_clean_scrub_stamp":"2024-05-27T10:52:00.183218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:17:08.180814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T10:52:12.903 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-27T10:52:12.903 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-27T10:52:12.903 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-27T10:52:12.903 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-27T10:52:13.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.153+0000 7f763be00640 1 Processor -- start 2024-05-27T10:52:13.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.153+0000 7f763be00640 1 -- start start 2024-05-27T10:52:13.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.154+0000 7f763be00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f763c06e520 0x7f763c15c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:13.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.154+0000 7f763be00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f763c15cec0 0x7f763c0b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:13.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.154+0000 7f763be00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f763c15d430 con 0x7f763c0ad0a0 2024-05-27T10:52:13.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.154+0000 7f763be00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f763c15d710 con 0x7f763c15cec0 2024-05-27T10:52:13.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.154+0000 7f763be00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f763c06dd20 con 0x7f763c06e520 2024-05-27T10:52:13.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.155+0000 7f763a000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f763c06e520 0x7f763c15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:13.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.155+0000 7f763a000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f763c06e520 0x7f763c15c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:51962/0 (socket says 172.21.15.47:51962) 2024-05-27T10:52:13.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.155+0000 7f763a000640 1 -- 172.21.15.47:0/3500401251 learned_addr learned my addr 172.21.15.47:0/3500401251 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:13.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.155+0000 7f763b400640 1 --2- 172.21.15.47:0/3500401251 >> v2:172.21.15.53:3300/0 conn(0x7f763c15cec0 0x7f763c0b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:13.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.156+0000 7f763a000640 1 -- 172.21.15.47:0/3500401251 >> v2:172.21.15.53:3300/0 conn(0x7f763c15cec0 msgr2=0x7f763c0b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:13.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.156+0000 7f763a000640 1 --2- 172.21.15.47:0/3500401251 >> v2:172.21.15.53:3300/0 conn(0x7f763c15cec0 0x7f763c0b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:13.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.156+0000 7f763a000640 1 -- 172.21.15.47:0/3500401251 >> v1:172.21.15.53:6789/0 conn(0x7f763c0ad0a0 legacy=0x7f763c0ad480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:13.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.156+0000 7f763a000640 1 -- 172.21.15.47:0/3500401251 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f763c06e000 con 0x7f763c06e520 2024-05-27T10:52:13.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.157+0000 7f763a000640 1 --2- 172.21.15.47:0/3500401251 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f763c06e520 0x7f763c15c980 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f76280098a0 tx=0x7f762802a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=522b7b7700c0f048 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:13.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.157+0000 7f7639600640 1 -- 172.21.15.47:0/3500401251 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7628037070 con 0x7f763c06e520 2024-05-27T10:52:13.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.158+0000 7f7639600640 1 -- 172.21.15.47:0/3500401251 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7628032440 con 0x7f763c06e520 2024-05-27T10:52:13.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.158+0000 7f7639600640 1 -- 172.21.15.47:0/3500401251 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7628032810 con 0x7f763c06e520 2024-05-27T10:52:13.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.158+0000 7f763be00640 1 -- 172.21.15.47:0/3500401251 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f763c06e520 msgr2=0x7f763c15c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:13.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.158+0000 7f763be00640 1 --2- 172.21.15.47:0/3500401251 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f763c06e520 0x7f763c15c980 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f76280098a0 tx=0x7f762802a2a0 comp rx=0 tx=0).stop 2024-05-27T10:52:13.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.158+0000 7f763be00640 1 -- 172.21.15.47:0/3500401251 shutdown_connections 2024-05-27T10:52:13.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.158+0000 7f763be00640 1 --2- 172.21.15.47:0/3500401251 >> v2:172.21.15.53:3300/0 conn(0x7f763c15cec0 0x7f763c0b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:13.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.158+0000 7f763be00640 1 --2- 172.21.15.47:0/3500401251 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f763c06e520 0x7f763c15c980 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:13.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.158+0000 7f763be00640 1 -- 172.21.15.47:0/3500401251 >> 172.21.15.47:0/3500401251 conn(0x7f763c0b1fa0 msgr2=0x7f763c0b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:13.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.158+0000 7f763be00640 1 -- 172.21.15.47:0/3500401251 shutdown_connections 2024-05-27T10:52:13.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.158+0000 7f763be00640 1 -- 172.21.15.47:0/3500401251 wait complete. 2024-05-27T10:52:13.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.160+0000 7f763be00640 1 Processor -- start 2024-05-27T10:52:13.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.161+0000 7f763be00640 1 -- start start 2024-05-27T10:52:13.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.162+0000 7f763be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763c06e520 0x7f763c1fa070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:13.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.162+0000 7f763be00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f763c0ad0a0 0x7f763c1f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:13.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.162+0000 7f763be00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f763c15cec0 0x7f763c0cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:13.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.162+0000 7f763be00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f763c0af330 con 0x7f763c06e520 2024-05-27T10:52:13.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.162+0000 7f763be00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f763c0af1b0 con 0x7f763c0ad0a0 2024-05-27T10:52:13.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.162+0000 7f763be00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f763c06e9a0 con 0x7f763c15cec0 2024-05-27T10:52:13.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.162+0000 7f763aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763c06e520 0x7f763c1fa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:13.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.162+0000 7f763aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763c06e520 0x7f763c1fa070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34408/0 (socket says 172.21.15.47:34408) 2024-05-27T10:52:13.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.162+0000 7f763aa00640 1 -- 172.21.15.47:0/3832217052 learned_addr learned my addr 172.21.15.47:0/3832217052 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:13.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.163+0000 7f763a000640 1 --2- 172.21.15.47:0/3832217052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f763c0ad0a0 0x7f763c1f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:13.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.163+0000 7f763aa00640 1 -- 172.21.15.47:0/3832217052 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f763c15cec0 msgr2=0x7f763c0cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:13.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.163+0000 7f763aa00640 1 --2- 172.21.15.47:0/3832217052 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f763c15cec0 0x7f763c0cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:13.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.163+0000 7f763aa00640 1 -- 172.21.15.47:0/3832217052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f763c0ad0a0 msgr2=0x7f763c1f87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:13.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.163+0000 7f763aa00640 1 --2- 172.21.15.47:0/3832217052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f763c0ad0a0 0x7f763c1f87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:13.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.163+0000 7f763aa00640 1 -- 172.21.15.47:0/3832217052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f763c1f8d20 con 0x7f763c06e520 2024-05-27T10:52:13.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.163+0000 7f763a000640 1 --2- 172.21.15.47:0/3832217052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f763c0ad0a0 0x7f763c1f87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:13.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.163+0000 7f763aa00640 1 --2- 172.21.15.47:0/3832217052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763c06e520 0x7f763c1fa070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f762c00c3c0 tx=0x7f762c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:13.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.163+0000 7f7632a00640 1 -- 172.21.15.47:0/3832217052 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762c0052d0 con 0x7f763c06e520 2024-05-27T10:52:13.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.163+0000 7f7632a00640 1 -- 172.21.15.47:0/3832217052 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f762c005490 con 0x7f763c06e520 2024-05-27T10:52:13.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.163+0000 7f7632a00640 1 -- 172.21.15.47:0/3832217052 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762c007260 con 0x7f763c06e520 2024-05-27T10:52:13.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.163+0000 7f763be00640 1 -- 172.21.15.47:0/3832217052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f763c0cd210 con 0x7f763c06e520 2024-05-27T10:52:13.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.163+0000 7f763be00640 1 -- 172.21.15.47:0/3832217052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f763c0cd7d0 con 0x7f763c06e520 2024-05-27T10:52:13.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.164+0000 7f763be00640 1 -- 172.21.15.47:0/3832217052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f763c0689e0 con 0x7f763c06e520 2024-05-27T10:52:13.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.165+0000 7f7632a00640 1 -- 172.21.15.47:0/3832217052 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f762c007400 con 0x7f763c06e520 2024-05-27T10:52:13.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.166+0000 7f7632a00640 1 --2- 172.21.15.47:0/3832217052 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f761c06c8f0 0x7f761c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:13.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.166+0000 7f7632a00640 1 -- 172.21.15.47:0/3832217052 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f762c08b0f0 con 0x7f763c06e520 2024-05-27T10:52:13.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.167+0000 7f763a000640 1 --2- 172.21.15.47:0/3832217052 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f761c06c8f0 0x7f761c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:13.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.168+0000 7f763a000640 1 --2- 172.21.15.47:0/3832217052 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f761c06c8f0 0x7f761c06edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7628034000 tx=0x7f762802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:13.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.171+0000 7f7632a00640 1 -- 172.21.15.47:0/3832217052 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f762c059480 con 0x7f763c06e520 2024-05-27T10:52:13.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.407+0000 7f763be00640 1 -- 172.21.15.47:0/3832217052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f763c1f8ef0 con 0x7f763c06e520 2024-05-27T10:52:13.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.408+0000 7f7632a00640 1 -- 172.21.15.47:0/3832217052 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f762c058d80 con 0x7f763c06e520 2024-05-27T10:52:13.406 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:13.406 INFO:teuthology.orchestra.run.smithi047.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-27T10:52:13.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.410+0000 7f763be00640 1 -- 172.21.15.47:0/3832217052 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f761c06c8f0 msgr2=0x7f761c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:13.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.410+0000 7f763be00640 1 --2- 172.21.15.47:0/3832217052 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f761c06c8f0 0x7f761c06edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7628034000 tx=0x7f762802e000 comp rx=0 tx=0).stop 2024-05-27T10:52:13.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.410+0000 7f763be00640 1 -- 172.21.15.47:0/3832217052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763c06e520 msgr2=0x7f763c1fa070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:13.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.410+0000 7f763be00640 1 --2- 172.21.15.47:0/3832217052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763c06e520 0x7f763c1fa070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f762c00c3c0 tx=0x7f762c00c880 comp rx=0 tx=0).stop 2024-05-27T10:52:13.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.410+0000 7f763be00640 1 -- 172.21.15.47:0/3832217052 shutdown_connections 2024-05-27T10:52:13.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.410+0000 7f763be00640 1 --2- 172.21.15.47:0/3832217052 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f761c06c8f0 0x7f761c06edb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:13.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.410+0000 7f763be00640 1 --2- 172.21.15.47:0/3832217052 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f763c15cec0 0x7f763c0cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:13.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.410+0000 7f763be00640 1 --2- 172.21.15.47:0/3832217052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f763c0ad0a0 0x7f763c1f87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:13.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.410+0000 7f763be00640 1 --2- 172.21.15.47:0/3832217052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763c06e520 0x7f763c1fa070 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:13.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.410+0000 7f763be00640 1 -- 172.21.15.47:0/3832217052 >> 172.21.15.47:0/3832217052 conn(0x7f763c0b1fa0 msgr2=0x7f763c15da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:13.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.411+0000 7f763be00640 1 -- 172.21.15.47:0/3832217052 shutdown_connections 2024-05-27T10:52:13.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.411+0000 7f763be00640 1 -- 172.21.15.47:0/3832217052 wait complete. 2024-05-27T10:52:13.427 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-27T10:52:13.427 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:52:13.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.636+0000 7fe2cbe00640 1 Processor -- start 2024-05-27T10:52:13.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.637+0000 7fe2cbe00640 1 -- start start 2024-05-27T10:52:13.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.638+0000 7fe2cbe00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe2cc15eaa0 0x7fe2cc0d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:13.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.638+0000 7fe2cbe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe2cc06ca40 0x7fe2cc0d2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:13.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.638+0000 7fe2cbe00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2cc0d0950 con 0x7fe2cc06d240 2024-05-27T10:52:13.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.638+0000 7fe2cbe00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe2cc0cf4b0 con 0x7fe2cc06ca40 2024-05-27T10:52:13.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.638+0000 7fe2cbe00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe2cc0cebc0 con 0x7fe2cc15eaa0 2024-05-27T10:52:13.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.639+0000 7fe2cb400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe2cc06ca40 0x7fe2cc0d2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:13.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.639+0000 7fe2cb400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe2cc06ca40 0x7fe2cc0d2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34414/0 (socket says 172.21.15.47:34414) 2024-05-27T10:52:13.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.639+0000 7fe2cb400640 1 -- 172.21.15.47:0/3374423553 learned_addr learned my addr 172.21.15.47:0/3374423553 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:13.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.639+0000 7fe2ca000640 1 --2- 172.21.15.47:0/3374423553 >> v2:172.21.15.53:3300/0 conn(0x7fe2cc15eaa0 0x7fe2cc0d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:13.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.639+0000 7fe2cb400640 1 -- 172.21.15.47:0/3374423553 >> v2:172.21.15.53:3300/0 conn(0x7fe2cc15eaa0 msgr2=0x7fe2cc0d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:13.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.639+0000 7fe2cb400640 1 --2- 172.21.15.47:0/3374423553 >> v2:172.21.15.53:3300/0 conn(0x7fe2cc15eaa0 0x7fe2cc0d2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:13.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.639+0000 7fe2cb400640 1 -- 172.21.15.47:0/3374423553 >> v1:172.21.15.53:6789/0 conn(0x7fe2cc06d240 legacy=0x7fe2cc06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:13.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.639+0000 7fe2cb400640 1 -- 172.21.15.47:0/3374423553 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2cc0cee60 con 0x7fe2cc06ca40 2024-05-27T10:52:13.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.640+0000 7fe2cb400640 1 --2- 172.21.15.47:0/3374423553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2cc06ca40 0x7fe2cc0d2bc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0c7e00 tx=0x7fe2c402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24eca841c682d09b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:13.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.641+0000 7fe2c9600640 1 -- 172.21.15.47:0/3374423553 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4036070 con 0x7fe2cc06ca40 2024-05-27T10:52:13.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.641+0000 7fe2c9600640 1 -- 172.21.15.47:0/3374423553 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c4031600 con 0x7fe2cc06ca40 2024-05-27T10:52:13.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.641+0000 7fe2c9600640 1 -- 172.21.15.47:0/3374423553 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c40319d0 con 0x7fe2cc06ca40 2024-05-27T10:52:13.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.641+0000 7fe2cbe00640 1 -- 172.21.15.47:0/3374423553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2cc06ca40 msgr2=0x7fe2cc0d2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:13.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.641+0000 7fe2cbe00640 1 --2- 172.21.15.47:0/3374423553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2cc06ca40 0x7fe2cc0d2bc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0c7e00 tx=0x7fe2c402a6f0 comp rx=0 tx=0).stop 2024-05-27T10:52:13.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.642+0000 7fe2cbe00640 1 -- 172.21.15.47:0/3374423553 shutdown_connections 2024-05-27T10:52:13.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.642+0000 7fe2cbe00640 1 --2- 172.21.15.47:0/3374423553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2cc06ca40 0x7fe2cc0d2bc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:13.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.642+0000 7fe2cbe00640 1 --2- 172.21.15.47:0/3374423553 >> v2:172.21.15.53:3300/0 conn(0x7fe2cc15eaa0 0x7fe2cc0d2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:13.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.642+0000 7fe2cbe00640 1 -- 172.21.15.47:0/3374423553 >> 172.21.15.47:0/3374423553 conn(0x7fe2cc08bfd0 msgr2=0x7fe2cc0d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:13.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.642+0000 7fe2cbe00640 1 -- 172.21.15.47:0/3374423553 shutdown_connections 2024-05-27T10:52:13.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.642+0000 7fe2cbe00640 1 -- 172.21.15.47:0/3374423553 wait complete. 2024-05-27T10:52:13.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.643+0000 7fe2cbe00640 1 Processor -- start 2024-05-27T10:52:13.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.644+0000 7fe2cbe00640 1 -- start start 2024-05-27T10:52:13.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.644+0000 7fe2cbe00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2cc06ca40 0x7fe2cc0cded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:13.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.644+0000 7fe2cbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2cc06d240 0x7fe2cc157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:13.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.644+0000 7fe2cbe00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe2cc15eaa0 0x7fe2cc0c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:13.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.645+0000 7fe2cbe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe2cc0b10a0 con 0x7fe2cc06d240 2024-05-27T10:52:13.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.645+0000 7fe2cbe00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe2cc06cf40 con 0x7fe2cc06ca40 2024-05-27T10:52:13.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.645+0000 7fe2cbe00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe2cc0b1220 con 0x7fe2cc15eaa0 2024-05-27T10:52:13.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.645+0000 7fe2ca000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2cc06d240 0x7fe2cc157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:13.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.645+0000 7fe2ca000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2cc06d240 0x7fe2cc157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34416/0 (socket says 172.21.15.47:34416) 2024-05-27T10:52:13.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.645+0000 7fe2ca000640 1 -- 172.21.15.47:0/1927127414 learned_addr learned my addr 172.21.15.47:0/1927127414 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:13.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.645+0000 7fe2caa00640 1 --2- 172.21.15.47:0/1927127414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2cc06ca40 0x7fe2cc0cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:13.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.645+0000 7fe2cb400640 1 --2- 172.21.15.47:0/1927127414 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe2cc15eaa0 0x7fe2cc0c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:13.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.645+0000 7fe2ca000640 1 -- 172.21.15.47:0/1927127414 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe2cc15eaa0 msgr2=0x7fe2cc0c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:13.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.645+0000 7fe2ca000640 1 --2- 172.21.15.47:0/1927127414 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe2cc15eaa0 0x7fe2cc0c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:13.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.645+0000 7fe2ca000640 1 -- 172.21.15.47:0/1927127414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2cc06ca40 msgr2=0x7fe2cc0cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:13.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.645+0000 7fe2ca000640 1 --2- 172.21.15.47:0/1927127414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2cc06ca40 0x7fe2cc0cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:13.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.645+0000 7fe2ca000640 1 -- 172.21.15.47:0/1927127414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2cc1596f0 con 0x7fe2cc06d240 2024-05-27T10:52:13.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.645+0000 7fe2cb400640 1 --2- 172.21.15.47:0/1927127414 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe2cc15eaa0 0x7fe2cc0c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:13.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.645+0000 7fe2caa00640 1 --2- 172.21.15.47:0/1927127414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2cc06ca40 0x7fe2cc0cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:13.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.646+0000 7fe2ca000640 1 --2- 172.21.15.47:0/1927127414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2cc06d240 0x7fe2cc157910 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe2b400d7d0 tx=0x7fe2b400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:13.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.646+0000 7fe2c2a00640 1 -- 172.21.15.47:0/1927127414 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b400b6c0 con 0x7fe2cc06d240 2024-05-27T10:52:13.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.646+0000 7fe2c2a00640 1 -- 172.21.15.47:0/1927127414 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2b4019070 con 0x7fe2cc06d240 2024-05-27T10:52:13.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.646+0000 7fe2c2a00640 1 -- 172.21.15.47:0/1927127414 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b400bac0 con 0x7fe2cc06d240 2024-05-27T10:52:13.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.646+0000 7fe2cbe00640 1 -- 172.21.15.47:0/1927127414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2cc1599d0 con 0x7fe2cc06d240 2024-05-27T10:52:13.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.646+0000 7fe2cbe00640 1 -- 172.21.15.47:0/1927127414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2cc159f90 con 0x7fe2cc06d240 2024-05-27T10:52:13.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.647+0000 7fe2cbe00640 1 -- 172.21.15.47:0/1927127414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2cc04fce0 con 0x7fe2cc06d240 2024-05-27T10:52:13.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.648+0000 7fe2c2a00640 1 -- 172.21.15.47:0/1927127414 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe2b400bc60 con 0x7fe2cc06d240 2024-05-27T10:52:13.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.649+0000 7fe2c2a00640 1 --2- 172.21.15.47:0/1927127414 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe2a806c920 0x7fe2a806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:13.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.649+0000 7fe2c2a00640 1 -- 172.21.15.47:0/1927127414 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe2b408bfc0 con 0x7fe2cc06d240 2024-05-27T10:52:13.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.649+0000 7fe2caa00640 1 --2- 172.21.15.47:0/1927127414 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe2a806c920 0x7fe2a806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:13.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.650+0000 7fe2caa00640 1 --2- 172.21.15.47:0/1927127414 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe2a806c920 0x7fe2a806ede0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc003eb0 tx=0x7fe2bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:13.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.654+0000 7fe2c2a00640 1 -- 172.21.15.47:0/1927127414 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe2b405a3e0 con 0x7fe2cc06d240 2024-05-27T10:52:13.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.867+0000 7fe2cbe00640 1 -- 172.21.15.47:0/1927127414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2cc0d2ca0 con 0x7fe2cc06d240 2024-05-27T10:52:13.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.870+0000 7fe2c2a00640 1 -- 172.21.15.47:0/1927127414 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16521 (secure 0 0 0) 0x7fe2b4059ce0 con 0x7fe2cc06d240 2024-05-27T10:52:13.869 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:13.869 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:03.257638+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:52:13.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.872+0000 7fe2cbe00640 1 -- 172.21.15.47:0/1927127414 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe2a806c920 msgr2=0x7fe2a806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:13.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.872+0000 7fe2cbe00640 1 --2- 172.21.15.47:0/1927127414 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe2a806c920 0x7fe2a806ede0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc003eb0 tx=0x7fe2bc009040 comp rx=0 tx=0).stop 2024-05-27T10:52:13.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.872+0000 7fe2cbe00640 1 -- 172.21.15.47:0/1927127414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2cc06d240 msgr2=0x7fe2cc157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:13.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.872+0000 7fe2cbe00640 1 --2- 172.21.15.47:0/1927127414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2cc06d240 0x7fe2cc157910 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe2b400d7d0 tx=0x7fe2b400dc90 comp rx=0 tx=0).stop 2024-05-27T10:52:13.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.872+0000 7fe2cbe00640 1 -- 172.21.15.47:0/1927127414 shutdown_connections 2024-05-27T10:52:13.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.872+0000 7fe2cbe00640 1 --2- 172.21.15.47:0/1927127414 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe2a806c920 0x7fe2a806ede0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:13.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.872+0000 7fe2cbe00640 1 --2- 172.21.15.47:0/1927127414 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe2cc15eaa0 0x7fe2cc0c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:13.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.872+0000 7fe2cbe00640 1 --2- 172.21.15.47:0/1927127414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2cc06d240 0x7fe2cc157910 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:13.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.872+0000 7fe2cbe00640 1 --2- 172.21.15.47:0/1927127414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2cc06ca40 0x7fe2cc0cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:13.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.873+0000 7fe2cbe00640 1 -- 172.21.15.47:0/1927127414 >> 172.21.15.47:0/1927127414 conn(0x7fe2cc08bfd0 msgr2=0x7fe2cc15dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:13.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.873+0000 7fe2cbe00640 1 -- 172.21.15.47:0/1927127414 shutdown_connections 2024-05-27T10:52:13.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:13.873+0000 7fe2cbe00640 1 -- 172.21.15.47:0/1927127414 wait complete. 2024-05-27T10:52:13.891 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T10:51:55.073251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T10:51:59.202702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T10:52:00.664039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T10:52:13.891 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T10:52:14.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.113+0000 7fc291600640 1 Processor -- start 2024-05-27T10:52:14.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.113+0000 7fc291600640 1 -- start start 2024-05-27T10:52:14.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.114+0000 7fc291600640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc28c15c4a0 0x7fc28c071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:14.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.114+0000 7fc291600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc28c0d1ad0 0x7fc28c0c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:14.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.114+0000 7fc291600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc28c072350 con 0x7fc28c0cc990 2024-05-27T10:52:14.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.114+0000 7fc291600640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fc28c071ab0 con 0x7fc28c15c4a0 2024-05-27T10:52:14.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.114+0000 7fc291600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc28c071d90 con 0x7fc28c0d1ad0 2024-05-27T10:52:14.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.115+0000 7fc290c00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc28c0cc990 0x7fc28c0d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60356/0 (socket says 172.21.15.47:60356) 2024-05-27T10:52:14.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.115+0000 7fc290c00640 1 -- 172.21.15.47:0/803773745 learned_addr learned my addr 172.21.15.47:0/803773745 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:14.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.115+0000 7fc28b400640 1 --2- 172.21.15.47:0/803773745 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc28c0d1ad0 0x7fc28c0c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:14.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.115+0000 7fc28be00640 1 --2- 172.21.15.47:0/803773745 >> v2:172.21.15.53:3300/0 conn(0x7fc28c15c4a0 0x7fc28c071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:14.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.115+0000 7fc28aa00640 1 -- 172.21.15.47:0/803773745 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4156546907 0 0) 0x7fc28c072350 con 0x7fc28c0cc990 2024-05-27T10:52:14.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.115+0000 7fc28aa00640 1 -- 172.21.15.47:0/803773745 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc270003520 con 0x7fc28c0cc990 2024-05-27T10:52:14.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.116+0000 7fc28aa00640 1 -- 172.21.15.47:0/803773745 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1142775714 0 0) 0x7fc270003520 con 0x7fc28c0cc990 2024-05-27T10:52:14.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.116+0000 7fc28aa00640 1 -- 172.21.15.47:0/803773745 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc28c0d1ad0 msgr2=0x7fc28c0c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:14.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.116+0000 7fc28aa00640 1 --2- 172.21.15.47:0/803773745 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc28c0d1ad0 0x7fc28c0c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.116+0000 7fc28aa00640 1 -- 172.21.15.47:0/803773745 >> v2:172.21.15.53:3300/0 conn(0x7fc28c15c4a0 msgr2=0x7fc28c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:14.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.116+0000 7fc28aa00640 1 --2- 172.21.15.47:0/803773745 >> v2:172.21.15.53:3300/0 conn(0x7fc28c15c4a0 0x7fc28c071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.116+0000 7fc28aa00640 1 -- 172.21.15.47:0/803773745 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28c072070 con 0x7fc28c0cc990 2024-05-27T10:52:14.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.116+0000 7fc28aa00640 1 -- 172.21.15.47:0/803773745 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7fc2840019f0 con 0x7fc28c0cc990 2024-05-27T10:52:14.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.116+0000 7fc28aa00640 1 -- 172.21.15.47:0/803773745 >> v1:172.21.15.47:6789/0 conn(0x7fc28c0cc990 legacy=0x7fc28c0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:14.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.116+0000 7fc28aa00640 1 --2- 172.21.15.47:0/803773745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2700039b0 0x7fc270003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.116+0000 7fc28aa00640 1 --2- 172.21.15.47:0/803773745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270004800 0x7fc270004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.116+0000 7fc28aa00640 1 --2- 172.21.15.47:0/803773745 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc28c0d1ad0 0x7fc2700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.116+0000 7fc28aa00640 1 -- 172.21.15.47:0/803773745 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c071ab0 con 0x7fc270004800 2024-05-27T10:52:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.116+0000 7fc28aa00640 1 -- 172.21.15.47:0/803773745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c071d90 con 0x7fc2700039b0 2024-05-27T10:52:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.116+0000 7fc28aa00640 1 -- 172.21.15.47:0/803773745 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc27000b9c0 con 0x7fc28c0d1ad0 2024-05-27T10:52:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.116+0000 7fc28b400640 1 --2- 172.21.15.47:0/803773745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270004800 0x7fc270004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.117+0000 7fc28b400640 1 -- 172.21.15.47:0/803773745 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc28c0d1ad0 msgr2=0x7fc2700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.117+0000 7fc28b400640 1 --2- 172.21.15.47:0/803773745 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc28c0d1ad0 0x7fc2700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.117+0000 7fc28b400640 1 -- 172.21.15.47:0/803773745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2700039b0 msgr2=0x7fc270003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.117+0000 7fc28be00640 1 --2- 172.21.15.47:0/803773745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2700039b0 0x7fc270003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.117+0000 7fc28b400640 1 --2- 172.21.15.47:0/803773745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2700039b0 0x7fc270003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.117+0000 7fc28b400640 1 -- 172.21.15.47:0/803773745 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc270003520 con 0x7fc270004800 2024-05-27T10:52:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.118+0000 7fc28b400640 1 --2- 172.21.15.47:0/803773745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270004800 0x7fc270004c80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc278009ac0 tx=0x7fc270005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0fb92d2c4dde142 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.118+0000 7fc28aa00640 1 -- 172.21.15.47:0/803773745 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278036070 con 0x7fc270004800 2024-05-27T10:52:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.118+0000 7fc28aa00640 1 -- 172.21.15.47:0/803773745 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc278031400 con 0x7fc270004800 2024-05-27T10:52:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.118+0000 7fc28aa00640 1 -- 172.21.15.47:0/803773745 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278009690 con 0x7fc270004800 2024-05-27T10:52:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.119+0000 7fc291600640 1 -- 172.21.15.47:0/803773745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270004800 msgr2=0x7fc270004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.119+0000 7fc291600640 1 --2- 172.21.15.47:0/803773745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270004800 0x7fc270004c80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc278009ac0 tx=0x7fc270005830 comp rx=0 tx=0).stop 2024-05-27T10:52:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.119+0000 7fc290c00640 1 -- 172.21.15.47:0/803773745 reap_dead start 2024-05-27T10:52:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.119+0000 7fc291600640 1 -- 172.21.15.47:0/803773745 shutdown_connections 2024-05-27T10:52:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.119+0000 7fc291600640 1 -- 172.21.15.47:0/803773745 >> 172.21.15.47:0/803773745 conn(0x7fc28c06fc30 msgr2=0x7fc28c070040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.119+0000 7fc291600640 1 -- 172.21.15.47:0/803773745 shutdown_connections 2024-05-27T10:52:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.119+0000 7fc291600640 1 -- 172.21.15.47:0/803773745 wait complete. 2024-05-27T10:52:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.121+0000 7fc291600640 1 Processor -- start 2024-05-27T10:52:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.121+0000 7fc291600640 1 -- start start 2024-05-27T10:52:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.122+0000 7fc291600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270004800 0x7fc28c146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.122+0000 7fc291600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc28c1442f0 0x7fc28c1f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.122+0000 7fc291600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc28c158330 0x7fc28c0d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.122+0000 7fc291600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c15c880 con 0x7fc270004800 2024-05-27T10:52:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.122+0000 7fc291600640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c0ceac0 con 0x7fc28c1442f0 2024-05-27T10:52:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.122+0000 7fc291600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc28c0c5e90 con 0x7fc28c158330 2024-05-27T10:52:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.122+0000 7fc28be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270004800 0x7fc28c146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.122+0000 7fc28be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270004800 0x7fc28c146d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34438/0 (socket says 172.21.15.47:34438) 2024-05-27T10:52:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.122+0000 7fc28be00640 1 -- 172.21.15.47:0/3784264727 learned_addr learned my addr 172.21.15.47:0/3784264727 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.123+0000 7fc28be00640 1 -- 172.21.15.47:0/3784264727 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc28c158330 msgr2=0x7fc28c0d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.123+0000 7fc290c00640 1 --2- 172.21.15.47:0/3784264727 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc28c158330 0x7fc28c0d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.123+0000 7fc28be00640 1 --2- 172.21.15.47:0/3784264727 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc28c158330 0x7fc28c0d03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.123+0000 7fc28b400640 1 --2- 172.21.15.47:0/3784264727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc28c1442f0 0x7fc28c1f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.123+0000 7fc28be00640 1 -- 172.21.15.47:0/3784264727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc28c1442f0 msgr2=0x7fc28c1f4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.123+0000 7fc28be00640 1 --2- 172.21.15.47:0/3784264727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc28c1442f0 0x7fc28c1f4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.123+0000 7fc28be00640 1 -- 172.21.15.47:0/3784264727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28c1472d0 con 0x7fc270004800 2024-05-27T10:52:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.123+0000 7fc28be00640 1 --2- 172.21.15.47:0/3784264727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270004800 0x7fc28c146d90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0108e0 tx=0x7fc27c010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.123+0000 7fc283e00640 1 -- 172.21.15.47:0/3784264727 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27c00f040 con 0x7fc270004800 2024-05-27T10:52:14.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.123+0000 7fc283e00640 1 -- 172.21.15.47:0/3784264727 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc27c00eb60 con 0x7fc270004800 2024-05-27T10:52:14.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.123+0000 7fc283e00640 1 -- 172.21.15.47:0/3784264727 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27c01c400 con 0x7fc270004800 2024-05-27T10:52:14.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.123+0000 7fc291600640 1 -- 172.21.15.47:0/3784264727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc28c0b7c20 con 0x7fc270004800 2024-05-27T10:52:14.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.124+0000 7fc291600640 1 -- 172.21.15.47:0/3784264727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc28c159e90 con 0x7fc270004800 2024-05-27T10:52:14.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.125+0000 7fc291600640 1 -- 172.21.15.47:0/3784264727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc28c0cf660 con 0x7fc270004800 2024-05-27T10:52:14.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.126+0000 7fc283e00640 1 -- 172.21.15.47:0/3784264727 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc27c01c5a0 con 0x7fc270004800 2024-05-27T10:52:14.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.127+0000 7fc283e00640 1 --2- 172.21.15.47:0/3784264727 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc26c06c970 0x7fc26c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:14.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.127+0000 7fc283e00640 1 -- 172.21.15.47:0/3784264727 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc27c08c320 con 0x7fc270004800 2024-05-27T10:52:14.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.127+0000 7fc28b400640 1 --2- 172.21.15.47:0/3784264727 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc26c06c970 0x7fc26c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:14.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.128+0000 7fc28b400640 1 --2- 172.21.15.47:0/3784264727 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc26c06c970 0x7fc26c06ee30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc278033000 tx=0x7fc278008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:14.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.132+0000 7fc283e00640 1 -- 172.21.15.47:0/3784264727 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc28c0cf660 con 0x7fc270004800 2024-05-27T10:52:14.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.336+0000 7fc291600640 1 -- 172.21.15.47:0/3784264727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc28c06d590 con 0x7fc270004800 2024-05-27T10:52:14.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.337+0000 7fc283e00640 1 -- 172.21.15.47:0/3784264727 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fc28c06d590 con 0x7fc270004800 2024-05-27T10:52:14.335 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-27T10:52:14.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.340+0000 7fc291600640 1 -- 172.21.15.47:0/3784264727 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc26c06c970 msgr2=0x7fc26c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:14.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.340+0000 7fc291600640 1 --2- 172.21.15.47:0/3784264727 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc26c06c970 0x7fc26c06ee30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc278033000 tx=0x7fc278008030 comp rx=0 tx=0).stop 2024-05-27T10:52:14.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.340+0000 7fc291600640 1 -- 172.21.15.47:0/3784264727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270004800 msgr2=0x7fc28c146d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:14.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.340+0000 7fc291600640 1 --2- 172.21.15.47:0/3784264727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270004800 0x7fc28c146d90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0108e0 tx=0x7fc27c010da0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.340+0000 7fc291600640 1 -- 172.21.15.47:0/3784264727 shutdown_connections 2024-05-27T10:52:14.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.340+0000 7fc291600640 1 --2- 172.21.15.47:0/3784264727 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc26c06c970 0x7fc26c06ee30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.340+0000 7fc291600640 1 --2- 172.21.15.47:0/3784264727 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc28c158330 0x7fc28c0d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.340+0000 7fc291600640 1 --2- 172.21.15.47:0/3784264727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc28c1442f0 0x7fc28c1f4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.340+0000 7fc291600640 1 --2- 172.21.15.47:0/3784264727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270004800 0x7fc28c146d90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.340+0000 7fc291600640 1 -- 172.21.15.47:0/3784264727 >> 172.21.15.47:0/3784264727 conn(0x7fc28c06fc30 msgr2=0x7fc28c06d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:14.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.340+0000 7fc291600640 1 -- 172.21.15.47:0/3784264727 shutdown_connections 2024-05-27T10:52:14.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.340+0000 7fc291600640 1 -- 172.21.15.47:0/3784264727 wait complete. 2024-05-27T10:52:14.356 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T10:52:14.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.571+0000 7f33af200640 1 Processor -- start 2024-05-27T10:52:14.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.571+0000 7f33af200640 1 -- start start 2024-05-27T10:52:14.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.572+0000 7f33af200640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f33a815c510 0x7f33a80b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:14.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.572+0000 7f33af200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f33a80d0a30 0x7f33a80ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:14.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.572+0000 7f33af200640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33a80b4620 con 0x7f33a806da80 2024-05-27T10:52:14.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.572+0000 7f33af200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f33a80b4900 con 0x7f33a80d0a30 2024-05-27T10:52:14.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.572+0000 7f33af200640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f33a80b4be0 con 0x7f33a815c510 2024-05-27T10:52:14.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.572+0000 7f33ae800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f33a80d0a30 0x7f33a80ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:14.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.572+0000 7f33ae800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f33a80d0a30 0x7f33a80ce9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34446/0 (socket says 172.21.15.47:34446) 2024-05-27T10:52:14.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.572+0000 7f33ae800640 1 -- 172.21.15.47:0/1459883678 learned_addr learned my addr 172.21.15.47:0/1459883678 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:14.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.573+0000 7f33ade00640 1 --2- 172.21.15.47:0/1459883678 >> v2:172.21.15.53:3300/0 conn(0x7f33a815c510 0x7f33a80b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:14.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.573+0000 7f33ae800640 1 -- 172.21.15.47:0/1459883678 >> v2:172.21.15.53:3300/0 conn(0x7f33a815c510 msgr2=0x7f33a80b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:14.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.573+0000 7f33ae800640 1 --2- 172.21.15.47:0/1459883678 >> v2:172.21.15.53:3300/0 conn(0x7f33a815c510 0x7f33a80b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.573+0000 7f33ae800640 1 -- 172.21.15.47:0/1459883678 >> v1:172.21.15.53:6789/0 conn(0x7f33a806da80 legacy=0x7f33a80d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:14.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.573+0000 7f33ae800640 1 -- 172.21.15.47:0/1459883678 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a80b4ec0 con 0x7f33a80d0a30 2024-05-27T10:52:14.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.573+0000 7f33ade00640 1 --2- 172.21.15.47:0/1459883678 >> v2:172.21.15.53:3300/0 conn(0x7f33a815c510 0x7f33a80b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:14.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.574+0000 7f33ae800640 1 --2- 172.21.15.47:0/1459883678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33a80d0a30 0x7f33a80ce9f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f33a8073e60 tx=0x7f33a402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec213597400986fe server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:14.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.575+0000 7f33aca00640 1 -- 172.21.15.47:0/1459883678 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4036070 con 0x7f33a80d0a30 2024-05-27T10:52:14.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.575+0000 7f33aca00640 1 -- 172.21.15.47:0/1459883678 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a4031600 con 0x7f33a80d0a30 2024-05-27T10:52:14.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.575+0000 7f33aca00640 1 -- 172.21.15.47:0/1459883678 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a40319d0 con 0x7f33a80d0a30 2024-05-27T10:52:14.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.575+0000 7f33af200640 1 -- 172.21.15.47:0/1459883678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33a80d0a30 msgr2=0x7f33a80ce9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:14.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.575+0000 7f33af200640 1 --2- 172.21.15.47:0/1459883678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33a80d0a30 0x7f33a80ce9f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f33a8073e60 tx=0x7f33a402a6f0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.575+0000 7f33af200640 1 -- 172.21.15.47:0/1459883678 shutdown_connections 2024-05-27T10:52:14.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.575+0000 7f33af200640 1 --2- 172.21.15.47:0/1459883678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33a80d0a30 0x7f33a80ce9f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.575+0000 7f33af200640 1 --2- 172.21.15.47:0/1459883678 >> v2:172.21.15.53:3300/0 conn(0x7f33a815c510 0x7f33a80b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.575+0000 7f33af200640 1 -- 172.21.15.47:0/1459883678 >> 172.21.15.47:0/1459883678 conn(0x7f33a806bb20 msgr2=0x7f33a806bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:14.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.575+0000 7f33af200640 1 -- 172.21.15.47:0/1459883678 shutdown_connections 2024-05-27T10:52:14.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.576+0000 7f33af200640 1 -- 172.21.15.47:0/1459883678 wait complete. 2024-05-27T10:52:14.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.577+0000 7f33af200640 1 Processor -- start 2024-05-27T10:52:14.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.577+0000 7f33af200640 1 -- start start 2024-05-27T10:52:14.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.578+0000 7f33af200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33a806da80 0x7f33a8156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.578+0000 7f33af200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f33a80d0a30 0x7f33a815f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.578+0000 7f33af200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33a815c510 0x7f33a80b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.578+0000 7f33af200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f33a80b4390 con 0x7f33a806da80 2024-05-27T10:52:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.578+0000 7f33af200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f33a80b4210 con 0x7f33a815c510 2024-05-27T10:52:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.578+0000 7f33af200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f33a80cef30 con 0x7f33a80d0a30 2024-05-27T10:52:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.579+0000 7f33ade00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33a806da80 0x7f33a8156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.579+0000 7f33ade00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33a806da80 0x7f33a8156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34460/0 (socket says 172.21.15.47:34460) 2024-05-27T10:52:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.579+0000 7f33ade00640 1 -- 172.21.15.47:0/749102886 learned_addr learned my addr 172.21.15.47:0/749102886 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.579+0000 7f33ad400640 1 --2- 172.21.15.47:0/749102886 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f33a80d0a30 0x7f33a815f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.579+0000 7f33ade00640 1 -- 172.21.15.47:0/749102886 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f33a80d0a30 msgr2=0x7f33a815f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.579+0000 7f33ade00640 1 --2- 172.21.15.47:0/749102886 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f33a80d0a30 0x7f33a815f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.579+0000 7f33ae800640 1 --2- 172.21.15.47:0/749102886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33a815c510 0x7f33a80b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:14.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.579+0000 7f33ade00640 1 -- 172.21.15.47:0/749102886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33a815c510 msgr2=0x7f33a80b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:14.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.579+0000 7f33ade00640 1 --2- 172.21.15.47:0/749102886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33a815c510 0x7f33a80b1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.579+0000 7f33ade00640 1 -- 172.21.15.47:0/749102886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a81e5fc0 con 0x7f33a806da80 2024-05-27T10:52:14.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.580+0000 7f33ade00640 1 --2- 172.21.15.47:0/749102886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33a806da80 0x7f33a8156bc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f339c00c820 tx=0x7f339c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:14.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.580+0000 7f33a2000640 1 -- 172.21.15.47:0/749102886 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c015070 con 0x7f33a806da80 2024-05-27T10:52:14.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.580+0000 7f33a2000640 1 -- 172.21.15.47:0/749102886 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f339c0079d0 con 0x7f33a806da80 2024-05-27T10:52:14.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.580+0000 7f33a2000640 1 -- 172.21.15.47:0/749102886 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c007d80 con 0x7f33a806da80 2024-05-27T10:52:14.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.580+0000 7f33af200640 1 -- 172.21.15.47:0/749102886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a81e62a0 con 0x7f33a806da80 2024-05-27T10:52:14.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.580+0000 7f33af200640 1 -- 172.21.15.47:0/749102886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a81e6860 con 0x7f33a806da80 2024-05-27T10:52:14.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.581+0000 7f33af200640 1 -- 172.21.15.47:0/749102886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a804fce0 con 0x7f33a806da80 2024-05-27T10:52:14.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.582+0000 7f33a2000640 1 -- 172.21.15.47:0/749102886 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f339c018070 con 0x7f33a806da80 2024-05-27T10:52:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.583+0000 7f33a2000640 1 --2- 172.21.15.47:0/749102886 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f338c06c8f0 0x7f338c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.584+0000 7f33a2000640 1 -- 172.21.15.47:0/749102886 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f339c08ba60 con 0x7f33a806da80 2024-05-27T10:52:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.584+0000 7f33ad400640 1 --2- 172.21.15.47:0/749102886 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f338c06c8f0 0x7f338c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.584+0000 7f33ad400640 1 --2- 172.21.15.47:0/749102886 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f338c06c8f0 0x7f338c06edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f33a815bf20 tx=0x7f3398009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:14.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.588+0000 7f33a2000640 1 -- 172.21.15.47:0/749102886 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f339c059df0 con 0x7f33a806da80 2024-05-27T10:52:14.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.787+0000 7f33af200640 1 -- 172.21.15.47:0/749102886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f33a8068d10 con 0x7f33a806da80 2024-05-27T10:52:14.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.788+0000 7f33a2000640 1 -- 172.21.15.47:0/749102886 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f339c0596f0 con 0x7f33a806da80 2024-05-27T10:52:14.786 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-27T10:52:14.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.791+0000 7f33af200640 1 -- 172.21.15.47:0/749102886 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f338c06c8f0 msgr2=0x7f338c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:14.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.791+0000 7f33af200640 1 --2- 172.21.15.47:0/749102886 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f338c06c8f0 0x7f338c06edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f33a815bf20 tx=0x7f3398009040 comp rx=0 tx=0).stop 2024-05-27T10:52:14.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.791+0000 7f33af200640 1 -- 172.21.15.47:0/749102886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33a806da80 msgr2=0x7f33a8156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:14.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.791+0000 7f33af200640 1 --2- 172.21.15.47:0/749102886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33a806da80 0x7f33a8156bc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f339c00c820 tx=0x7f339c00cce0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.791+0000 7f33af200640 1 -- 172.21.15.47:0/749102886 shutdown_connections 2024-05-27T10:52:14.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.791+0000 7f33af200640 1 --2- 172.21.15.47:0/749102886 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f338c06c8f0 0x7f338c06edb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.791+0000 7f33af200640 1 --2- 172.21.15.47:0/749102886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33a815c510 0x7f33a80b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.791+0000 7f33af200640 1 --2- 172.21.15.47:0/749102886 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f33a80d0a30 0x7f33a815f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.791+0000 7f33af200640 1 --2- 172.21.15.47:0/749102886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33a806da80 0x7f33a8156bc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:14.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.791+0000 7f33af200640 1 -- 172.21.15.47:0/749102886 >> 172.21.15.47:0/749102886 conn(0x7f33a806bb20 msgr2=0x7f33a815a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:14.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.791+0000 7f33af200640 1 -- 172.21.15.47:0/749102886 shutdown_connections 2024-05-27T10:52:14.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:14.791+0000 7f33af200640 1 -- 172.21.15.47:0/749102886 wait complete. 2024-05-27T10:52:14.808 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T10:52:15.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.027+0000 7fbe95c00640 1 Processor -- start 2024-05-27T10:52:15.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.027+0000 7fbe95c00640 1 -- start start 2024-05-27T10:52:15.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.029+0000 7fbe95c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbe9013f690 0x7fbe900ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:15.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.029+0000 7fbe95c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe9015cd60 con 0x7fbe90072440 2024-05-27T10:52:15.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.029+0000 7fbe95c00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe9015d040 con 0x7fbe900cec90 2024-05-27T10:52:15.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.029+0000 7fbe95c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbe9015d320 con 0x7fbe9013f690 2024-05-27T10:52:15.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.029+0000 7fbe8f400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbe90072440 0x7fbe9013fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60370/0 (socket says 172.21.15.47:60370) 2024-05-27T10:52:15.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.029+0000 7fbe8f400640 1 -- 172.21.15.47:0/1552601101 learned_addr learned my addr 172.21.15.47:0/1552601101 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:15.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.029+0000 7fbe8ea00640 1 --2- 172.21.15.47:0/1552601101 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbe9013f690 0x7fbe900ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:15.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.029+0000 7fbe8e000640 1 -- 172.21.15.47:0/1552601101 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 890286402 0 0) 0x7fbe9015cd60 con 0x7fbe90072440 2024-05-27T10:52:15.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.030+0000 7fbe8e000640 1 -- 172.21.15.47:0/1552601101 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe74003520 con 0x7fbe90072440 2024-05-27T10:52:15.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.030+0000 7fbe8e000640 1 -- 172.21.15.47:0/1552601101 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 189069327 0 0) 0x7fbe74003520 con 0x7fbe90072440 2024-05-27T10:52:15.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.030+0000 7fbe8e000640 1 -- 172.21.15.47:0/1552601101 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbe9013f690 msgr2=0x7fbe900ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:15.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.030+0000 7fbe8e000640 1 --2- 172.21.15.47:0/1552601101 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbe9013f690 0x7fbe900ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.030+0000 7fbe8e000640 1 -- 172.21.15.47:0/1552601101 >> v1:172.21.15.53:6789/0 conn(0x7fbe900cec90 legacy=0x7fbe90071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:15.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.030+0000 7fbe8e000640 1 -- 172.21.15.47:0/1552601101 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9015d600 con 0x7fbe90072440 2024-05-27T10:52:15.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.030+0000 7fbe8e000640 1 -- 172.21.15.47:0/1552601101 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7fbe880019f0 con 0x7fbe90072440 2024-05-27T10:52:15.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.030+0000 7fbe8e000640 1 -- 172.21.15.47:0/1552601101 >> v1:172.21.15.47:6789/0 conn(0x7fbe90072440 legacy=0x7fbe9013fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:15.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.030+0000 7fbe8e000640 1 --2- 172.21.15.47:0/1552601101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe740039e0 0x7fbe74003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:15.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.030+0000 7fbe8e000640 1 --2- 172.21.15.47:0/1552601101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe74004800 0x7fbe74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:15.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.030+0000 7fbe8e000640 1 --2- 172.21.15.47:0/1552601101 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbe9013f690 0x7fbe74005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:15.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.030+0000 7fbe8e000640 1 -- 172.21.15.47:0/1552601101 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9015d320 con 0x7fbe74004800 2024-05-27T10:52:15.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.030+0000 7fbe8e000640 1 -- 172.21.15.47:0/1552601101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7400bb50 con 0x7fbe740039e0 2024-05-27T10:52:15.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.030+0000 7fbe8e000640 1 -- 172.21.15.47:0/1552601101 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbe7400bd50 con 0x7fbe9013f690 2024-05-27T10:52:15.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.031+0000 7fbe87e00640 1 --2- 172.21.15.47:0/1552601101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe74004800 0x7fbe74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:15.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.031+0000 7fbe8ea00640 1 --2- 172.21.15.47:0/1552601101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe740039e0 0x7fbe74003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:15.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.031+0000 7fbe87e00640 1 -- 172.21.15.47:0/1552601101 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbe9013f690 msgr2=0x7fbe74005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:15.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.031+0000 7fbe87e00640 1 --2- 172.21.15.47:0/1552601101 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbe9013f690 0x7fbe74005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.031+0000 7fbe87e00640 1 -- 172.21.15.47:0/1552601101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe740039e0 msgr2=0x7fbe74003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:15.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.031+0000 7fbe87e00640 1 --2- 172.21.15.47:0/1552601101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe740039e0 0x7fbe74003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.031+0000 7fbe87e00640 1 -- 172.21.15.47:0/1552601101 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe74003520 con 0x7fbe74004800 2024-05-27T10:52:15.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.032+0000 7fbe87e00640 1 --2- 172.21.15.47:0/1552601101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe74004800 0x7fbe74004c80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbe78001750 tx=0x7fbe74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b7222b356f389f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:15.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.032+0000 7fbe8e000640 1 -- 172.21.15.47:0/1552601101 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe78001370 con 0x7fbe74004800 2024-05-27T10:52:15.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.032+0000 7fbe8e000640 1 -- 172.21.15.47:0/1552601101 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe780052d0 con 0x7fbe74004800 2024-05-27T10:52:15.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.032+0000 7fbe8e000640 1 -- 172.21.15.47:0/1552601101 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7802abe0 con 0x7fbe74004800 2024-05-27T10:52:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.033+0000 7fbe95c00640 1 -- 172.21.15.47:0/1552601101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe74004800 msgr2=0x7fbe74004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.033+0000 7fbe95c00640 1 --2- 172.21.15.47:0/1552601101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe74004800 0x7fbe74004c80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbe78001750 tx=0x7fbe74005830 comp rx=0 tx=0).stop 2024-05-27T10:52:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.033+0000 7fbe8f400640 1 -- 172.21.15.47:0/1552601101 reap_dead start 2024-05-27T10:52:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.033+0000 7fbe95c00640 1 -- 172.21.15.47:0/1552601101 shutdown_connections 2024-05-27T10:52:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.033+0000 7fbe95c00640 1 -- 172.21.15.47:0/1552601101 >> 172.21.15.47:0/1552601101 conn(0x7fbe900b21e0 msgr2=0x7fbe900b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.033+0000 7fbe95c00640 1 -- 172.21.15.47:0/1552601101 shutdown_connections 2024-05-27T10:52:15.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.033+0000 7fbe95c00640 1 -- 172.21.15.47:0/1552601101 wait complete. 2024-05-27T10:52:15.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.035+0000 7fbe95c00640 1 Processor -- start 2024-05-27T10:52:15.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.035+0000 7fbe95c00640 1 -- start start 2024-05-27T10:52:15.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.036+0000 7fbe95c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbe74004800 0x7fbe9012daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.036+0000 7fbe95c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe9012f320 0x7fbe9013d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.036+0000 7fbe95c00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe9013daa0 0x7fbe90130fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.036+0000 7fbe95c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbe900ce480 con 0x7fbe9012f320 2024-05-27T10:52:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.036+0000 7fbe95c00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbe900ce300 con 0x7fbe9013daa0 2024-05-27T10:52:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.036+0000 7fbe95c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbe900ce750 con 0x7fbe74004800 2024-05-27T10:52:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.036+0000 7fbe87e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe9012f320 0x7fbe9013d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.036+0000 7fbe87e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe9012f320 0x7fbe9013d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34484/0 (socket says 172.21.15.47:34484) 2024-05-27T10:52:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.036+0000 7fbe87e00640 1 -- 172.21.15.47:0/1776803271 learned_addr learned my addr 172.21.15.47:0/1776803271 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.037+0000 7fbe87e00640 1 -- 172.21.15.47:0/1776803271 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbe74004800 msgr2=0x7fbe9012daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.037+0000 7fbe87e00640 1 --2- 172.21.15.47:0/1776803271 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbe74004800 0x7fbe9012daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.037+0000 7fbe87e00640 1 -- 172.21.15.47:0/1776803271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe9013daa0 msgr2=0x7fbe90130fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:15.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.037+0000 7fbe87e00640 1 --2- 172.21.15.47:0/1776803271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe9013daa0 0x7fbe90130fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.037+0000 7fbe87e00640 1 -- 172.21.15.47:0/1776803271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9012dfe0 con 0x7fbe9012f320 2024-05-27T10:52:15.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.037+0000 7fbe87e00640 1 --2- 172.21.15.47:0/1776803271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe9012f320 0x7fbe9013d560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbe78001870 tx=0x7fbe78001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:15.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.037+0000 7fbe86a00640 1 -- 172.21.15.47:0/1776803271 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe78042070 con 0x7fbe9012f320 2024-05-27T10:52:15.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.037+0000 7fbe86a00640 1 -- 172.21.15.47:0/1776803271 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe78005480 con 0x7fbe9012f320 2024-05-27T10:52:15.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.037+0000 7fbe95c00640 1 -- 172.21.15.47:0/1776803271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9012e280 con 0x7fbe9012f320 2024-05-27T10:52:15.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.037+0000 7fbe86a00640 1 -- 172.21.15.47:0/1776803271 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe78037040 con 0x7fbe9012f320 2024-05-27T10:52:15.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.037+0000 7fbe95c00640 1 -- 172.21.15.47:0/1776803271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe9012e840 con 0x7fbe9012f320 2024-05-27T10:52:15.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.038+0000 7fbe95c00640 1 -- 172.21.15.47:0/1776803271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe90073800 con 0x7fbe9012f320 2024-05-27T10:52:15.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.039+0000 7fbe86a00640 1 -- 172.21.15.47:0/1776803271 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbe78045070 con 0x7fbe9012f320 2024-05-27T10:52:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.041+0000 7fbe86a00640 1 --2- 172.21.15.47:0/1776803271 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbe6c06c8f0 0x7fbe6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.041+0000 7fbe86a00640 1 -- 172.21.15.47:0/1776803271 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbe780ab3e0 con 0x7fbe9012f320 2024-05-27T10:52:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.041+0000 7fbe8ea00640 1 --2- 172.21.15.47:0/1776803271 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbe6c06c8f0 0x7fbe6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.042+0000 7fbe8ea00640 1 --2- 172.21.15.47:0/1776803271 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbe6c06c8f0 0x7fbe6c06edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009930 tx=0x7fbe80008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:15.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.045+0000 7fbe86a00640 1 -- 172.21.15.47:0/1776803271 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbe78079800 con 0x7fbe9012f320 2024-05-27T10:52:15.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.239+0000 7fbe95c00640 1 -- 172.21.15.47:0/1776803271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbe9004fdc0 con 0x7fbe9012f320 2024-05-27T10:52:15.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.240+0000 7fbe86a00640 1 -- 172.21.15.47:0/1776803271 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fbe78079100 con 0x7fbe9012f320 2024-05-27T10:52:15.238 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-27T10:52:15.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.242+0000 7fbe95c00640 1 -- 172.21.15.47:0/1776803271 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbe6c06c8f0 msgr2=0x7fbe6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:15.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.242+0000 7fbe95c00640 1 --2- 172.21.15.47:0/1776803271 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbe6c06c8f0 0x7fbe6c06edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009930 tx=0x7fbe80008040 comp rx=0 tx=0).stop 2024-05-27T10:52:15.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.242+0000 7fbe95c00640 1 -- 172.21.15.47:0/1776803271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe9012f320 msgr2=0x7fbe9013d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:15.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.242+0000 7fbe95c00640 1 --2- 172.21.15.47:0/1776803271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe9012f320 0x7fbe9013d560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbe78001870 tx=0x7fbe78001120 comp rx=0 tx=0).stop 2024-05-27T10:52:15.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.242+0000 7fbe95c00640 1 -- 172.21.15.47:0/1776803271 shutdown_connections 2024-05-27T10:52:15.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.242+0000 7fbe95c00640 1 --2- 172.21.15.47:0/1776803271 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbe6c06c8f0 0x7fbe6c06edb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.242+0000 7fbe95c00640 1 --2- 172.21.15.47:0/1776803271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe9013daa0 0x7fbe90130fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.242+0000 7fbe95c00640 1 --2- 172.21.15.47:0/1776803271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe9012f320 0x7fbe9013d560 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.242+0000 7fbe95c00640 1 --2- 172.21.15.47:0/1776803271 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbe74004800 0x7fbe9012daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.242+0000 7fbe95c00640 1 -- 172.21.15.47:0/1776803271 >> 172.21.15.47:0/1776803271 conn(0x7fbe900b21e0 msgr2=0x7fbe90071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:15.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.243+0000 7fbe95c00640 1 -- 172.21.15.47:0/1776803271 shutdown_connections 2024-05-27T10:52:15.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.243+0000 7fbe95c00640 1 -- 172.21.15.47:0/1776803271 wait complete. 2024-05-27T10:52:15.256 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T10:52:15.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.450+0000 7f114e400640 1 Processor -- start 2024-05-27T10:52:15.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.451+0000 7f114e400640 1 -- start start 2024-05-27T10:52:15.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.452+0000 7f114e400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f114806f6c0 0x7f114815f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:15.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.452+0000 7f114e400640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f11480d0700 0x7f11480d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:15.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.452+0000 7f114e400640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f114806dd50 con 0x7f1148072d40 2024-05-27T10:52:15.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.452+0000 7f114e400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f11480d1070 con 0x7f114806f6c0 2024-05-27T10:52:15.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.452+0000 7f114e400640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f114806e030 con 0x7f11480d0700 2024-05-27T10:52:15.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.452+0000 7f1147400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f114806f6c0 0x7f114815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:15.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.452+0000 7f1147400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f114806f6c0 0x7f114815f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34496/0 (socket says 172.21.15.47:34496) 2024-05-27T10:52:15.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.452+0000 7f1147400640 1 -- 172.21.15.47:0/1099333656 learned_addr learned my addr 172.21.15.47:0/1099333656 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:15.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.453+0000 7f1147e00640 1 --2- 172.21.15.47:0/1099333656 >> v2:172.21.15.53:3300/0 conn(0x7f11480d0700 0x7f11480d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:15.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.453+0000 7f1147400640 1 -- 172.21.15.47:0/1099333656 >> v2:172.21.15.53:3300/0 conn(0x7f11480d0700 msgr2=0x7f11480d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:15.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.453+0000 7f1147400640 1 --2- 172.21.15.47:0/1099333656 >> v2:172.21.15.53:3300/0 conn(0x7f11480d0700 0x7f11480d0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.453+0000 7f1147400640 1 -- 172.21.15.47:0/1099333656 >> v1:172.21.15.53:6789/0 conn(0x7f1148072d40 legacy=0x7f11480738f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:15.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.453+0000 7f1147400640 1 -- 172.21.15.47:0/1099333656 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f114806e310 con 0x7f114806f6c0 2024-05-27T10:52:15.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.454+0000 7f1147400640 1 --2- 172.21.15.47:0/1099333656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f114806f6c0 0x7f114815f060 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f114815ba70 tx=0x7f113802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf44a598cad1dec server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:15.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.454+0000 7f1146000640 1 -- 172.21.15.47:0/1099333656 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1138037070 con 0x7f114806f6c0 2024-05-27T10:52:15.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.454+0000 7f1146000640 1 -- 172.21.15.47:0/1099333656 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1138032440 con 0x7f114806f6c0 2024-05-27T10:52:15.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.454+0000 7f1146000640 1 -- 172.21.15.47:0/1099333656 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1138032810 con 0x7f114806f6c0 2024-05-27T10:52:15.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.455+0000 7f114e400640 1 -- 172.21.15.47:0/1099333656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f114806f6c0 msgr2=0x7f114815f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:15.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.455+0000 7f114e400640 1 --2- 172.21.15.47:0/1099333656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f114806f6c0 0x7f114815f060 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f114815ba70 tx=0x7f113802a230 comp rx=0 tx=0).stop 2024-05-27T10:52:15.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.455+0000 7f114e400640 1 -- 172.21.15.47:0/1099333656 shutdown_connections 2024-05-27T10:52:15.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.455+0000 7f114e400640 1 --2- 172.21.15.47:0/1099333656 >> v2:172.21.15.53:3300/0 conn(0x7f11480d0700 0x7f11480d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.455+0000 7f114e400640 1 --2- 172.21.15.47:0/1099333656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f114806f6c0 0x7f114815f060 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.455+0000 7f114e400640 1 -- 172.21.15.47:0/1099333656 >> 172.21.15.47:0/1099333656 conn(0x7f114806bd60 msgr2=0x7f114806c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:15.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.455+0000 7f114e400640 1 -- 172.21.15.47:0/1099333656 shutdown_connections 2024-05-27T10:52:15.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.455+0000 7f114e400640 1 -- 172.21.15.47:0/1099333656 wait complete. 2024-05-27T10:52:15.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.457+0000 7f114e400640 1 Processor -- start 2024-05-27T10:52:15.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.457+0000 7f114e400640 1 -- start start 2024-05-27T10:52:15.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.458+0000 7f114e400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f114806f6c0 0x7f114814a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:15.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.458+0000 7f114e400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1148072d40 0x7f114814ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:15.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.458+0000 7f114e400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11480d0700 0x7f114814e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:15.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.458+0000 7f114e400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f114815bbe0 con 0x7f114806f6c0 2024-05-27T10:52:15.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.458+0000 7f114e400640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f114806e8d0 con 0x7f1148072d40 2024-05-27T10:52:15.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.458+0000 7f114e400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f114815bd60 con 0x7f11480d0700 2024-05-27T10:52:15.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.458+0000 7f1147400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f114806f6c0 0x7f114814a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:15.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.458+0000 7f1147400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f114806f6c0 0x7f114814a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34510/0 (socket says 172.21.15.47:34510) 2024-05-27T10:52:15.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.458+0000 7f1147400640 1 -- 172.21.15.47:0/2675781731 learned_addr learned my addr 172.21.15.47:0/2675781731 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:15.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.459+0000 7f1147e00640 1 --2- 172.21.15.47:0/2675781731 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11480d0700 0x7f114814e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:15.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.459+0000 7f1147400640 1 -- 172.21.15.47:0/2675781731 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11480d0700 msgr2=0x7f114814e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:15.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.459+0000 7f1146a00640 1 --2- 172.21.15.47:0/2675781731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1148072d40 0x7f114814ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:15.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.459+0000 7f1147400640 1 --2- 172.21.15.47:0/2675781731 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11480d0700 0x7f114814e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.459+0000 7f1147400640 1 -- 172.21.15.47:0/2675781731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1148072d40 msgr2=0x7f114814ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:15.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.459+0000 7f1147400640 1 --2- 172.21.15.47:0/2675781731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1148072d40 0x7f114814ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.459+0000 7f1147400640 1 -- 172.21.15.47:0/2675781731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1148158ca0 con 0x7f114806f6c0 2024-05-27T10:52:15.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.459+0000 7f1147e00640 1 --2- 172.21.15.47:0/2675781731 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11480d0700 0x7f114814e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:15.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.459+0000 7f1146a00640 1 --2- 172.21.15.47:0/2675781731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1148072d40 0x7f114814ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:15.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.459+0000 7f1147400640 1 --2- 172.21.15.47:0/2675781731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f114806f6c0 0x7f114814a0a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1138000c00 tx=0x7f11380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:15.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.459+0000 7f113f400640 1 -- 172.21.15.47:0/2675781731 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1138041020 con 0x7f114806f6c0 2024-05-27T10:52:15.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.459+0000 7f113f400640 1 -- 172.21.15.47:0/2675781731 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1138030970 con 0x7f114806f6c0 2024-05-27T10:52:15.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.459+0000 7f113f400640 1 -- 172.21.15.47:0/2675781731 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1138037040 con 0x7f114806f6c0 2024-05-27T10:52:15.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.459+0000 7f114e400640 1 -- 172.21.15.47:0/2675781731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f114814d270 con 0x7f114806f6c0 2024-05-27T10:52:15.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.460+0000 7f114e400640 1 -- 172.21.15.47:0/2675781731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f114814d830 con 0x7f114806f6c0 2024-05-27T10:52:15.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.461+0000 7f114e400640 1 -- 172.21.15.47:0/2675781731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11480b0e60 con 0x7f114806f6c0 2024-05-27T10:52:15.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.462+0000 7f113f400640 1 -- 172.21.15.47:0/2675781731 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1138044020 con 0x7f114806f6c0 2024-05-27T10:52:15.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.462+0000 7f113f400640 1 --2- 172.21.15.47:0/2675781731 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f112806c8f0 0x7f112806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:15.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.463+0000 7f113f400640 1 -- 172.21.15.47:0/2675781731 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f11380ac260 con 0x7f114806f6c0 2024-05-27T10:52:15.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.463+0000 7f1146a00640 1 --2- 172.21.15.47:0/2675781731 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f112806c8f0 0x7f112806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:15.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.463+0000 7f1146a00640 1 --2- 172.21.15.47:0/2675781731 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f112806c8f0 0x7f112806edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1148155090 tx=0x7f1134009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:15.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.467+0000 7f113f400640 1 -- 172.21.15.47:0/2675781731 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f11480b0e60 con 0x7f114806f6c0 2024-05-27T10:52:15.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.715+0000 7f114e400640 1 -- 172.21.15.47:0/2675781731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11480689e0 con 0x7f114806f6c0 2024-05-27T10:52:15.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.716+0000 7f113f400640 1 -- 172.21.15.47:0/2675781731 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f113804b070 con 0x7f114806f6c0 2024-05-27T10:52:15.714 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:15.714 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/4062514569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4062514569},{"type":"v1","addr":"172.21.15.47:6836","nonce":4062514569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/4113289884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":4113289884},{"type":"v1","addr":"172.21.15.53:6834","nonce":4113289884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3409529039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":3409529039},{"type":"v1","addr":"172.21.15.47:6837","nonce":3409529039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T10:52:01.683075+0000","modified":"2024-05-27T10:52:04.791891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6835/4292385883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":4292385883},{"type":"v1","addr":"172.21.15.53:6835","nonce":4292385883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-27T10:52:15.715 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-05-27T10:52:15.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.719+0000 7f114e400640 1 -- 172.21.15.47:0/2675781731 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f112806c8f0 msgr2=0x7f112806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:15.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.719+0000 7f114e400640 1 --2- 172.21.15.47:0/2675781731 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f112806c8f0 0x7f112806edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1148155090 tx=0x7f1134009040 comp rx=0 tx=0).stop 2024-05-27T10:52:15.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.719+0000 7f114e400640 1 -- 172.21.15.47:0/2675781731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f114806f6c0 msgr2=0x7f114814a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:15.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.719+0000 7f114e400640 1 --2- 172.21.15.47:0/2675781731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f114806f6c0 0x7f114814a0a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1138000c00 tx=0x7f11380046c0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.719+0000 7f114e400640 1 -- 172.21.15.47:0/2675781731 shutdown_connections 2024-05-27T10:52:15.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.719+0000 7f114e400640 1 --2- 172.21.15.47:0/2675781731 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f112806c8f0 0x7f112806edb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.719+0000 7f114e400640 1 --2- 172.21.15.47:0/2675781731 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11480d0700 0x7f114814e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.719+0000 7f114e400640 1 --2- 172.21.15.47:0/2675781731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1148072d40 0x7f114814ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.719+0000 7f114e400640 1 --2- 172.21.15.47:0/2675781731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f114806f6c0 0x7f114814a0a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.719+0000 7f114e400640 1 -- 172.21.15.47:0/2675781731 >> 172.21.15.47:0/2675781731 conn(0x7f114806bd60 msgr2=0x7f11480aded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:15.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.720+0000 7f114e400640 1 -- 172.21.15.47:0/2675781731 shutdown_connections 2024-05-27T10:52:15.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.720+0000 7f114e400640 1 -- 172.21.15.47:0/2675781731 wait complete. 2024-05-27T10:52:15.735 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:52:15.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.942+0000 7fb23b400640 1 Processor -- start 2024-05-27T10:52:15.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.942+0000 7fb23b400640 1 -- start start 2024-05-27T10:52:15.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.944+0000 7fb23b400640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb23406dcb0 0x7fb2340d0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:15.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.944+0000 7fb23b400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb2340d0c40 0x7fb2340ada50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:15.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.944+0000 7fb23b400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23415ebb0 con 0x7fb23415e7d0 2024-05-27T10:52:15.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.944+0000 7fb23b400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb2340d10a0 con 0x7fb2340d0c40 2024-05-27T10:52:15.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.944+0000 7fb23b400640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fb23406e270 con 0x7fb23406dcb0 2024-05-27T10:52:15.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.944+0000 7fb238a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb23415e7d0 0x7fb2340b3b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60378/0 (socket says 172.21.15.47:60378) 2024-05-27T10:52:15.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.944+0000 7fb238a00640 1 -- 172.21.15.47:0/365701269 learned_addr learned my addr 172.21.15.47:0/365701269 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:15.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.944+0000 7fb239400640 1 --2- 172.21.15.47:0/365701269 >> v2:172.21.15.47:3300/0 conn(0x7fb2340d0c40 0x7fb2340ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:15.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.944+0000 7fb239400640 1 -- 172.21.15.47:0/365701269 >> v2:172.21.15.53:3300/0 conn(0x7fb23406dcb0 msgr2=0x7fb2340d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:15.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.945+0000 7fb233e00640 1 --2- 172.21.15.47:0/365701269 >> v2:172.21.15.53:3300/0 conn(0x7fb23406dcb0 0x7fb2340d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:15.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.945+0000 7fb239400640 1 --2- 172.21.15.47:0/365701269 >> v2:172.21.15.53:3300/0 conn(0x7fb23406dcb0 0x7fb2340d0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.945+0000 7fb239400640 1 -- 172.21.15.47:0/365701269 >> v1:172.21.15.47:6789/0 conn(0x7fb23415e7d0 legacy=0x7fb2340b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:15.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.945+0000 7fb239400640 1 -- 172.21.15.47:0/365701269 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23406e550 con 0x7fb2340d0c40 2024-05-27T10:52:15.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.945+0000 7fb233e00640 1 --2- 172.21.15.47:0/365701269 >> v2:172.21.15.53:3300/0 conn(0x7fb23406dcb0 0x7fb2340d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:15.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.945+0000 7fb233400640 1 -- 172.21.15.47:0/365701269 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3457210203 0 0) 0x7fb228001110 con 0x7fb23415e7d0 2024-05-27T10:52:15.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.946+0000 7fb239400640 1 --2- 172.21.15.47:0/365701269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2340d0c40 0x7fb2340ada50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb2340b47d0 tx=0x7fb22c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36008db5e4add34d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:15.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.946+0000 7fb233400640 1 -- 172.21.15.47:0/365701269 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c007740 con 0x7fb2340d0c40 2024-05-27T10:52:15.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.946+0000 7fb233400640 1 -- 172.21.15.47:0/365701269 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb22c0078e0 con 0x7fb2340d0c40 2024-05-27T10:52:15.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.946+0000 7fb233400640 1 -- 172.21.15.47:0/365701269 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c007cb0 con 0x7fb2340d0c40 2024-05-27T10:52:15.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.947+0000 7fb23b400640 1 -- 172.21.15.47:0/365701269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2340d0c40 msgr2=0x7fb2340ada50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:15.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.947+0000 7fb23b400640 1 --2- 172.21.15.47:0/365701269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2340d0c40 0x7fb2340ada50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb2340b47d0 tx=0x7fb22c02a680 comp rx=0 tx=0).stop 2024-05-27T10:52:15.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.947+0000 7fb23b400640 1 -- 172.21.15.47:0/365701269 shutdown_connections 2024-05-27T10:52:15.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.947+0000 7fb23b400640 1 --2- 172.21.15.47:0/365701269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2340d0c40 0x7fb2340ada50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.947+0000 7fb23b400640 1 --2- 172.21.15.47:0/365701269 >> v2:172.21.15.53:3300/0 conn(0x7fb23406dcb0 0x7fb2340d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.947+0000 7fb23b400640 1 -- 172.21.15.47:0/365701269 >> 172.21.15.47:0/365701269 conn(0x7fb23406bd60 msgr2=0x7fb23406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:15.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.947+0000 7fb23b400640 1 -- 172.21.15.47:0/365701269 shutdown_connections 2024-05-27T10:52:15.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.947+0000 7fb23b400640 1 -- 172.21.15.47:0/365701269 wait complete. 2024-05-27T10:52:15.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.949+0000 7fb23b400640 1 Processor -- start 2024-05-27T10:52:15.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.949+0000 7fb23b400640 1 -- start start 2024-05-27T10:52:15.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.950+0000 7fb23b400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb23406dcb0 0x7fb2341527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:15.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.950+0000 7fb23b400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2340d0c40 0x7fb23409d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:15.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.950+0000 7fb23b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb23415e7d0 0x7fb23409d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:15.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.950+0000 7fb23b400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb2340adf90 con 0x7fb23415e7d0 2024-05-27T10:52:15.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.950+0000 7fb23b400640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb2340ad250 con 0x7fb2340d0c40 2024-05-27T10:52:15.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.950+0000 7fb23b400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb2340ae110 con 0x7fb23406dcb0 2024-05-27T10:52:15.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.950+0000 7fb239400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb23415e7d0 0x7fb23409d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:15.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.950+0000 7fb239400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb23415e7d0 0x7fb23409d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34534/0 (socket says 172.21.15.47:34534) 2024-05-27T10:52:15.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.950+0000 7fb239400640 1 -- 172.21.15.47:0/836293735 learned_addr learned my addr 172.21.15.47:0/836293735 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:15.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.951+0000 7fb233e00640 1 --2- 172.21.15.47:0/836293735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2340d0c40 0x7fb23409d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:15.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.951+0000 7fb238a00640 1 --2- 172.21.15.47:0/836293735 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb23406dcb0 0x7fb2341527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:15.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.951+0000 7fb239400640 1 -- 172.21.15.47:0/836293735 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb23406dcb0 msgr2=0x7fb2341527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:15.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.951+0000 7fb239400640 1 --2- 172.21.15.47:0/836293735 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb23406dcb0 0x7fb2341527d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.951+0000 7fb239400640 1 -- 172.21.15.47:0/836293735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2340d0c40 msgr2=0x7fb23409d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:15.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.951+0000 7fb239400640 1 --2- 172.21.15.47:0/836293735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2340d0c40 0x7fb23409d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:15.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.951+0000 7fb239400640 1 -- 172.21.15.47:0/836293735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23409bc90 con 0x7fb23415e7d0 2024-05-27T10:52:15.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.951+0000 7fb233e00640 1 --2- 172.21.15.47:0/836293735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2340d0c40 0x7fb23409d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:15.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.951+0000 7fb239400640 1 --2- 172.21.15.47:0/836293735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb23415e7d0 0x7fb23409d600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009e80 tx=0x7fb22c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:15.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.951+0000 7fb230c00640 1 -- 172.21.15.47:0/836293735 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c040070 con 0x7fb23415e7d0 2024-05-27T10:52:15.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.951+0000 7fb230c00640 1 -- 172.21.15.47:0/836293735 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb22c031c40 con 0x7fb23415e7d0 2024-05-27T10:52:15.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.951+0000 7fb230c00640 1 -- 172.21.15.47:0/836293735 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c003b90 con 0x7fb23415e7d0 2024-05-27T10:52:15.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.951+0000 7fb23b400640 1 -- 172.21.15.47:0/836293735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb23409b110 con 0x7fb23415e7d0 2024-05-27T10:52:15.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.952+0000 7fb23b400640 1 -- 172.21.15.47:0/836293735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb23409b6d0 con 0x7fb23415e7d0 2024-05-27T10:52:15.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.953+0000 7fb23b400640 1 -- 172.21.15.47:0/836293735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2340689e0 con 0x7fb23415e7d0 2024-05-27T10:52:15.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.954+0000 7fb230c00640 1 -- 172.21.15.47:0/836293735 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb22c039040 con 0x7fb23415e7d0 2024-05-27T10:52:15.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.955+0000 7fb230c00640 1 --2- 172.21.15.47:0/836293735 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb21806c8f0 0x7fb21806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:15.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.955+0000 7fb230c00640 1 -- 172.21.15.47:0/836293735 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb22c0ace60 con 0x7fb23415e7d0 2024-05-27T10:52:15.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.955+0000 7fb238a00640 1 --2- 172.21.15.47:0/836293735 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb21806c8f0 0x7fb21806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:15.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.956+0000 7fb238a00640 1 --2- 172.21.15.47:0/836293735 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb21806c8f0 0x7fb21806edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb228000f60 tx=0x7fb228009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:15.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:15.959+0000 7fb230c00640 1 -- 172.21.15.47:0/836293735 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb22c07b290 con 0x7fb23415e7d0 2024-05-27T10:52:16.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.153+0000 7fb23b400640 1 -- 172.21.15.47:0/836293735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb2340739a0 con 0x7fb23415e7d0 2024-05-27T10:52:16.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.155+0000 7fb230c00640 1 -- 172.21.15.47:0/836293735 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16521 (secure 0 0 0) 0x7fb22c07ab90 con 0x7fb23415e7d0 2024-05-27T10:52:16.153 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:16.153 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:03.257638+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:52:16.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.157+0000 7fb23b400640 1 -- 172.21.15.47:0/836293735 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb21806c8f0 msgr2=0x7fb21806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:16.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.157+0000 7fb23b400640 1 --2- 172.21.15.47:0/836293735 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb21806c8f0 0x7fb21806edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb228000f60 tx=0x7fb228009040 comp rx=0 tx=0).stop 2024-05-27T10:52:16.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.157+0000 7fb23b400640 1 -- 172.21.15.47:0/836293735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb23415e7d0 msgr2=0x7fb23409d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:16.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.157+0000 7fb23b400640 1 --2- 172.21.15.47:0/836293735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb23415e7d0 0x7fb23409d600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009e80 tx=0x7fb22c004a40 comp rx=0 tx=0).stop 2024-05-27T10:52:16.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.158+0000 7fb23b400640 1 -- 172.21.15.47:0/836293735 shutdown_connections 2024-05-27T10:52:16.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.158+0000 7fb23b400640 1 --2- 172.21.15.47:0/836293735 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb21806c8f0 0x7fb21806edb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:16.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.158+0000 7fb23b400640 1 --2- 172.21.15.47:0/836293735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb23415e7d0 0x7fb23409d600 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:16.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.158+0000 7fb23b400640 1 --2- 172.21.15.47:0/836293735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2340d0c40 0x7fb23409d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:16.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.158+0000 7fb23b400640 1 --2- 172.21.15.47:0/836293735 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb23406dcb0 0x7fb2341527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:16.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.158+0000 7fb23b400640 1 -- 172.21.15.47:0/836293735 >> 172.21.15.47:0/836293735 conn(0x7fb23406bd60 msgr2=0x7fb234073000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:16.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.158+0000 7fb23b400640 1 -- 172.21.15.47:0/836293735 shutdown_connections 2024-05-27T10:52:16.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.158+0000 7fb23b400640 1 -- 172.21.15.47:0/836293735 wait complete. 2024-05-27T10:52:16.174 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T10:51:55.073251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T10:51:59.202702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T10:52:00.664039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T10:52:16.175 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T10:52:16.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.380+0000 7f1ce2400640 1 Processor -- start 2024-05-27T10:52:16.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.380+0000 7f1ce2400640 1 -- start start 2024-05-27T10:52:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.382+0000 7f1ce2400640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1cdc0d0970 0x7f1cdc0cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.382+0000 7f1ce2400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1cdc0cc030 0x7f1cdc0cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.382+0000 7f1ce2400640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cdc0ce5c0 con 0x7f1cdc0d0590 2024-05-27T10:52:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.382+0000 7f1ce2400640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f1cdc06da80 con 0x7f1cdc0d0970 2024-05-27T10:52:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.382+0000 7f1ce2400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f1cdc0ce8a0 con 0x7f1cdc0cc030 2024-05-27T10:52:16.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.383+0000 7f1ce1a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1cdc0cc030 0x7f1cdc0cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:16.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.383+0000 7f1ce1a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1cdc0cc030 0x7f1cdc0cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:52054/0 (socket says 172.21.15.47:52054) 2024-05-27T10:52:16.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.383+0000 7f1ce1a00640 1 -- 172.21.15.47:0/1303359131 learned_addr learned my addr 172.21.15.47:0/1303359131 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:16.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.383+0000 7f1cdbe00640 1 --2- 172.21.15.47:0/1303359131 >> v2:172.21.15.53:3300/0 conn(0x7f1cdc0d0970 0x7f1cdc0cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:16.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.384+0000 7f1ce1a00640 1 -- 172.21.15.47:0/1303359131 >> v2:172.21.15.53:3300/0 conn(0x7f1cdc0d0970 msgr2=0x7f1cdc0cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:16.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.384+0000 7f1ce1a00640 1 --2- 172.21.15.47:0/1303359131 >> v2:172.21.15.53:3300/0 conn(0x7f1cdc0d0970 0x7f1cdc0cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:16.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.384+0000 7f1ce1a00640 1 -- 172.21.15.47:0/1303359131 >> v1:172.21.15.53:6789/0 conn(0x7f1cdc0d0590 legacy=0x7f1cdc15c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:16.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.384+0000 7f1ce1a00640 1 -- 172.21.15.47:0/1303359131 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cdc0ceb80 con 0x7f1cdc0cc030 2024-05-27T10:52:16.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.384+0000 7f1cdb400640 1 -- 172.21.15.47:0/1303359131 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2098267012 0 0) 0x7f1cdc0ce5c0 con 0x7f1cdc0d0590 2024-05-27T10:52:16.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.385+0000 7f1ce1a00640 1 --2- 172.21.15.47:0/1303359131 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1cdc0cc030 0x7f1cdc0cc4c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009e80 tx=0x7f1cd402a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99bdc51e0cbbbdea server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:16.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.385+0000 7f1cdb400640 1 -- 172.21.15.47:0/1303359131 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4036070 con 0x7f1cdc0cc030 2024-05-27T10:52:16.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.385+0000 7f1cdb400640 1 -- 172.21.15.47:0/1303359131 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd4031600 con 0x7f1cdc0cc030 2024-05-27T10:52:16.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.385+0000 7f1cdb400640 1 -- 172.21.15.47:0/1303359131 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd40319d0 con 0x7f1cdc0cc030 2024-05-27T10:52:16.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.386+0000 7f1ce2400640 1 -- 172.21.15.47:0/1303359131 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1cdc0cc030 msgr2=0x7f1cdc0cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:16.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.386+0000 7f1ce2400640 1 --2- 172.21.15.47:0/1303359131 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1cdc0cc030 0x7f1cdc0cc4c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009e80 tx=0x7f1cd402a6c0 comp rx=0 tx=0).stop 2024-05-27T10:52:16.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.386+0000 7f1ce2400640 1 -- 172.21.15.47:0/1303359131 shutdown_connections 2024-05-27T10:52:16.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.386+0000 7f1ce2400640 1 --2- 172.21.15.47:0/1303359131 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1cdc0cc030 0x7f1cdc0cc4c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:16.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.386+0000 7f1ce2400640 1 --2- 172.21.15.47:0/1303359131 >> v2:172.21.15.53:3300/0 conn(0x7f1cdc0d0970 0x7f1cdc0cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:16.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.386+0000 7f1ce2400640 1 -- 172.21.15.47:0/1303359131 >> 172.21.15.47:0/1303359131 conn(0x7f1cdc06bb20 msgr2=0x7f1cdc06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:16.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.386+0000 7f1ce2400640 1 -- 172.21.15.47:0/1303359131 shutdown_connections 2024-05-27T10:52:16.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.386+0000 7f1ce2400640 1 -- 172.21.15.47:0/1303359131 wait complete. 2024-05-27T10:52:16.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.388+0000 7f1ce2400640 1 Processor -- start 2024-05-27T10:52:16.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.388+0000 7f1ce2400640 1 -- start start 2024-05-27T10:52:16.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.389+0000 7f1ce2400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cdc0cc030 0x7f1cdc14be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.389+0000 7f1ce2400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cdc0d0590 0x7f1cdc09b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.389+0000 7f1ce2400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1cdc0d0970 0x7f1cdc14eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.389+0000 7f1ce2400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc155620 con 0x7f1cdc0d0590 2024-05-27T10:52:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.389+0000 7f1ce2400640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc1554a0 con 0x7f1cdc0cc030 2024-05-27T10:52:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.389+0000 7f1ce2400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f1cdc1557a0 con 0x7f1cdc0d0970 2024-05-27T10:52:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.389+0000 7f1cdbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cdc0d0590 0x7f1cdc09b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.389+0000 7f1cdbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cdc0d0590 0x7f1cdc09b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34546/0 (socket says 172.21.15.47:34546) 2024-05-27T10:52:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.389+0000 7f1cdbe00640 1 -- 172.21.15.47:0/3872847120 learned_addr learned my addr 172.21.15.47:0/3872847120 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.389+0000 7f1ce1000640 1 --2- 172.21.15.47:0/3872847120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cdc0cc030 0x7f1cdc14be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.390+0000 7f1ce1a00640 1 --2- 172.21.15.47:0/3872847120 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1cdc0d0970 0x7f1cdc14eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.390+0000 7f1cdbe00640 1 -- 172.21.15.47:0/3872847120 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1cdc0d0970 msgr2=0x7f1cdc14eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.390+0000 7f1cdbe00640 1 --2- 172.21.15.47:0/3872847120 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1cdc0d0970 0x7f1cdc14eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.390+0000 7f1cdbe00640 1 -- 172.21.15.47:0/3872847120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cdc0cc030 msgr2=0x7f1cdc14be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:16.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.390+0000 7f1cdbe00640 1 --2- 172.21.15.47:0/3872847120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cdc0cc030 0x7f1cdc14be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:16.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.390+0000 7f1cdbe00640 1 -- 172.21.15.47:0/3872847120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cdc0975f0 con 0x7f1cdc0d0590 2024-05-27T10:52:16.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.390+0000 7f1ce1a00640 1 --2- 172.21.15.47:0/3872847120 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1cdc0d0970 0x7f1cdc14eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:16.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.390+0000 7f1ce1000640 1 --2- 172.21.15.47:0/3872847120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cdc0cc030 0x7f1cdc14be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:16.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.390+0000 7f1cdbe00640 1 --2- 172.21.15.47:0/3872847120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cdc0d0590 0x7f1cdc09b560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800e870 tx=0x7f1cc800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:16.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.390+0000 7f1cd8c00640 1 -- 172.21.15.47:0/3872847120 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8017070 con 0x7f1cdc0d0590 2024-05-27T10:52:16.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.390+0000 7f1cd8c00640 1 -- 172.21.15.47:0/3872847120 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cc800c940 con 0x7f1cdc0d0590 2024-05-27T10:52:16.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.390+0000 7f1cd8c00640 1 -- 172.21.15.47:0/3872847120 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc800cd30 con 0x7f1cdc0d0590 2024-05-27T10:52:16.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.390+0000 7f1ce2400640 1 -- 172.21.15.47:0/3872847120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cdc0978d0 con 0x7f1cdc0d0590 2024-05-27T10:52:16.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.390+0000 7f1ce2400640 1 -- 172.21.15.47:0/3872847120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cdc097e90 con 0x7f1cdc0d0590 2024-05-27T10:52:16.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.392+0000 7f1ce2400640 1 -- 172.21.15.47:0/3872847120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cdc0ae8a0 con 0x7f1cdc0d0590 2024-05-27T10:52:16.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.392+0000 7f1cd8c00640 1 -- 172.21.15.47:0/3872847120 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1cc801a070 con 0x7f1cdc0d0590 2024-05-27T10:52:16.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.393+0000 7f1cd8c00640 1 --2- 172.21.15.47:0/3872847120 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f1cbc06c920 0x7f1cbc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:16.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.393+0000 7f1cd8c00640 1 -- 172.21.15.47:0/3872847120 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1cc808bd50 con 0x7f1cdc0d0590 2024-05-27T10:52:16.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.394+0000 7f1ce1000640 1 --2- 172.21.15.47:0/3872847120 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f1cbc06c920 0x7f1cbc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:16.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.394+0000 7f1ce1000640 1 --2- 172.21.15.47:0/3872847120 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f1cbc06c920 0x7f1cbc06ede0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0000f60 tx=0x7f1cd0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.398+0000 7f1cd8c00640 1 -- 172.21.15.47:0/3872847120 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1cdc0ae8a0 con 0x7f1cdc0d0590 2024-05-27T10:52:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.601+0000 7f1ce2400640 1 -- 172.21.15.47:0/3872847120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1cdc04fce0 con 0x7f1cdc0d0590 2024-05-27T10:52:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.602+0000 7f1cd8c00640 1 -- 172.21.15.47:0/3872847120 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f1cc808f030 con 0x7f1cdc0d0590 2024-05-27T10:52:16.600 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-27T10:52:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.604+0000 7f1ce2400640 1 -- 172.21.15.47:0/3872847120 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f1cbc06c920 msgr2=0x7f1cbc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.604+0000 7f1ce2400640 1 --2- 172.21.15.47:0/3872847120 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f1cbc06c920 0x7f1cbc06ede0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0000f60 tx=0x7f1cd0009040 comp rx=0 tx=0).stop 2024-05-27T10:52:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.604+0000 7f1ce2400640 1 -- 172.21.15.47:0/3872847120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cdc0d0590 msgr2=0x7f1cdc09b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.604+0000 7f1ce2400640 1 --2- 172.21.15.47:0/3872847120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cdc0d0590 0x7f1cdc09b560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800e870 tx=0x7f1cc800ed30 comp rx=0 tx=0).stop 2024-05-27T10:52:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.604+0000 7f1ce2400640 1 -- 172.21.15.47:0/3872847120 shutdown_connections 2024-05-27T10:52:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.604+0000 7f1ce2400640 1 --2- 172.21.15.47:0/3872847120 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f1cbc06c920 0x7f1cbc06ede0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.604+0000 7f1ce2400640 1 --2- 172.21.15.47:0/3872847120 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1cdc0d0970 0x7f1cdc14eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.604+0000 7f1ce2400640 1 --2- 172.21.15.47:0/3872847120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cdc0d0590 0x7f1cdc09b560 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.604+0000 7f1ce2400640 1 --2- 172.21.15.47:0/3872847120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cdc0cc030 0x7f1cdc14be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.604+0000 7f1ce2400640 1 -- 172.21.15.47:0/3872847120 >> 172.21.15.47:0/3872847120 conn(0x7f1cdc06bb20 msgr2=0x7f1cdc0ae190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.604+0000 7f1ce2400640 1 -- 172.21.15.47:0/3872847120 shutdown_connections 2024-05-27T10:52:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.605+0000 7f1ce2400640 1 -- 172.21.15.47:0/3872847120 wait complete. 2024-05-27T10:52:16.622 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T10:52:16.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.837+0000 7f734f200640 1 Processor -- start 2024-05-27T10:52:16.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.838+0000 7f734f200640 1 -- start start 2024-05-27T10:52:16.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.839+0000 7f734f200640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f735015e630 0x7f73500d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:16.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.839+0000 7f734f200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73500ced40 con 0x7f73500cfde0 2024-05-27T10:52:16.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.839+0000 7f734f200640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73500cf020 con 0x7f73500b6670 2024-05-27T10:52:16.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.839+0000 7f734f200640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f73500cf950 con 0x7f735015e630 2024-05-27T10:52:16.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.839+0000 7f734d400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f73500cfde0 0x7f73500b5f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60390/0 (socket says 172.21.15.47:60390) 2024-05-27T10:52:16.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.839+0000 7f734d400640 1 -- 172.21.15.47:0/2359757686 learned_addr learned my addr 172.21.15.47:0/2359757686 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:16.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.840+0000 7f734de00640 1 --2- 172.21.15.47:0/2359757686 >> v2:172.21.15.53:3300/0 conn(0x7f735015e630 0x7f73500d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:16.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.840+0000 7f734ca00640 1 -- 172.21.15.47:0/2359757686 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 323012270 0 0) 0x7f73500ced40 con 0x7f73500cfde0 2024-05-27T10:52:16.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.840+0000 7f734ca00640 1 -- 172.21.15.47:0/2359757686 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7334003520 con 0x7f73500cfde0 2024-05-27T10:52:16.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.840+0000 7f734ca00640 1 -- 172.21.15.47:0/2359757686 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2769020501 0 0) 0x7f7334003520 con 0x7f73500cfde0 2024-05-27T10:52:16.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.840+0000 7f734ca00640 1 -- 172.21.15.47:0/2359757686 >> v2:172.21.15.53:3300/0 conn(0x7f735015e630 msgr2=0x7f73500d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:16.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.840+0000 7f734ca00640 1 --2- 172.21.15.47:0/2359757686 >> v2:172.21.15.53:3300/0 conn(0x7f735015e630 0x7f73500d3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:16.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.840+0000 7f734ca00640 1 -- 172.21.15.47:0/2359757686 >> v1:172.21.15.53:6789/0 conn(0x7f73500b6670 legacy=0x7f73501685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:16.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.840+0000 7f734ca00640 1 -- 172.21.15.47:0/2359757686 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73500cf300 con 0x7f73500cfde0 2024-05-27T10:52:16.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.840+0000 7f734ca00640 1 -- 172.21.15.47:0/2359757686 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f73400019f0 con 0x7f73500cfde0 2024-05-27T10:52:16.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.840+0000 7f734ca00640 1 -- 172.21.15.47:0/2359757686 >> v1:172.21.15.47:6789/0 conn(0x7f73500cfde0 legacy=0x7f73500b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:16.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.840+0000 7f734ca00640 1 --2- 172.21.15.47:0/2359757686 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7334003a00 0x7f7334003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:16.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.840+0000 7f734ca00640 1 --2- 172.21.15.47:0/2359757686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7334004800 0x7f7334004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:16.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.840+0000 7f734ca00640 1 --2- 172.21.15.47:0/2359757686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73340051c0 0x7f733400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:16.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.840+0000 7f734ca00640 1 -- 172.21.15.47:0/2359757686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f73500cf950 con 0x7f7334004800 2024-05-27T10:52:16.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.840+0000 7f734ca00640 1 -- 172.21.15.47:0/2359757686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f733400c0c0 con 0x7f73340051c0 2024-05-27T10:52:16.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.840+0000 7f734ca00640 1 -- 172.21.15.47:0/2359757686 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f733400c2c0 con 0x7f7334003a00 2024-05-27T10:52:16.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.841+0000 7f734d400640 1 --2- 172.21.15.47:0/2359757686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7334004800 0x7f7334004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:16.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.841+0000 7f734de00640 1 --2- 172.21.15.47:0/2359757686 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7334003a00 0x7f7334003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:16.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.841+0000 7f734e800640 1 --2- 172.21.15.47:0/2359757686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73340051c0 0x7f733400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:16.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.841+0000 7f734d400640 1 -- 172.21.15.47:0/2359757686 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7334003a00 msgr2=0x7f7334003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:16.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.841+0000 7f734d400640 1 --2- 172.21.15.47:0/2359757686 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7334003a00 0x7f7334003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:16.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.841+0000 7f734d400640 1 -- 172.21.15.47:0/2359757686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73340051c0 msgr2=0x7f733400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:16.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.841+0000 7f734d400640 1 --2- 172.21.15.47:0/2359757686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73340051c0 0x7f733400b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:16.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.841+0000 7f734d400640 1 -- 172.21.15.47:0/2359757686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7334003520 con 0x7f7334004800 2024-05-27T10:52:16.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.841+0000 7f734e800640 1 -- 172.21.15.47:0/2359757686 reap_dead start 2024-05-27T10:52:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.842+0000 7f734d400640 1 --2- 172.21.15.47:0/2359757686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7334004800 0x7f7334004c80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f734000a770 tx=0x7f7334005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f45d9d1a8ccab7 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.842+0000 7f734ca00640 1 -- 172.21.15.47:0/2359757686 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734000a390 con 0x7f7334004800 2024-05-27T10:52:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.842+0000 7f734ca00640 1 -- 172.21.15.47:0/2359757686 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f734002f070 con 0x7f7334004800 2024-05-27T10:52:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.842+0000 7f734ca00640 1 -- 172.21.15.47:0/2359757686 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734002bc20 con 0x7f7334004800 2024-05-27T10:52:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.843+0000 7f734f200640 1 -- 172.21.15.47:0/2359757686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7334004800 msgr2=0x7f7334004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.843+0000 7f734f200640 1 --2- 172.21.15.47:0/2359757686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7334004800 0x7f7334004c80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f734000a770 tx=0x7f7334005830 comp rx=0 tx=0).stop 2024-05-27T10:52:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.843+0000 7f734f200640 1 -- 172.21.15.47:0/2359757686 shutdown_connections 2024-05-27T10:52:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.843+0000 7f734f200640 1 --2- 172.21.15.47:0/2359757686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7334004800 0x7f7334004c80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.843+0000 7f734f200640 1 -- 172.21.15.47:0/2359757686 >> 172.21.15.47:0/2359757686 conn(0x7f735008bfd0 msgr2=0x7f73500d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:16.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.843+0000 7f734f200640 1 -- 172.21.15.47:0/2359757686 shutdown_connections 2024-05-27T10:52:16.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.843+0000 7f734f200640 1 -- 172.21.15.47:0/2359757686 wait complete. 2024-05-27T10:52:16.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.845+0000 7f734f200640 1 Processor -- start 2024-05-27T10:52:16.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.845+0000 7f734f200640 1 -- start start 2024-05-27T10:52:16.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.846+0000 7f734f200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7334004800 0x7f7350161500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:16.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.846+0000 7f734f200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f735014ae40 0x7f73501f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:16.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.846+0000 7f734f200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73500c9600 0x7f73500c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:16.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.846+0000 7f734f200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f735015eb90 con 0x7f735014ae40 2024-05-27T10:52:16.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.846+0000 7f734f200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f735015ea10 con 0x7f73500c9600 2024-05-27T10:52:16.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.846+0000 7f734f200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f73500b5f60 con 0x7f7334004800 2024-05-27T10:52:16.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.846+0000 7f734d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f735014ae40 0x7f73501f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:16.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.846+0000 7f734d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f735014ae40 0x7f73501f42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34554/0 (socket says 172.21.15.47:34554) 2024-05-27T10:52:16.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.846+0000 7f734d400640 1 -- 172.21.15.47:0/1013426432 learned_addr learned my addr 172.21.15.47:0/1013426432 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:16.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.847+0000 7f734de00640 1 --2- 172.21.15.47:0/1013426432 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7334004800 0x7f7350161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:16.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.847+0000 7f734e800640 1 --2- 172.21.15.47:0/1013426432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73500c9600 0x7f73500c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:16.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.847+0000 7f734d400640 1 -- 172.21.15.47:0/1013426432 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7334004800 msgr2=0x7f7350161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:16.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.847+0000 7f734d400640 1 --2- 172.21.15.47:0/1013426432 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7334004800 0x7f7350161500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:16.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.847+0000 7f734d400640 1 -- 172.21.15.47:0/1013426432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73500c9600 msgr2=0x7f73500c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:16.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.847+0000 7f734d400640 1 --2- 172.21.15.47:0/1013426432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73500c9600 0x7f73500c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:16.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.847+0000 7f734d400640 1 -- 172.21.15.47:0/1013426432 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73501f47e0 con 0x7f735014ae40 2024-05-27T10:52:16.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.847+0000 7f734d400640 1 --2- 172.21.15.47:0/1013426432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f735014ae40 0x7f73501f42a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f734000a890 tx=0x7f73500cf1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:16.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.847+0000 7f7346000640 1 -- 172.21.15.47:0/1013426432 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7340001ee0 con 0x7f735014ae40 2024-05-27T10:52:16.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.848+0000 7f7346000640 1 -- 172.21.15.47:0/1013426432 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7340001250 con 0x7f735014ae40 2024-05-27T10:52:16.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.848+0000 7f7346000640 1 -- 172.21.15.47:0/1013426432 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7340034670 con 0x7f735014ae40 2024-05-27T10:52:16.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.848+0000 7f734f200640 1 -- 172.21.15.47:0/1013426432 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7350161c10 con 0x7f735014ae40 2024-05-27T10:52:16.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.848+0000 7f734f200640 1 -- 172.21.15.47:0/1013426432 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73500ca360 con 0x7f735014ae40 2024-05-27T10:52:16.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.849+0000 7f734f200640 1 -- 172.21.15.47:0/1013426432 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f735004fce0 con 0x7f735014ae40 2024-05-27T10:52:16.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.850+0000 7f7346000640 1 -- 172.21.15.47:0/1013426432 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7340034810 con 0x7f735014ae40 2024-05-27T10:52:16.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.851+0000 7f7346000640 1 --2- 172.21.15.47:0/1013426432 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f732c06c8f0 0x7f732c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:16.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.851+0000 7f7346000640 1 -- 172.21.15.47:0/1013426432 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f73400ac130 con 0x7f735014ae40 2024-05-27T10:52:16.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.851+0000 7f734de00640 1 --2- 172.21.15.47:0/1013426432 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f732c06c8f0 0x7f732c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:16.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.852+0000 7f734de00640 1 --2- 172.21.15.47:0/1013426432 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f732c06c8f0 0x7f732c06edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7338009a90 tx=0x7f7338008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:16.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:16.856+0000 7f7346000640 1 -- 172.21.15.47:0/1013426432 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f734007a560 con 0x7f735014ae40 2024-05-27T10:52:17.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.056+0000 7f734f200640 1 -- 172.21.15.47:0/1013426432 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f73500b5d00 con 0x7f735014ae40 2024-05-27T10:52:17.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.057+0000 7f7346000640 1 -- 172.21.15.47:0/1013426432 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f7340079e60 con 0x7f735014ae40 2024-05-27T10:52:17.055 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-27T10:52:17.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.059+0000 7f734f200640 1 -- 172.21.15.47:0/1013426432 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f732c06c8f0 msgr2=0x7f732c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:17.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.059+0000 7f734f200640 1 --2- 172.21.15.47:0/1013426432 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f732c06c8f0 0x7f732c06edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7338009a90 tx=0x7f7338008040 comp rx=0 tx=0).stop 2024-05-27T10:52:17.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.059+0000 7f734f200640 1 -- 172.21.15.47:0/1013426432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f735014ae40 msgr2=0x7f73501f42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:17.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.059+0000 7f734f200640 1 --2- 172.21.15.47:0/1013426432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f735014ae40 0x7f73501f42a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f734000a890 tx=0x7f73500cf1f0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.059+0000 7f734f200640 1 -- 172.21.15.47:0/1013426432 shutdown_connections 2024-05-27T10:52:17.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.059+0000 7f734f200640 1 --2- 172.21.15.47:0/1013426432 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f732c06c8f0 0x7f732c06edb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.059+0000 7f734f200640 1 --2- 172.21.15.47:0/1013426432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73500c9600 0x7f73500c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.059+0000 7f734f200640 1 --2- 172.21.15.47:0/1013426432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f735014ae40 0x7f73501f42a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.059+0000 7f734f200640 1 --2- 172.21.15.47:0/1013426432 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7334004800 0x7f7350161500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.059+0000 7f734f200640 1 -- 172.21.15.47:0/1013426432 >> 172.21.15.47:0/1013426432 conn(0x7f735008bfd0 msgr2=0x7f73500b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:17.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.059+0000 7f734f200640 1 -- 172.21.15.47:0/1013426432 shutdown_connections 2024-05-27T10:52:17.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.060+0000 7f734f200640 1 -- 172.21.15.47:0/1013426432 wait complete. 2024-05-27T10:52:17.077 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T10:52:17.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.295+0000 7f8207200640 1 Processor -- start 2024-05-27T10:52:17.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.295+0000 7f8207200640 1 -- start start 2024-05-27T10:52:17.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.296+0000 7f8207200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f820815c510 0x7f82080b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:17.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.296+0000 7f8207200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f820806da80 0x7f82080d0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:17.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.296+0000 7f8207200640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f82080d0860 0x7f82081600e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:17.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.296+0000 7f8207200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f82080d0cd0 con 0x7f820815c510 2024-05-27T10:52:17.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.296+0000 7f8207200640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f82080b4620 con 0x7f82080d0860 2024-05-27T10:52:17.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.296+0000 7f8207200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f82080b4900 con 0x7f820806da80 2024-05-27T10:52:17.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.297+0000 7f8205e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f820815c510 0x7f82080b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:17.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.297+0000 7f8205e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f820815c510 0x7f82080b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34570/0 (socket says 172.21.15.47:34570) 2024-05-27T10:52:17.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.297+0000 7f8205e00640 1 -- 172.21.15.47:0/273799192 learned_addr learned my addr 172.21.15.47:0/273799192 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:17.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.297+0000 7f8206800640 1 --2- 172.21.15.47:0/273799192 >> v2:172.21.15.53:3300/0 conn(0x7f82080d0860 0x7f82081600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:17.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.297+0000 7f8205400640 1 --2- 172.21.15.47:0/273799192 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f820806da80 0x7f82080d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:17.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.297+0000 7f8205e00640 1 -- 172.21.15.47:0/273799192 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f820806da80 msgr2=0x7f82080d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:17.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.297+0000 7f8205e00640 1 --2- 172.21.15.47:0/273799192 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f820806da80 0x7f82080d0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.297+0000 7f8205e00640 1 -- 172.21.15.47:0/273799192 >> v2:172.21.15.53:3300/0 conn(0x7f82080d0860 msgr2=0x7f82081600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:17.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.297+0000 7f8205e00640 1 --2- 172.21.15.47:0/273799192 >> v2:172.21.15.53:3300/0 conn(0x7f82080d0860 0x7f82081600e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.297+0000 7f8205e00640 1 -- 172.21.15.47:0/273799192 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82080b4be0 con 0x7f820815c510 2024-05-27T10:52:17.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.297+0000 7f8205400640 1 --2- 172.21.15.47:0/273799192 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f820806da80 0x7f82080d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:17.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.298+0000 7f8205e00640 1 --2- 172.21.15.47:0/273799192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f820815c510 0x7f82080b3cd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f82080ce140 tx=0x7f81f802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c0d13982d04dbd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:17.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.298+0000 7f8204a00640 1 -- 172.21.15.47:0/273799192 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f8036070 con 0x7f820815c510 2024-05-27T10:52:17.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.298+0000 7f8204a00640 1 -- 172.21.15.47:0/273799192 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f8031600 con 0x7f820815c510 2024-05-27T10:52:17.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.298+0000 7f8204a00640 1 -- 172.21.15.47:0/273799192 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f80319d0 con 0x7f820815c510 2024-05-27T10:52:17.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.299+0000 7f8207200640 1 -- 172.21.15.47:0/273799192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f820815c510 msgr2=0x7f82080b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:17.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.299+0000 7f8207200640 1 --2- 172.21.15.47:0/273799192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f820815c510 0x7f82080b3cd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f82080ce140 tx=0x7f81f802a6a0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.299+0000 7f8207200640 1 -- 172.21.15.47:0/273799192 shutdown_connections 2024-05-27T10:52:17.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.299+0000 7f8207200640 1 --2- 172.21.15.47:0/273799192 >> v2:172.21.15.53:3300/0 conn(0x7f82080d0860 0x7f82081600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.299+0000 7f8207200640 1 --2- 172.21.15.47:0/273799192 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f820806da80 0x7f82080d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.299+0000 7f8207200640 1 --2- 172.21.15.47:0/273799192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f820815c510 0x7f82080b3cd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.299+0000 7f8207200640 1 -- 172.21.15.47:0/273799192 >> 172.21.15.47:0/273799192 conn(0x7f820806bb20 msgr2=0x7f820806bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:17.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.299+0000 7f8207200640 1 -- 172.21.15.47:0/273799192 shutdown_connections 2024-05-27T10:52:17.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.299+0000 7f8207200640 1 -- 172.21.15.47:0/273799192 wait complete. 2024-05-27T10:52:17.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.301+0000 7f8207200640 1 Processor -- start 2024-05-27T10:52:17.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.301+0000 7f8207200640 1 -- start start 2024-05-27T10:52:17.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.302+0000 7f8207200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f820806da80 0x7f820809c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:17.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.302+0000 7f8207200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82080d0860 0x7f820815d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:17.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.302+0000 7f8207200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f820815c510 0x7f820815dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:17.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.302+0000 7f8207200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f82080b4210 con 0x7f820806da80 2024-05-27T10:52:17.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.302+0000 7f8207200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f820815c8f0 con 0x7f82080d0860 2024-05-27T10:52:17.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.302+0000 7f8207200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f82080b4390 con 0x7f820815c510 2024-05-27T10:52:17.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.302+0000 7f8205e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f820806da80 0x7f820809c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:17.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.302+0000 7f8205e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f820806da80 0x7f820809c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34584/0 (socket says 172.21.15.47:34584) 2024-05-27T10:52:17.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.302+0000 7f8205e00640 1 -- 172.21.15.47:0/2002087075 learned_addr learned my addr 172.21.15.47:0/2002087075 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:17.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.303+0000 7f8205e00640 1 -- 172.21.15.47:0/2002087075 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f820815c510 msgr2=0x7f820815dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:17.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.303+0000 7f8205400640 1 --2- 172.21.15.47:0/2002087075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82080d0860 0x7f820815d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:17.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.303+0000 7f8206800640 1 --2- 172.21.15.47:0/2002087075 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f820815c510 0x7f820815dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:17.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.303+0000 7f8205e00640 1 --2- 172.21.15.47:0/2002087075 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f820815c510 0x7f820815dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.303+0000 7f8205e00640 1 -- 172.21.15.47:0/2002087075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82080d0860 msgr2=0x7f820815d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:17.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.303+0000 7f8205e00640 1 --2- 172.21.15.47:0/2002087075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82080d0860 0x7f820815d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.303+0000 7f8205e00640 1 -- 172.21.15.47:0/2002087075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820815e150 con 0x7f820806da80 2024-05-27T10:52:17.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.303+0000 7f8205400640 1 --2- 172.21.15.47:0/2002087075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82080d0860 0x7f820815d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:17.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.303+0000 7f8205e00640 1 --2- 172.21.15.47:0/2002087075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f820806da80 0x7f820809c600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f81f8034040 tx=0x7f81f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:17.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.303+0000 7f81fe000640 1 -- 172.21.15.47:0/2002087075 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f8036050 con 0x7f820806da80 2024-05-27T10:52:17.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.303+0000 7f81fe000640 1 -- 172.21.15.47:0/2002087075 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f8042070 con 0x7f820806da80 2024-05-27T10:52:17.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.303+0000 7f81fe000640 1 -- 172.21.15.47:0/2002087075 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f8009510 con 0x7f820806da80 2024-05-27T10:52:17.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.303+0000 7f8207200640 1 -- 172.21.15.47:0/2002087075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f820815e460 con 0x7f820806da80 2024-05-27T10:52:17.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.304+0000 7f8207200640 1 -- 172.21.15.47:0/2002087075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f820809a810 con 0x7f820806da80 2024-05-27T10:52:17.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.304+0000 7f8207200640 1 -- 172.21.15.47:0/2002087075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f820804fce0 con 0x7f820806da80 2024-05-27T10:52:17.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.306+0000 7f81fe000640 1 -- 172.21.15.47:0/2002087075 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f81f8007c30 con 0x7f820806da80 2024-05-27T10:52:17.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.307+0000 7f81fe000640 1 --2- 172.21.15.47:0/2002087075 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f81e406c8f0 0x7f81e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:17.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.307+0000 7f81fe000640 1 -- 172.21.15.47:0/2002087075 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f81f80acae0 con 0x7f820806da80 2024-05-27T10:52:17.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.307+0000 7f8205400640 1 --2- 172.21.15.47:0/2002087075 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f81e406c8f0 0x7f81e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:17.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.308+0000 7f8205400640 1 --2- 172.21.15.47:0/2002087075 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f81e406c8f0 0x7f81e406edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f820815fc00 tx=0x7f81f0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:17.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.311+0000 7f81fe000640 1 -- 172.21.15.47:0/2002087075 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f820815e460 con 0x7f820806da80 2024-05-27T10:52:17.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.520+0000 7f8207200640 1 -- 172.21.15.47:0/2002087075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f820806e070 con 0x7f820806da80 2024-05-27T10:52:17.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.521+0000 7f81fe000640 1 -- 172.21.15.47:0/2002087075 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f81f807ae70 con 0x7f820806da80 2024-05-27T10:52:17.519 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-27T10:52:17.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.524+0000 7f8207200640 1 -- 172.21.15.47:0/2002087075 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f81e406c8f0 msgr2=0x7f81e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:17.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.524+0000 7f8207200640 1 --2- 172.21.15.47:0/2002087075 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f81e406c8f0 0x7f81e406edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f820815fc00 tx=0x7f81f0008040 comp rx=0 tx=0).stop 2024-05-27T10:52:17.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.524+0000 7f8207200640 1 -- 172.21.15.47:0/2002087075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f820806da80 msgr2=0x7f820809c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:17.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.524+0000 7f8207200640 1 --2- 172.21.15.47:0/2002087075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f820806da80 0x7f820809c600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f81f8034040 tx=0x7f81f8004a40 comp rx=0 tx=0).stop 2024-05-27T10:52:17.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.524+0000 7f8207200640 1 -- 172.21.15.47:0/2002087075 shutdown_connections 2024-05-27T10:52:17.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.524+0000 7f8207200640 1 --2- 172.21.15.47:0/2002087075 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f81e406c8f0 0x7f81e406edb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.524+0000 7f8207200640 1 --2- 172.21.15.47:0/2002087075 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f820815c510 0x7f820815dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.524+0000 7f8207200640 1 --2- 172.21.15.47:0/2002087075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82080d0860 0x7f820815d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.524+0000 7f8207200640 1 --2- 172.21.15.47:0/2002087075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f820806da80 0x7f820809c600 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.524+0000 7f8207200640 1 -- 172.21.15.47:0/2002087075 >> 172.21.15.47:0/2002087075 conn(0x7f820806bb20 msgr2=0x7f82080ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:17.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.524+0000 7f8207200640 1 -- 172.21.15.47:0/2002087075 shutdown_connections 2024-05-27T10:52:17.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.524+0000 7f8207200640 1 -- 172.21.15.47:0/2002087075 wait complete. 2024-05-27T10:52:17.540 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T10:52:17.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.748+0000 7f133e400640 1 Processor -- start 2024-05-27T10:52:17.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.748+0000 7f133e400640 1 -- start start 2024-05-27T10:52:17.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.750+0000 7f133e400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f133806dcb0 0x7f13380d0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.750+0000 7f133e400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f13380d0c40 0x7f13380ada50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.750+0000 7f133e400640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f133815ebb0 con 0x7f133815e7d0 2024-05-27T10:52:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.750+0000 7f133e400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f133806e270 con 0x7f13380d0c40 2024-05-27T10:52:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.750+0000 7f133e400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f133806e550 con 0x7f133806dcb0 2024-05-27T10:52:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.750+0000 7f1337e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f13380d0c40 0x7f13380ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.751+0000 7f1337e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f13380d0c40 0x7f13380ada50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34592/0 (socket says 172.21.15.47:34592) 2024-05-27T10:52:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.751+0000 7f1337e00640 1 -- 172.21.15.47:0/1824968725 learned_addr learned my addr 172.21.15.47:0/1824968725 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.751+0000 7f132fe00640 1 --2- 172.21.15.47:0/1824968725 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f133806dcb0 0x7f13380d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.751+0000 7f1337e00640 1 -- 172.21.15.47:0/1824968725 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f133806dcb0 msgr2=0x7f13380d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.751+0000 7f1337e00640 1 --2- 172.21.15.47:0/1824968725 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f133806dcb0 0x7f13380d0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.751+0000 7f1337e00640 1 -- 172.21.15.47:0/1824968725 >> v1:172.21.15.53:6789/0 conn(0x7f133815e7d0 legacy=0x7f13380b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.751+0000 7f1337e00640 1 -- 172.21.15.47:0/1824968725 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f133806e830 con 0x7f13380d0c40 2024-05-27T10:52:17.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.752+0000 7f1337e00640 1 --2- 172.21.15.47:0/1824968725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13380d0c40 0x7f13380ada50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1330009e50 tx=0x7f133002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cfae49b638258e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:17.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.752+0000 7f1336a00640 1 -- 172.21.15.47:0/1824968725 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1330036070 con 0x7f13380d0c40 2024-05-27T10:52:17.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.752+0000 7f1336a00640 1 -- 172.21.15.47:0/1824968725 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1330031600 con 0x7f13380d0c40 2024-05-27T10:52:17.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.752+0000 7f1336a00640 1 -- 172.21.15.47:0/1824968725 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13300319d0 con 0x7f13380d0c40 2024-05-27T10:52:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.753+0000 7f133e400640 1 -- 172.21.15.47:0/1824968725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13380d0c40 msgr2=0x7f13380ada50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.753+0000 7f133e400640 1 --2- 172.21.15.47:0/1824968725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13380d0c40 0x7f13380ada50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1330009e50 tx=0x7f133002a6d0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.753+0000 7f133e400640 1 -- 172.21.15.47:0/1824968725 shutdown_connections 2024-05-27T10:52:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.753+0000 7f133e400640 1 --2- 172.21.15.47:0/1824968725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13380d0c40 0x7f13380ada50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.753+0000 7f133e400640 1 --2- 172.21.15.47:0/1824968725 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f133806dcb0 0x7f13380d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.753+0000 7f133e400640 1 -- 172.21.15.47:0/1824968725 >> 172.21.15.47:0/1824968725 conn(0x7f133806bd60 msgr2=0x7f133806c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:17.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.753+0000 7f133e400640 1 -- 172.21.15.47:0/1824968725 shutdown_connections 2024-05-27T10:52:17.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.753+0000 7f133e400640 1 -- 172.21.15.47:0/1824968725 wait complete. 2024-05-27T10:52:17.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.755+0000 7f133e400640 1 Processor -- start 2024-05-27T10:52:17.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.755+0000 7f133e400640 1 -- start start 2024-05-27T10:52:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.756+0000 7f133e400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f133806dcb0 0x7f1338149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.756+0000 7f133e400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13380d0c40 0x7f1338159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.756+0000 7f133e400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f133815e7d0 0x7f13381568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.756+0000 7f133e400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f13380ae110 con 0x7f133806dcb0 2024-05-27T10:52:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.756+0000 7f133e400640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f13380adf90 con 0x7f13380d0c40 2024-05-27T10:52:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.756+0000 7f133e400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f13380ae290 con 0x7f133815e7d0 2024-05-27T10:52:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.756+0000 7f1337400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f133806dcb0 0x7f1338149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.756+0000 7f1337400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f133806dcb0 0x7f1338149550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34598/0 (socket says 172.21.15.47:34598) 2024-05-27T10:52:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.756+0000 7f1337400640 1 -- 172.21.15.47:0/2539760250 learned_addr learned my addr 172.21.15.47:0/2539760250 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.757+0000 7f1337e00640 1 --2- 172.21.15.47:0/2539760250 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f133815e7d0 0x7f13381568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.757+0000 7f132fe00640 1 --2- 172.21.15.47:0/2539760250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13380d0c40 0x7f1338159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.757+0000 7f1337400640 1 -- 172.21.15.47:0/2539760250 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f133815e7d0 msgr2=0x7f13381568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:17.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.757+0000 7f1337400640 1 --2- 172.21.15.47:0/2539760250 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f133815e7d0 0x7f13381568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.757+0000 7f1337400640 1 -- 172.21.15.47:0/2539760250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13380d0c40 msgr2=0x7f1338159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:17.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.757+0000 7f1337400640 1 --2- 172.21.15.47:0/2539760250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13380d0c40 0x7f1338159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:17.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.757+0000 7f1337400640 1 -- 172.21.15.47:0/2539760250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1338155350 con 0x7f133806dcb0 2024-05-27T10:52:17.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.757+0000 7f1337e00640 1 --2- 172.21.15.47:0/2539760250 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f133815e7d0 0x7f13381568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:17.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.757+0000 7f1337400640 1 --2- 172.21.15.47:0/2539760250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f133806dcb0 0x7f1338149550 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f132800b420 tx=0x7f132800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.757+0000 7f132f400640 1 -- 172.21.15.47:0/2539760250 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1328011830 con 0x7f133806dcb0 2024-05-27T10:52:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.757+0000 7f132f400640 1 -- 172.21.15.47:0/2539760250 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1328016070 con 0x7f133806dcb0 2024-05-27T10:52:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.757+0000 7f132f400640 1 -- 172.21.15.47:0/2539760250 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1328011c10 con 0x7f133806dcb0 2024-05-27T10:52:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.757+0000 7f133e400640 1 -- 172.21.15.47:0/2539760250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13381563b0 con 0x7f133806dcb0 2024-05-27T10:52:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.758+0000 7f133e400640 1 -- 172.21.15.47:0/2539760250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13381558d0 con 0x7f133806dcb0 2024-05-27T10:52:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.759+0000 7f133e400640 1 -- 172.21.15.47:0/2539760250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13380689e0 con 0x7f133806dcb0 2024-05-27T10:52:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.760+0000 7f132f400640 1 -- 172.21.15.47:0/2539760250 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f132801b460 con 0x7f133806dcb0 2024-05-27T10:52:17.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.761+0000 7f132f400640 1 --2- 172.21.15.47:0/2539760250 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f131406c920 0x7f131406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:17.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.761+0000 7f132f400640 1 -- 172.21.15.47:0/2539760250 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f132808b610 con 0x7f133806dcb0 2024-05-27T10:52:17.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.761+0000 7f132fe00640 1 --2- 172.21.15.47:0/2539760250 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f131406c920 0x7f131406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:17.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.762+0000 7f132fe00640 1 --2- 172.21.15.47:0/2539760250 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f131406c920 0x7f131406ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1338156850 tx=0x7f1320008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:17.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:17.766+0000 7f132f400640 1 -- 172.21.15.47:0/2539760250 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1328020020 con 0x7f133806dcb0 2024-05-27T10:52:18.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.007+0000 7f133e400640 1 -- 172.21.15.47:0/2539760250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f133806cc70 con 0x7f133806dcb0 2024-05-27T10:52:18.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.008+0000 7f132f400640 1 -- 172.21.15.47:0/2539760250 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f1328059a30 con 0x7f133806dcb0 2024-05-27T10:52:18.007 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:18.007 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/4062514569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4062514569},{"type":"v1","addr":"172.21.15.47:6836","nonce":4062514569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/4113289884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":4113289884},{"type":"v1","addr":"172.21.15.53:6834","nonce":4113289884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3409529039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":3409529039},{"type":"v1","addr":"172.21.15.47:6837","nonce":3409529039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T10:52:01.683075+0000","modified":"2024-05-27T10:52:04.791891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6835/4292385883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":4292385883},{"type":"v1","addr":"172.21.15.53:6835","nonce":4292385883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-27T10:52:18.007 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-05-27T10:52:18.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.011+0000 7f133e400640 1 -- 172.21.15.47:0/2539760250 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f131406c920 msgr2=0x7f131406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:18.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.011+0000 7f133e400640 1 --2- 172.21.15.47:0/2539760250 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f131406c920 0x7f131406ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1338156850 tx=0x7f1320008040 comp rx=0 tx=0).stop 2024-05-27T10:52:18.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.011+0000 7f133e400640 1 -- 172.21.15.47:0/2539760250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f133806dcb0 msgr2=0x7f1338149550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:18.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.011+0000 7f133e400640 1 --2- 172.21.15.47:0/2539760250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f133806dcb0 0x7f1338149550 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f132800b420 tx=0x7f132800b8e0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.011+0000 7f133e400640 1 -- 172.21.15.47:0/2539760250 shutdown_connections 2024-05-27T10:52:18.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.011+0000 7f133e400640 1 --2- 172.21.15.47:0/2539760250 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f131406c920 0x7f131406ede0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.011+0000 7f133e400640 1 --2- 172.21.15.47:0/2539760250 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f133815e7d0 0x7f13381568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.011+0000 7f133e400640 1 --2- 172.21.15.47:0/2539760250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13380d0c40 0x7f1338159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.011+0000 7f133e400640 1 --2- 172.21.15.47:0/2539760250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f133806dcb0 0x7f1338149550 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.011+0000 7f133e400640 1 -- 172.21.15.47:0/2539760250 >> 172.21.15.47:0/2539760250 conn(0x7f133806bd60 msgr2=0x7f13380b1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:18.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.011+0000 7f133e400640 1 -- 172.21.15.47:0/2539760250 shutdown_connections 2024-05-27T10:52:18.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.011+0000 7f133e400640 1 -- 172.21.15.47:0/2539760250 wait complete. 2024-05-27T10:52:18.028 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:52:18.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.245+0000 7fb489c00640 1 Processor -- start 2024-05-27T10:52:18.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.245+0000 7fb489c00640 1 -- start start 2024-05-27T10:52:18.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.247+0000 7fb489c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb4840d0a70 0x7fb48406e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:18.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.247+0000 7fb489c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb48406f3a0 con 0x7fb48406ebd0 2024-05-27T10:52:18.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.247+0000 7fb489c00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb48406f680 con 0x7fb48415b380 2024-05-27T10:52:18.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.247+0000 7fb489c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb4840adcc0 con 0x7fb4840d0a70 2024-05-27T10:52:18.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.247+0000 7fb489200640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb48406ebd0 0x7fb4840ae130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60406/0 (socket says 172.21.15.47:60406) 2024-05-27T10:52:18.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.247+0000 7fb489200640 1 -- 172.21.15.47:0/2525029229 learned_addr learned my addr 172.21.15.47:0/2525029229 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:18.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.248+0000 7fb47be00640 1 --2- 172.21.15.47:0/2525029229 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb4840d0a70 0x7fb48406e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:18.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.248+0000 7fb483400640 1 -- 172.21.15.47:0/2525029229 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3579204300 0 0) 0x7fb48406f3a0 con 0x7fb48406ebd0 2024-05-27T10:52:18.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.248+0000 7fb483400640 1 -- 172.21.15.47:0/2525029229 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb468003520 con 0x7fb48406ebd0 2024-05-27T10:52:18.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.248+0000 7fb483400640 1 -- 172.21.15.47:0/2525029229 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2520228365 0 0) 0x7fb468003520 con 0x7fb48406ebd0 2024-05-27T10:52:18.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.248+0000 7fb483400640 1 -- 172.21.15.47:0/2525029229 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb4840d0a70 msgr2=0x7fb48406e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:18.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.248+0000 7fb483400640 1 --2- 172.21.15.47:0/2525029229 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb4840d0a70 0x7fb48406e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.248+0000 7fb483400640 1 -- 172.21.15.47:0/2525029229 >> v1:172.21.15.53:6789/0 conn(0x7fb48415b380 legacy=0x7fb4840d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:18.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.248+0000 7fb483400640 1 -- 172.21.15.47:0/2525029229 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb48406f960 con 0x7fb48406ebd0 2024-05-27T10:52:18.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.248+0000 7fb483400640 1 -- 172.21.15.47:0/2525029229 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7fb47c0019f0 con 0x7fb48406ebd0 2024-05-27T10:52:18.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.248+0000 7fb483400640 1 -- 172.21.15.47:0/2525029229 >> v1:172.21.15.47:6789/0 conn(0x7fb48406ebd0 legacy=0x7fb4840ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:18.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.248+0000 7fb483400640 1 --2- 172.21.15.47:0/2525029229 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb4840d0a70 0x7fb4680039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:18.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.248+0000 7fb483400640 1 --2- 172.21.15.47:0/2525029229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb468003f60 0x7fb468004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:18.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.248+0000 7fb483400640 1 --2- 172.21.15.47:0/2525029229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb468004d40 0x7fb4680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:18.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.248+0000 7fb483400640 1 -- 172.21.15.47:0/2525029229 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb46800bb50 con 0x7fb468004d40 2024-05-27T10:52:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.248+0000 7fb483400640 1 -- 172.21.15.47:0/2525029229 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb46800bcd0 con 0x7fb468003f60 2024-05-27T10:52:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.249+0000 7fb483400640 1 -- 172.21.15.47:0/2525029229 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb46800e0e0 con 0x7fb4840d0a70 2024-05-27T10:52:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.249+0000 7fb489200640 1 --2- 172.21.15.47:0/2525029229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb468004d40 0x7fb4680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.249+0000 7fb483e00640 1 --2- 172.21.15.47:0/2525029229 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb4840d0a70 0x7fb4680039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.249+0000 7fb47be00640 1 --2- 172.21.15.47:0/2525029229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb468003f60 0x7fb468004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.249+0000 7fb489200640 1 -- 172.21.15.47:0/2525029229 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb4840d0a70 msgr2=0x7fb4680039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.249+0000 7fb489200640 1 --2- 172.21.15.47:0/2525029229 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb4840d0a70 0x7fb4680039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.249+0000 7fb489200640 1 -- 172.21.15.47:0/2525029229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb468003f60 msgr2=0x7fb468004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.249+0000 7fb489200640 1 --2- 172.21.15.47:0/2525029229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb468003f60 0x7fb468004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.249+0000 7fb489200640 1 -- 172.21.15.47:0/2525029229 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb468003520 con 0x7fb468004d40 2024-05-27T10:52:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.249+0000 7fb47be00640 1 --2- 172.21.15.47:0/2525029229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb468003f60 0x7fb468004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:18.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.250+0000 7fb489200640 1 --2- 172.21.15.47:0/2525029229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb468004d40 0x7fb4680051c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00a840 tx=0x7fb468005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91f46868425080d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:18.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.250+0000 7fb483400640 1 -- 172.21.15.47:0/2525029229 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c00a460 con 0x7fb468004d40 2024-05-27T10:52:18.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.251+0000 7fb483400640 1 -- 172.21.15.47:0/2525029229 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb47c02f070 con 0x7fb468004d40 2024-05-27T10:52:18.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.251+0000 7fb483400640 1 -- 172.21.15.47:0/2525029229 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c02bcb0 con 0x7fb468004d40 2024-05-27T10:52:18.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.251+0000 7fb489c00640 1 -- 172.21.15.47:0/2525029229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb468004d40 msgr2=0x7fb4680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:18.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.251+0000 7fb489c00640 1 --2- 172.21.15.47:0/2525029229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb468004d40 0x7fb4680051c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00a840 tx=0x7fb468005830 comp rx=0 tx=0).stop 2024-05-27T10:52:18.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.251+0000 7fb489200640 1 -- 172.21.15.47:0/2525029229 reap_dead start 2024-05-27T10:52:18.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.251+0000 7fb489c00640 1 -- 172.21.15.47:0/2525029229 shutdown_connections 2024-05-27T10:52:18.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.251+0000 7fb489c00640 1 -- 172.21.15.47:0/2525029229 >> 172.21.15.47:0/2525029229 conn(0x7fb48406bb20 msgr2=0x7fb48406bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:18.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.251+0000 7fb489c00640 1 -- 172.21.15.47:0/2525029229 shutdown_connections 2024-05-27T10:52:18.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.251+0000 7fb489c00640 1 -- 172.21.15.47:0/2525029229 wait complete. 2024-05-27T10:52:18.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.253+0000 7fb489c00640 1 Processor -- start 2024-05-27T10:52:18.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.253+0000 7fb489c00640 1 -- start start 2024-05-27T10:52:18.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.254+0000 7fb489c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb484142a90 0x7fb4840b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:18.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.254+0000 7fb489c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb484142e70 0x7fb4840b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:18.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.254+0000 7fb489c00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb48409ce50 0x7fb48409d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:18.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.254+0000 7fb489c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb48406f040 con 0x7fb484142e70 2024-05-27T10:52:18.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.254+0000 7fb489c00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb48406ff20 con 0x7fb48409ce50 2024-05-27T10:52:18.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.254+0000 7fb489c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb48406e690 con 0x7fb484142a90 2024-05-27T10:52:18.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.254+0000 7fb47be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb484142e70 0x7fb4840b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:18.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.254+0000 7fb47be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb484142e70 0x7fb4840b12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34630/0 (socket says 172.21.15.47:34630) 2024-05-27T10:52:18.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.254+0000 7fb47be00640 1 -- 172.21.15.47:0/1281595492 learned_addr learned my addr 172.21.15.47:0/1281595492 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:18.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.255+0000 7fb483e00640 1 --2- 172.21.15.47:0/1281595492 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb484142a90 0x7fb4840b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:18.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.255+0000 7fb489200640 1 --2- 172.21.15.47:0/1281595492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb48409ce50 0x7fb48409d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:18.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.255+0000 7fb47be00640 1 -- 172.21.15.47:0/1281595492 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb484142a90 msgr2=0x7fb4840b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:18.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.255+0000 7fb47be00640 1 --2- 172.21.15.47:0/1281595492 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb484142a90 0x7fb4840b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.255+0000 7fb47be00640 1 -- 172.21.15.47:0/1281595492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb48409ce50 msgr2=0x7fb48409d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:18.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.255+0000 7fb47be00640 1 --2- 172.21.15.47:0/1281595492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb48409ce50 0x7fb48409d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.255+0000 7fb47be00640 1 -- 172.21.15.47:0/1281595492 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4841463f0 con 0x7fb484142e70 2024-05-27T10:52:18.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.255+0000 7fb47be00640 1 --2- 172.21.15.47:0/1281595492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb484142e70 0x7fb4840b12d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb46c010890 tx=0x7fb46c010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:18.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.256+0000 7fb480c00640 1 -- 172.21.15.47:0/1281595492 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46c00f040 con 0x7fb484142e70 2024-05-27T10:52:18.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.256+0000 7fb480c00640 1 -- 172.21.15.47:0/1281595492 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb46c00eb00 con 0x7fb484142e70 2024-05-27T10:52:18.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.256+0000 7fb480c00640 1 -- 172.21.15.47:0/1281595492 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46c01c400 con 0x7fb484142e70 2024-05-27T10:52:18.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.256+0000 7fb489c00640 1 -- 172.21.15.47:0/1281595492 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4840b1900 con 0x7fb484142e70 2024-05-27T10:52:18.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.256+0000 7fb489c00640 1 -- 172.21.15.47:0/1281595492 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4840b1ec0 con 0x7fb484142e70 2024-05-27T10:52:18.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.257+0000 7fb489c00640 1 -- 172.21.15.47:0/1281595492 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb48404fce0 con 0x7fb484142e70 2024-05-27T10:52:18.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.258+0000 7fb480c00640 1 -- 172.21.15.47:0/1281595492 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb46c01c5a0 con 0x7fb484142e70 2024-05-27T10:52:18.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.259+0000 7fb480c00640 1 --2- 172.21.15.47:0/1281595492 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb46006c8f0 0x7fb46006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:18.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.259+0000 7fb480c00640 1 -- 172.21.15.47:0/1281595492 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb46c08c0a0 con 0x7fb484142e70 2024-05-27T10:52:18.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.259+0000 7fb483e00640 1 --2- 172.21.15.47:0/1281595492 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb46006c8f0 0x7fb46006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:18.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.260+0000 7fb483e00640 1 --2- 172.21.15.47:0/1281595492 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb46006c8f0 0x7fb46006edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb474007fd0 tx=0x7fb474009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:18.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.264+0000 7fb480c00640 1 -- 172.21.15.47:0/1281595492 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb46c018030 con 0x7fb484142e70 2024-05-27T10:52:18.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.474+0000 7fb489c00640 1 -- 172.21.15.47:0/1281595492 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb48415e550 con 0x7fb484142e70 2024-05-27T10:52:18.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.476+0000 7fb480c00640 1 -- 172.21.15.47:0/1281595492 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16521 (secure 0 0 0) 0x7fb46c05a560 con 0x7fb484142e70 2024-05-27T10:52:18.474 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:18.474 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:03.257638+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:52:18.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.478+0000 7fb489c00640 1 -- 172.21.15.47:0/1281595492 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb46006c8f0 msgr2=0x7fb46006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:18.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.478+0000 7fb489c00640 1 --2- 172.21.15.47:0/1281595492 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb46006c8f0 0x7fb46006edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb474007fd0 tx=0x7fb474009040 comp rx=0 tx=0).stop 2024-05-27T10:52:18.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.478+0000 7fb489c00640 1 -- 172.21.15.47:0/1281595492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb484142e70 msgr2=0x7fb4840b12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:18.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.478+0000 7fb489c00640 1 --2- 172.21.15.47:0/1281595492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb484142e70 0x7fb4840b12d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb46c010890 tx=0x7fb46c010d50 comp rx=0 tx=0).stop 2024-05-27T10:52:18.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.478+0000 7fb489c00640 1 -- 172.21.15.47:0/1281595492 shutdown_connections 2024-05-27T10:52:18.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.478+0000 7fb489c00640 1 --2- 172.21.15.47:0/1281595492 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb46006c8f0 0x7fb46006edb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.478+0000 7fb489c00640 1 --2- 172.21.15.47:0/1281595492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb48409ce50 0x7fb48409d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.478+0000 7fb489c00640 1 --2- 172.21.15.47:0/1281595492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb484142e70 0x7fb4840b12d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.478+0000 7fb489c00640 1 --2- 172.21.15.47:0/1281595492 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb484142a90 0x7fb4840b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.478+0000 7fb489c00640 1 -- 172.21.15.47:0/1281595492 >> 172.21.15.47:0/1281595492 conn(0x7fb48406bb20 msgr2=0x7fb484159bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:18.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.478+0000 7fb489c00640 1 -- 172.21.15.47:0/1281595492 shutdown_connections 2024-05-27T10:52:18.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.479+0000 7fb489c00640 1 -- 172.21.15.47:0/1281595492 wait complete. 2024-05-27T10:52:18.497 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T10:52:18.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.714+0000 7fad02c00640 1 Processor -- start 2024-05-27T10:52:18.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.714+0000 7fad02c00640 1 -- start start 2024-05-27T10:52:18.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.716+0000 7fad02c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facfc0d2a70 0x7facfc0d2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.716+0000 7fad02c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7facfc0d0d10 0x7facfc0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.716+0000 7fad02c00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facfc0d16d0 con 0x7facfc15ea80 2024-05-27T10:52:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.716+0000 7fad02c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7facfc0d1940 con 0x7facfc0d0d10 2024-05-27T10:52:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.716+0000 7fad02c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7facfc0d3390 con 0x7facfc0d2a70 2024-05-27T10:52:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.716+0000 7fad00e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7facfc0d0d10 0x7facfc0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.716+0000 7fad00e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7facfc0d0d10 0x7facfc0d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34646/0 (socket says 172.21.15.47:34646) 2024-05-27T10:52:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.716+0000 7fad00e00640 1 -- 172.21.15.47:0/1340073871 learned_addr learned my addr 172.21.15.47:0/1340073871 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.717+0000 7fad01800640 1 --2- 172.21.15.47:0/1340073871 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facfc0d2a70 0x7facfc0d2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:18.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.717+0000 7fad00e00640 1 -- 172.21.15.47:0/1340073871 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facfc0d2a70 msgr2=0x7facfc0d2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:18.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.717+0000 7fad00e00640 1 --2- 172.21.15.47:0/1340073871 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facfc0d2a70 0x7facfc0d2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.717+0000 7fad00e00640 1 -- 172.21.15.47:0/1340073871 >> v1:172.21.15.53:6789/0 conn(0x7facfc15ea80 legacy=0x7facfc15ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:18.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.717+0000 7fad00e00640 1 -- 172.21.15.47:0/1340073871 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facfc163090 con 0x7facfc0d0d10 2024-05-27T10:52:18.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.717+0000 7fad01800640 1 --2- 172.21.15.47:0/1340073871 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facfc0d2a70 0x7facfc0d2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:18.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.718+0000 7fad00e00640 1 --2- 172.21.15.47:0/1340073871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facfc0d0d10 0x7facfc0d1190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7face80098a0 tx=0x7face802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e31dde75ef954b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:18.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.718+0000 7facfbe00640 1 -- 172.21.15.47:0/1340073871 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8037070 con 0x7facfc0d0d10 2024-05-27T10:52:18.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.718+0000 7facfbe00640 1 -- 172.21.15.47:0/1340073871 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face8032440 con 0x7facfc0d0d10 2024-05-27T10:52:18.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.718+0000 7facfbe00640 1 -- 172.21.15.47:0/1340073871 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8032810 con 0x7facfc0d0d10 2024-05-27T10:52:18.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.719+0000 7fad02c00640 1 -- 172.21.15.47:0/1340073871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facfc0d0d10 msgr2=0x7facfc0d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:18.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.719+0000 7fad02c00640 1 --2- 172.21.15.47:0/1340073871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facfc0d0d10 0x7facfc0d1190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7face80098a0 tx=0x7face802a1a0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.719+0000 7fad02c00640 1 -- 172.21.15.47:0/1340073871 shutdown_connections 2024-05-27T10:52:18.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.719+0000 7fad02c00640 1 --2- 172.21.15.47:0/1340073871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facfc0d0d10 0x7facfc0d1190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.719+0000 7fad02c00640 1 --2- 172.21.15.47:0/1340073871 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facfc0d2a70 0x7facfc0d2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.719+0000 7fad02c00640 1 -- 172.21.15.47:0/1340073871 >> 172.21.15.47:0/1340073871 conn(0x7facfc08bfd0 msgr2=0x7facfc0d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:18.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.719+0000 7fad02c00640 1 -- 172.21.15.47:0/1340073871 shutdown_connections 2024-05-27T10:52:18.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.719+0000 7fad02c00640 1 -- 172.21.15.47:0/1340073871 wait complete. 2024-05-27T10:52:18.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.721+0000 7fad02c00640 1 Processor -- start 2024-05-27T10:52:18.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.721+0000 7fad02c00640 1 -- start start 2024-05-27T10:52:18.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.722+0000 7fad02c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facfc0d0d10 0x7facfc1f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:18.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.722+0000 7fad02c00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facfc0d2a70 0x7facfc1f84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:18.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.722+0000 7fad02c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facfc15ea80 0x7facfc1f6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:18.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.722+0000 7fad02c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7facfc162890 con 0x7facfc15ea80 2024-05-27T10:52:18.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.722+0000 7fad02c00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7facfc1625b0 con 0x7facfc0d2a70 2024-05-27T10:52:18.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.722+0000 7fad02c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7facfc162b70 con 0x7facfc0d0d10 2024-05-27T10:52:18.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.723+0000 7fad02200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facfc15ea80 0x7facfc1f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:18.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.723+0000 7fad02200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facfc15ea80 0x7facfc1f6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34656/0 (socket says 172.21.15.47:34656) 2024-05-27T10:52:18.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.723+0000 7fad02200640 1 -- 172.21.15.47:0/3398607458 learned_addr learned my addr 172.21.15.47:0/3398607458 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:18.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.723+0000 7fad01800640 1 --2- 172.21.15.47:0/3398607458 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facfc0d0d10 0x7facfc1f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:18.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.723+0000 7fad00e00640 1 --2- 172.21.15.47:0/3398607458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facfc0d2a70 0x7facfc1f84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:18.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.723+0000 7fad02200640 1 -- 172.21.15.47:0/3398607458 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facfc0d0d10 msgr2=0x7facfc1f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:18.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.723+0000 7fad02200640 1 --2- 172.21.15.47:0/3398607458 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facfc0d0d10 0x7facfc1f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.723+0000 7fad02200640 1 -- 172.21.15.47:0/3398607458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facfc0d2a70 msgr2=0x7facfc1f84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:18.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.723+0000 7fad02200640 1 --2- 172.21.15.47:0/3398607458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facfc0d2a70 0x7facfc1f84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.723+0000 7fad02200640 1 -- 172.21.15.47:0/3398607458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facfc1f89e0 con 0x7facfc15ea80 2024-05-27T10:52:18.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.724+0000 7fad02200640 1 --2- 172.21.15.47:0/3398607458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facfc15ea80 0x7facfc1f6070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7facf400c780 tx=0x7facf400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:18.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.724+0000 7facf9600640 1 -- 172.21.15.47:0/3398607458 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf4004b60 con 0x7facfc15ea80 2024-05-27T10:52:18.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.724+0000 7facf9600640 1 -- 172.21.15.47:0/3398607458 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facf4004d00 con 0x7facfc15ea80 2024-05-27T10:52:18.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.724+0000 7facf9600640 1 -- 172.21.15.47:0/3398607458 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf400aa90 con 0x7facfc15ea80 2024-05-27T10:52:18.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.724+0000 7fad02c00640 1 -- 172.21.15.47:0/3398607458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facfc1f8cb0 con 0x7facfc15ea80 2024-05-27T10:52:18.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.724+0000 7fad02c00640 1 -- 172.21.15.47:0/3398607458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facfc1f9270 con 0x7facfc15ea80 2024-05-27T10:52:18.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.725+0000 7fad02c00640 1 -- 172.21.15.47:0/3398607458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facfc04fce0 con 0x7facfc15ea80 2024-05-27T10:52:18.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.726+0000 7facf9600640 1 -- 172.21.15.47:0/3398607458 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7facf400ac30 con 0x7facfc15ea80 2024-05-27T10:52:18.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.727+0000 7facf9600640 1 --2- 172.21.15.47:0/3398607458 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7facdc06c8f0 0x7facdc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:18.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.727+0000 7facf9600640 1 -- 172.21.15.47:0/3398607458 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7facf408be20 con 0x7facfc15ea80 2024-05-27T10:52:18.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.727+0000 7fad01800640 1 --2- 172.21.15.47:0/3398607458 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7facdc06c8f0 0x7facdc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:18.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.728+0000 7fad01800640 1 --2- 172.21.15.47:0/3398607458 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7facdc06c8f0 0x7facdc06edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7facf000a990 tx=0x7facf0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:18.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.732+0000 7facf9600640 1 -- 172.21.15.47:0/3398607458 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7facf4020070 con 0x7facfc15ea80 2024-05-27T10:52:18.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.975+0000 7fad02c00640 1 -- 172.21.15.47:0/3398607458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7facfc0cea00 con 0x7facfc15ea80 2024-05-27T10:52:18.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.976+0000 7facf9600640 1 -- 172.21.15.47:0/3398607458 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7facf405a240 con 0x7facfc15ea80 2024-05-27T10:52:18.974 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:18.975 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/4062514569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4062514569},{"type":"v1","addr":"172.21.15.47:6836","nonce":4062514569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/4113289884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":4113289884},{"type":"v1","addr":"172.21.15.53:6834","nonce":4113289884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3409529039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":3409529039},{"type":"v1","addr":"172.21.15.47:6837","nonce":3409529039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T10:52:01.683075+0000","modified":"2024-05-27T10:52:04.791891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6835/4292385883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":4292385883},{"type":"v1","addr":"172.21.15.53:6835","nonce":4292385883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-27T10:52:18.975 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-05-27T10:52:18.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.979+0000 7fad02c00640 1 -- 172.21.15.47:0/3398607458 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7facdc06c8f0 msgr2=0x7facdc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:18.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.979+0000 7fad02c00640 1 --2- 172.21.15.47:0/3398607458 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7facdc06c8f0 0x7facdc06edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7facf000a990 tx=0x7facf0008040 comp rx=0 tx=0).stop 2024-05-27T10:52:18.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.979+0000 7fad02c00640 1 -- 172.21.15.47:0/3398607458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facfc15ea80 msgr2=0x7facfc1f6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:18.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.979+0000 7fad02c00640 1 --2- 172.21.15.47:0/3398607458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facfc15ea80 0x7facfc1f6070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7facf400c780 tx=0x7facf400cc40 comp rx=0 tx=0).stop 2024-05-27T10:52:18.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.979+0000 7fad02c00640 1 -- 172.21.15.47:0/3398607458 shutdown_connections 2024-05-27T10:52:18.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.979+0000 7fad02c00640 1 --2- 172.21.15.47:0/3398607458 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7facdc06c8f0 0x7facdc06edb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.979+0000 7fad02c00640 1 --2- 172.21.15.47:0/3398607458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facfc15ea80 0x7facfc1f6070 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.979+0000 7fad02c00640 1 --2- 172.21.15.47:0/3398607458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facfc0d2a70 0x7facfc1f84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.979+0000 7fad02c00640 1 --2- 172.21.15.47:0/3398607458 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facfc0d0d10 0x7facfc1f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:18.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.979+0000 7fad02c00640 1 -- 172.21.15.47:0/3398607458 >> 172.21.15.47:0/3398607458 conn(0x7facfc08bfd0 msgr2=0x7facfc06ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:18.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.979+0000 7fad02c00640 1 -- 172.21.15.47:0/3398607458 shutdown_connections 2024-05-27T10:52:18.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:18.979+0000 7fad02c00640 1 -- 172.21.15.47:0/3398607458 wait complete. 2024-05-27T10:52:19.401 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-27T10:52:01.683075+0000', 'modified': '2024-05-27T10:52:04.791891+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.53:6835/4292385883', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6833', 'nonce': 4292385883}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 4292385883}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4272, 'qdb_cluster': [4272]} 2024-05-27T10:52:19.401 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-27T10:52:19.401 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-27T10:52:19.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.634+0000 7f6752600640 1 Processor -- start 2024-05-27T10:52:19.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.634+0000 7f6752600640 1 -- start start 2024-05-27T10:52:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.636+0000 7f6752600640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f674c1460a0 0x7f674c15de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.636+0000 7f6752600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f674c1611a0 con 0x7f674c15d710 2024-05-27T10:52:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.636+0000 7f6752600640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f674c160620 con 0x7f674c06c050 2024-05-27T10:52:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.636+0000 7f6752600640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f674c0afaf0 con 0x7f674c1460a0 2024-05-27T10:52:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.636+0000 7f674aa00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f674c15d710 0x7f674c06b940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60420/0 (socket says 172.21.15.47:60420) 2024-05-27T10:52:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.636+0000 7f674aa00640 1 -- 172.21.15.47:0/3653858740 learned_addr learned my addr 172.21.15.47:0/3653858740 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:19.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.637+0000 7f674b400640 1 --2- 172.21.15.47:0/3653858740 >> v2:172.21.15.53:3300/0 conn(0x7f674c1460a0 0x7f674c15de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:19.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.637+0000 7f674a000640 1 -- 172.21.15.47:0/3653858740 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1215470957 0 0) 0x7f674c1611a0 con 0x7f674c15d710 2024-05-27T10:52:19.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.637+0000 7f674a000640 1 -- 172.21.15.47:0/3653858740 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6730003520 con 0x7f674c15d710 2024-05-27T10:52:19.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.637+0000 7f674a000640 1 -- 172.21.15.47:0/3653858740 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 541534130 0 0) 0x7f6730003520 con 0x7f674c15d710 2024-05-27T10:52:19.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.637+0000 7f674a000640 1 -- 172.21.15.47:0/3653858740 >> v2:172.21.15.53:3300/0 conn(0x7f674c1460a0 msgr2=0x7f674c15de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:19.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.637+0000 7f674a000640 1 --2- 172.21.15.47:0/3653858740 >> v2:172.21.15.53:3300/0 conn(0x7f674c1460a0 0x7f674c15de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.637+0000 7f674a000640 1 -- 172.21.15.47:0/3653858740 >> v1:172.21.15.53:6789/0 conn(0x7f674c06c050 legacy=0x7f674c0aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:19.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.637+0000 7f674a000640 1 -- 172.21.15.47:0/3653858740 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f674c160900 con 0x7f674c15d710 2024-05-27T10:52:19.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.637+0000 7f674a000640 1 -- 172.21.15.47:0/3653858740 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f673c0019f0 con 0x7f674c15d710 2024-05-27T10:52:19.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.637+0000 7f674a000640 1 -- 172.21.15.47:0/3653858740 >> v1:172.21.15.47:6789/0 conn(0x7f674c15d710 legacy=0x7f674c06b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:19.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.637+0000 7f674a000640 1 --2- 172.21.15.47:0/3653858740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67300039b0 0x7f6730003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.637+0000 7f674a000640 1 --2- 172.21.15.47:0/3653858740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6730004800 0x7f6730004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.637+0000 7f674a000640 1 --2- 172.21.15.47:0/3653858740 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f67300051c0 0x7f673000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.637+0000 7f674a000640 1 -- 172.21.15.47:0/3653858740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f673000c0e0 con 0x7f6730004800 2024-05-27T10:52:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.637+0000 7f674a000640 1 -- 172.21.15.47:0/3653858740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f673000c290 con 0x7f67300039b0 2024-05-27T10:52:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.637+0000 7f674a000640 1 -- 172.21.15.47:0/3653858740 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f673000c490 con 0x7f67300051c0 2024-05-27T10:52:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.637+0000 7f674b400640 1 --2- 172.21.15.47:0/3653858740 >> v2:172.21.15.53:3300/0 conn(0x7f674c1460a0 0x7f674c15de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:52:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.638+0000 7f674aa00640 1 --2- 172.21.15.47:0/3653858740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6730004800 0x7f6730004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.638+0000 7f674be00640 1 --2- 172.21.15.47:0/3653858740 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f67300051c0 0x7f673000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.638+0000 7f674b400640 1 --2- 172.21.15.47:0/3653858740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67300039b0 0x7f6730003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.638+0000 7f674aa00640 1 -- 172.21.15.47:0/3653858740 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f67300051c0 msgr2=0x7f673000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.638+0000 7f674aa00640 1 --2- 172.21.15.47:0/3653858740 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f67300051c0 0x7f673000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.638+0000 7f674aa00640 1 -- 172.21.15.47:0/3653858740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67300039b0 msgr2=0x7f6730003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.638+0000 7f674aa00640 1 --2- 172.21.15.47:0/3653858740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67300039b0 0x7f6730003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.638+0000 7f674aa00640 1 -- 172.21.15.47:0/3653858740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6730003520 con 0x7f6730004800 2024-05-27T10:52:19.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.638+0000 7f674b400640 1 --2- 172.21.15.47:0/3653858740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67300039b0 0x7f6730003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:19.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.638+0000 7f674be00640 1 -- 172.21.15.47:0/3653858740 reap_dead start 2024-05-27T10:52:19.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.639+0000 7f674aa00640 1 --2- 172.21.15.47:0/3653858740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6730004800 0x7f6730004c80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f673c00a840 tx=0x7f6730005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca86b7857b1e1c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:19.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.639+0000 7f674a000640 1 -- 172.21.15.47:0/3653858740 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c00a460 con 0x7f6730004800 2024-05-27T10:52:19.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.639+0000 7f674a000640 1 -- 172.21.15.47:0/3653858740 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f673c02f070 con 0x7f6730004800 2024-05-27T10:52:19.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.639+0000 7f674a000640 1 -- 172.21.15.47:0/3653858740 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c02bcf0 con 0x7f6730004800 2024-05-27T10:52:19.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.640+0000 7f6752600640 1 -- 172.21.15.47:0/3653858740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6730004800 msgr2=0x7f6730004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:19.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.640+0000 7f6752600640 1 --2- 172.21.15.47:0/3653858740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6730004800 0x7f6730004c80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f673c00a840 tx=0x7f6730005830 comp rx=0 tx=0).stop 2024-05-27T10:52:19.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.640+0000 7f6752600640 1 -- 172.21.15.47:0/3653858740 shutdown_connections 2024-05-27T10:52:19.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.640+0000 7f6752600640 1 --2- 172.21.15.47:0/3653858740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6730004800 0x7f6730004c80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.640+0000 7f6752600640 1 -- 172.21.15.47:0/3653858740 >> 172.21.15.47:0/3653858740 conn(0x7f674c09aa40 msgr2=0x7f674c0b67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:19.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.640+0000 7f6752600640 1 -- 172.21.15.47:0/3653858740 shutdown_connections 2024-05-27T10:52:19.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.640+0000 7f6752600640 1 -- 172.21.15.47:0/3653858740 wait complete. 2024-05-27T10:52:19.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.642+0000 7f6752600640 1 Processor -- start 2024-05-27T10:52:19.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.642+0000 7f6752600640 1 -- start start 2024-05-27T10:52:19.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.643+0000 7f6752600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6730004800 0x7f674c142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.643+0000 7f6752600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f674c13cf70 0x7f674c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.643+0000 7f6752600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f674c13eaa0 0x7f674c13ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.643+0000 7f6752600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f674c15db70 con 0x7f6730004800 2024-05-27T10:52:19.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.643+0000 7f6752600640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f674c160ec0 con 0x7f674c13cf70 2024-05-27T10:52:19.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.643+0000 7f6752600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f674c0ae4d0 con 0x7f674c13eaa0 2024-05-27T10:52:19.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.643+0000 7f674b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6730004800 0x7f674c142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:19.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.643+0000 7f674b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6730004800 0x7f674c142020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34676/0 (socket says 172.21.15.47:34676) 2024-05-27T10:52:19.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.643+0000 7f674b400640 1 -- 172.21.15.47:0/3013248104 learned_addr learned my addr 172.21.15.47:0/3013248104 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:19.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.644+0000 7f674aa00640 1 --2- 172.21.15.47:0/3013248104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f674c13cf70 0x7f674c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:19.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.644+0000 7f674be00640 1 --2- 172.21.15.47:0/3013248104 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f674c13eaa0 0x7f674c13ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:19.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.644+0000 7f674b400640 1 -- 172.21.15.47:0/3013248104 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f674c13eaa0 msgr2=0x7f674c13ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:19.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.644+0000 7f674b400640 1 --2- 172.21.15.47:0/3013248104 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f674c13eaa0 0x7f674c13ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.644+0000 7f674b400640 1 -- 172.21.15.47:0/3013248104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f674c13cf70 msgr2=0x7f674c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:19.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.644+0000 7f674b400640 1 --2- 172.21.15.47:0/3013248104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f674c13cf70 0x7f674c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.644+0000 7f674b400640 1 -- 172.21.15.47:0/3013248104 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f674c13d710 con 0x7f6730004800 2024-05-27T10:52:19.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.644+0000 7f674b400640 1 --2- 172.21.15.47:0/3013248104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6730004800 0x7f674c142020 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f673400f4c0 tx=0x7f673400f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:19.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.644+0000 7f6743400640 1 -- 172.21.15.47:0/3013248104 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734018070 con 0x7f6730004800 2024-05-27T10:52:19.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.645+0000 7f6743400640 1 -- 172.21.15.47:0/3013248104 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6734014890 con 0x7f6730004800 2024-05-27T10:52:19.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.645+0000 7f6743400640 1 -- 172.21.15.47:0/3013248104 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734014c60 con 0x7f6730004800 2024-05-27T10:52:19.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.645+0000 7f6752600640 1 -- 172.21.15.47:0/3013248104 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f674c13d9f0 con 0x7f6730004800 2024-05-27T10:52:19.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.645+0000 7f6752600640 1 -- 172.21.15.47:0/3013248104 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f674c13dfb0 con 0x7f6730004800 2024-05-27T10:52:19.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.648+0000 7f6743400640 1 -- 172.21.15.47:0/3013248104 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f673401b070 con 0x7f6730004800 2024-05-27T10:52:19.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.649+0000 7f6743400640 1 --2- 172.21.15.47:0/3013248104 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f672806c8f0 0x7f672806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.649+0000 7f6743400640 1 -- 172.21.15.47:0/3013248104 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f673408bd40 con 0x7f6730004800 2024-05-27T10:52:19.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.650+0000 7f674aa00640 1 --2- 172.21.15.47:0/3013248104 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f672806c8f0 0x7f672806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:19.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.650+0000 7f675542a740 1 Processor -- start 2024-05-27T10:52:19.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.650+0000 7f675542a740 1 -- start start 2024-05-27T10:52:19.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.650+0000 7f674aa00640 1 --2- 172.21.15.47:0/3013248104 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f672806c8f0 0x7f672806edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f673c033000 tx=0x7f673c007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:19.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.651+0000 7f675542a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf459d2a0 0x555cf45a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.651+0000 7f675542a740 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555cf45a0f60 0x555cf45bcea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.651+0000 7f675542a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf45bd3e0 0x555cf45bd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.651+0000 7f675542a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555cf44dab10 con 0x555cf459d2a0 2024-05-27T10:52:19.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.651+0000 7f675542a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555cf44812b0 con 0x555cf45bd3e0 2024-05-27T10:52:19.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.651+0000 7f675542a740 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x555cf44d6ad0 con 0x555cf45a0f60 2024-05-27T10:52:19.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.651+0000 7f674b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf459d2a0 0x555cf45a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:19.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.651+0000 7f674b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf459d2a0 0x555cf45a0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34692/0 (socket says 172.21.15.47:34692) 2024-05-27T10:52:19.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.651+0000 7f674b400640 1 -- 172.21.15.47:0/1181201284 learned_addr learned my addr 172.21.15.47:0/1181201284 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:19.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.652+0000 7f674b400640 1 -- 172.21.15.47:0/1181201284 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555cf45a0f60 msgr2=0x555cf45bcea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:19.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.652+0000 7f674b400640 1 --2- 172.21.15.47:0/1181201284 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555cf45a0f60 0x555cf45bcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.652+0000 7f674b400640 1 -- 172.21.15.47:0/1181201284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf45bd3e0 msgr2=0x555cf45bd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:19.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.652+0000 7f674b400640 1 --2- 172.21.15.47:0/1181201284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf45bd3e0 0x555cf45bd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.652+0000 7f674b400640 1 -- 172.21.15.47:0/1181201284 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cf41ed2d0 con 0x555cf459d2a0 2024-05-27T10:52:19.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.652+0000 7f674b400640 1 --2- 172.21.15.47:0/1181201284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf459d2a0 0x555cf45a0a20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6734055ec0 tx=0x7f673405a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c0ea9c8fd23993 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:19.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.652+0000 7f673be00640 1 -- 172.21.15.47:0/1181201284 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734022040 con 0x555cf459d2a0 2024-05-27T10:52:19.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.652+0000 7f673be00640 1 -- 172.21.15.47:0/1181201284 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f673405de10 con 0x555cf459d2a0 2024-05-27T10:52:19.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.652+0000 7f673be00640 1 -- 172.21.15.47:0/1181201284 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734062640 con 0x555cf459d2a0 2024-05-27T10:52:19.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.653+0000 7f675542a740 1 -- 172.21.15.47:0/1181201284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf459d2a0 msgr2=0x555cf45a0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:19.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.653+0000 7f675542a740 1 --2- 172.21.15.47:0/1181201284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf459d2a0 0x555cf45a0a20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6734055ec0 tx=0x7f673405a160 comp rx=0 tx=0).stop 2024-05-27T10:52:19.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.653+0000 7f675542a740 1 -- 172.21.15.47:0/1181201284 shutdown_connections 2024-05-27T10:52:19.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.653+0000 7f675542a740 1 --2- 172.21.15.47:0/1181201284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf45bd3e0 0x555cf45bd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.653+0000 7f675542a740 1 --2- 172.21.15.47:0/1181201284 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555cf45a0f60 0x555cf45bcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.653+0000 7f675542a740 1 --2- 172.21.15.47:0/1181201284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf459d2a0 0x555cf45a0a20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.653+0000 7f675542a740 1 -- 172.21.15.47:0/1181201284 >> 172.21.15.47:0/1181201284 conn(0x555cf4573280 msgr2=0x555cf4574280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:19.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.653+0000 7f675542a740 1 -- 172.21.15.47:0/1181201284 shutdown_connections 2024-05-27T10:52:19.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.653+0000 7f675542a740 1 -- 172.21.15.47:0/1181201284 wait complete. 2024-05-27T10:52:19.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.654+0000 7f675542a740 1 -- start start 2024-05-27T10:52:19.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.654+0000 7f675542a740 1 Processor -- start 2024-05-27T10:52:19.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.655+0000 7f675542a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf45a0f60 0x555cf4598f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.655+0000 7f675542a740 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555cf45bd3e0 0x555cf45a4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.655+0000 7f675542a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf459b3a0 0x555cf459c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.655+0000 7f675542a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555cf45710b0 con 0x555cf459b3a0 2024-05-27T10:52:19.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.655+0000 7f675542a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555cf4494570 con 0x555cf45a0f60 2024-05-27T10:52:19.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.655+0000 7f675542a740 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x555cf4571390 con 0x555cf45bd3e0 2024-05-27T10:52:19.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.655+0000 7f675542a740 10 client.0 _ll_register_callbacks cb 0x555cf4462fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T10:52:19.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.655+0000 7f674be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf459b3a0 0x555cf459c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:19.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.655+0000 7f674be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf459b3a0 0x555cf459c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34696/0 (socket says 172.21.15.47:34696) 2024-05-27T10:52:19.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.655+0000 7f674be00640 1 -- 172.21.15.47:0/3188518642 learned_addr learned my addr 172.21.15.47:0/3188518642 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:19.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.656+0000 7f674b400640 1 --2- 172.21.15.47:0/3188518642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf45a0f60 0x555cf4598f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:19.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.656+0000 7f674be00640 1 -- 172.21.15.47:0/3188518642 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555cf45bd3e0 msgr2=0x555cf45a4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:19.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.656+0000 7f674aa00640 1 --2- 172.21.15.47:0/3188518642 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555cf45bd3e0 0x555cf45a4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:19.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.656+0000 7f674be00640 1 --2- 172.21.15.47:0/3188518642 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555cf45bd3e0 0x555cf45a4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.656+0000 7f674be00640 1 -- 172.21.15.47:0/3188518642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf45a0f60 msgr2=0x555cf4598f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:19.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.656+0000 7f674be00640 1 --2- 172.21.15.47:0/3188518642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf45a0f60 0x555cf4598f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.656+0000 7f674be00640 1 -- 172.21.15.47:0/3188518642 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cf42b76b0 con 0x555cf459b3a0 2024-05-27T10:52:19.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.656+0000 7f674b400640 1 --2- 172.21.15.47:0/3188518642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf45a0f60 0x555cf4598f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:19.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.656+0000 7f674aa00640 1 --2- 172.21.15.47:0/3188518642 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555cf45bd3e0 0x555cf45a4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:19.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.656+0000 7f674be00640 1 --2- 172.21.15.47:0/3188518642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf459b3a0 0x555cf459c4c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f674c0725e0 tx=0x7f6744003cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6808af1e844b7ef server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:19.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.656+0000 7f6738c00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-27T10:52:19.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.656+0000 7f6738c00640 1 -- 172.21.15.47:0/3188518642 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674401a060 con 0x555cf459b3a0 2024-05-27T10:52:19.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.657+0000 7f6738c00640 1 -- 172.21.15.47:0/3188518642 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f67440019d0 con 0x555cf459b3a0 2024-05-27T10:52:19.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.657+0000 7f675542a740 1 -- 172.21.15.47:0/3188518642 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f673405de10 con 0x555cf459b3a0 2024-05-27T10:52:19.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.657+0000 7f6738c00640 1 -- 172.21.15.47:0/3188518642 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f6744001bd0 con 0x555cf459b3a0 2024-05-27T10:52:19.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.657+0000 7f675542a740 10 client.4632 fetch_fsmap learned FSMap version 8 2024-05-27T10:52:19.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.657+0000 7f675542a740 1 -- 172.21.15.47:0/3188518642 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x555cf45b7aa0 con 0x555cf459b3a0 2024-05-27T10:52:19.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.657+0000 7f6738c00640 1 -- 172.21.15.47:0/3188518642 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f673405de10 con 0x555cf459b3a0 2024-05-27T10:52:19.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.657+0000 7f6738c00640 1 -- 172.21.15.47:0/3188518642 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f6744007030 con 0x555cf459b3a0 2024-05-27T10:52:19.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.657+0000 7f675542a740 10 client.4632 fetch_fsmap finished waiting for FSMap version 8 2024-05-27T10:52:19.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.657+0000 7f675542a740 10 client.4632 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-27T10:52:19.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.657+0000 7f675542a740 20 client.4632 populate_metadata read hostname 'smithi047' 2024-05-27T10:52:19.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.657+0000 7f675542a740 1 --2- 172.21.15.47:0/3188518642 >> [v2:172.21.15.53:6833/4292385883,v1:172.21.15.53:6835/4292385883] conn(0x555cf45a2410 0x555cf45de440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.657+0000 7f675542a740 4 client.4632 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T10:52:19.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.657+0000 7f675542a740 1 -- 172.21.15.47:0/3188518642 --> [v2:172.21.15.53:6833/4292385883,v1:172.21.15.53:6835/4292385883] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cf44e8530 con 0x555cf45a2410 2024-05-27T10:52:19.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.658+0000 7f674b400640 1 --2- 172.21.15.47:0/3188518642 >> [v2:172.21.15.53:6833/4292385883,v1:172.21.15.53:6835/4292385883] conn(0x555cf45a2410 0x555cf45de440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:19.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.659+0000 7f674b400640 1 --2- 172.21.15.47:0/3188518642 >> [v2:172.21.15.53:6833/4292385883,v1:172.21.15.53:6835/4292385883] conn(0x555cf45a2410 0x555cf45de440 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f40c15723a7b9711 server_cookie=e5f472d90f71fbbd in_seq=0 out_seq=0 2024-05-27T10:52:19.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.659+0000 7f6738c00640 10 client.4632 ms_handle_connect on v2:172.21.15.53:6833/4292385883 2024-05-27T10:52:19.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.661+0000 7f6738c00640 1 -- 172.21.15.47:0/3188518642 <== mds.0 v2:172.21.15.53:6833/4292385883 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555cf44e8530 con 0x555cf45a2410 2024-05-27T10:52:19.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.661+0000 7f6738c00640 10 client.4632 handle_command_reply: tid=0 2024-05-27T10:52:19.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.661+0000 7f675542a740 1 client.4632 shutdown 2024-05-27T10:52:19.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.661+0000 7f675542a740 1 -- 172.21.15.47:0/3188518642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf459b3a0 msgr2=0x555cf459c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:19.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.661+0000 7f675542a740 1 --2- 172.21.15.47:0/3188518642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf459b3a0 0x555cf459c4c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f674c0725e0 tx=0x7f6744003cb0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.661+0000 7f675542a740 1 -- 172.21.15.47:0/3188518642 shutdown_connections 2024-05-27T10:52:19.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.661+0000 7f675542a740 1 --2- 172.21.15.47:0/3188518642 >> [v2:172.21.15.53:6833/4292385883,v1:172.21.15.53:6835/4292385883] conn(0x555cf45a2410 0x555cf45de440 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.661+0000 7f675542a740 1 --2- 172.21.15.47:0/3188518642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf459b3a0 0x555cf459c4c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.661+0000 7f675542a740 1 --2- 172.21.15.47:0/3188518642 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555cf45bd3e0 0x555cf45a4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.661+0000 7f675542a740 1 --2- 172.21.15.47:0/3188518642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf45a0f60 0x555cf4598f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.661+0000 7f675542a740 1 -- 172.21.15.47:0/3188518642 >> 172.21.15.47:0/3188518642 conn(0x555cf459d2a0 msgr2=0x555cf4576db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:19.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.661+0000 7f6738c00640 0 client.4632 ms_handle_reset on v2:172.21.15.53:6833/4292385883 2024-05-27T10:52:19.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.662+0000 7f675542a740 1 -- 172.21.15.47:0/3188518642 shutdown_connections 2024-05-27T10:52:19.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.662+0000 7f675542a740 1 -- 172.21.15.47:0/3188518642 wait complete. 2024-05-27T10:52:19.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.662+0000 7f675542a740 20 client.4632 trim_cache size 0 max 16384 2024-05-27T10:52:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.682+0000 7f675542a740 1 Processor -- start 2024-05-27T10:52:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.682+0000 7f675542a740 1 -- start start 2024-05-27T10:52:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.683+0000 7f675542a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf459b3a0 0x555cf45cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.683+0000 7f675542a740 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555cf45a0f60 0x555cf4571dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.683+0000 7f675542a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf45bd3e0 0x555cf4572300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.683+0000 7f675542a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f674c070e50 con 0x555cf45bd3e0 2024-05-27T10:52:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.683+0000 7f675542a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f674c141860 con 0x555cf459b3a0 2024-05-27T10:52:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.683+0000 7f675542a740 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f674c0cf280 con 0x555cf45a0f60 2024-05-27T10:52:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.683+0000 7f674be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf45bd3e0 0x555cf4572300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.683+0000 7f674be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf45bd3e0 0x555cf4572300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34700/0 (socket says 172.21.15.47:34700) 2024-05-27T10:52:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.683+0000 7f674be00640 1 -- 172.21.15.47:0/1077223464 learned_addr learned my addr 172.21.15.47:0/1077223464 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.683+0000 7f674b400640 1 --2- 172.21.15.47:0/1077223464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf459b3a0 0x555cf45cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.683+0000 7f674aa00640 1 --2- 172.21.15.47:0/1077223464 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555cf45a0f60 0x555cf4571dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.684+0000 7f674be00640 1 -- 172.21.15.47:0/1077223464 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555cf45a0f60 msgr2=0x555cf4571dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.684+0000 7f674be00640 1 --2- 172.21.15.47:0/1077223464 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555cf45a0f60 0x555cf4571dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.684+0000 7f674be00640 1 -- 172.21.15.47:0/1077223464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf459b3a0 msgr2=0x555cf45cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:19.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.684+0000 7f674be00640 1 --2- 172.21.15.47:0/1077223464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf459b3a0 0x555cf45cf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.684+0000 7f674be00640 1 -- 172.21.15.47:0/1077223464 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cf45a43f0 con 0x555cf45bd3e0 2024-05-27T10:52:19.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.684+0000 7f674be00640 1 --2- 172.21.15.47:0/1077223464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf45bd3e0 0x555cf4572300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6744000c00 tx=0x7f6744010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b82d269657d2cde server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:19.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.684+0000 7f673b400640 1 -- 172.21.15.47:0/1077223464 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67440019d0 con 0x555cf45bd3e0 2024-05-27T10:52:19.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.684+0000 7f673b400640 1 -- 172.21.15.47:0/1077223464 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67440076d0 con 0x555cf45bd3e0 2024-05-27T10:52:19.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.684+0000 7f673b400640 1 -- 172.21.15.47:0/1077223464 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67440067d0 con 0x555cf45bd3e0 2024-05-27T10:52:19.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.685+0000 7f675542a740 1 -- 172.21.15.47:0/1077223464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf45bd3e0 msgr2=0x555cf4572300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:19.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.685+0000 7f675542a740 1 --2- 172.21.15.47:0/1077223464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf45bd3e0 0x555cf4572300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6744000c00 tx=0x7f6744010000 comp rx=0 tx=0).stop 2024-05-27T10:52:19.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.685+0000 7f675542a740 1 -- 172.21.15.47:0/1077223464 shutdown_connections 2024-05-27T10:52:19.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.685+0000 7f675542a740 1 --2- 172.21.15.47:0/1077223464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf45bd3e0 0x555cf4572300 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.685+0000 7f675542a740 1 --2- 172.21.15.47:0/1077223464 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555cf45a0f60 0x555cf4571dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.685+0000 7f675542a740 1 --2- 172.21.15.47:0/1077223464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf459b3a0 0x555cf45cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.685+0000 7f675542a740 1 -- 172.21.15.47:0/1077223464 >> 172.21.15.47:0/1077223464 conn(0x555cf459d2a0 msgr2=0x555cf459c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:19.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.685+0000 7f675542a740 1 -- 172.21.15.47:0/1077223464 shutdown_connections 2024-05-27T10:52:19.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.685+0000 7f675542a740 1 -- 172.21.15.47:0/1077223464 wait complete. 2024-05-27T10:52:19.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.686+0000 7f675542a740 1 -- start start 2024-05-27T10:52:19.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.686+0000 7f675542a740 1 Processor -- start 2024-05-27T10:52:19.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.687+0000 7f675542a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf459b3a0 0x555cf4598d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.687+0000 7f675542a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf45a0f60 0x555cf4599270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.687+0000 7f675542a740 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555cf45bd3e0 0x555cf45b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.687+0000 7f675542a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555cf45a46b0 con 0x555cf45a0f60 2024-05-27T10:52:19.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.687+0000 7f675542a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555cf4599d20 con 0x555cf459b3a0 2024-05-27T10:52:19.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.687+0000 7f675542a740 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x555cf45b7670 con 0x555cf45bd3e0 2024-05-27T10:52:19.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.687+0000 7f675542a740 10 client.0 _ll_register_callbacks cb 0x7f6744005530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T10:52:19.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.687+0000 7f674aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf45a0f60 0x555cf4599270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:19.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.687+0000 7f674aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf45a0f60 0x555cf4599270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34716/0 (socket says 172.21.15.47:34716) 2024-05-27T10:52:19.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.687+0000 7f674aa00640 1 -- 172.21.15.47:0/76700723 learned_addr learned my addr 172.21.15.47:0/76700723 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.688+0000 7f674be00640 1 --2- 172.21.15.47:0/76700723 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555cf45bd3e0 0x555cf45b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.688+0000 7f674b400640 1 --2- 172.21.15.47:0/76700723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf459b3a0 0x555cf4598d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.688+0000 7f674aa00640 1 -- 172.21.15.47:0/76700723 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555cf45bd3e0 msgr2=0x555cf45b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.688+0000 7f674aa00640 1 --2- 172.21.15.47:0/76700723 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555cf45bd3e0 0x555cf45b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.688+0000 7f674aa00640 1 -- 172.21.15.47:0/76700723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf459b3a0 msgr2=0x555cf4598d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.688+0000 7f674aa00640 1 --2- 172.21.15.47:0/76700723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf459b3a0 0x555cf4598d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.688+0000 7f674aa00640 1 -- 172.21.15.47:0/76700723 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cf459cd90 con 0x555cf45a0f60 2024-05-27T10:52:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.688+0000 7f674b400640 1 --2- 172.21.15.47:0/76700723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf459b3a0 0x555cf4598d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.688+0000 7f674aa00640 1 --2- 172.21.15.47:0/76700723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf45a0f60 0x555cf4599270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f673c00a960 tx=0x7f674c160ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10dd007df723b66 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:19.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.688+0000 7f6738c00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-27T10:52:19.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.688+0000 7f6738c00640 1 -- 172.21.15.47:0/76700723 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c034840 con 0x555cf45a0f60 2024-05-27T10:52:19.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.688+0000 7f6738c00640 1 -- 172.21.15.47:0/76700723 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f673c0349e0 con 0x555cf45a0f60 2024-05-27T10:52:19.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.688+0000 7f675542a740 1 -- 172.21.15.47:0/76700723 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67440076d0 con 0x555cf45a0f60 2024-05-27T10:52:19.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.689+0000 7f6738c00640 1 -- 172.21.15.47:0/76700723 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f673c058050 con 0x555cf45a0f60 2024-05-27T10:52:19.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.689+0000 7f675542a740 10 client.4638 fetch_fsmap learned FSMap version 8 2024-05-27T10:52:19.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.689+0000 7f675542a740 1 -- 172.21.15.47:0/76700723 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x555cf45e41d0 con 0x555cf45a0f60 2024-05-27T10:52:19.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.689+0000 7f6738c00640 1 -- 172.21.15.47:0/76700723 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67440076d0 con 0x555cf45a0f60 2024-05-27T10:52:19.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.689+0000 7f6738c00640 1 -- 172.21.15.47:0/76700723 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f673c05b020 con 0x555cf45a0f60 2024-05-27T10:52:19.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.689+0000 7f675542a740 10 client.4638 fetch_fsmap finished waiting for FSMap version 8 2024-05-27T10:52:19.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.689+0000 7f675542a740 10 client.4638 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-27T10:52:19.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.689+0000 7f675542a740 20 client.4638 populate_metadata read hostname 'smithi047' 2024-05-27T10:52:19.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.689+0000 7f675542a740 1 --2- 172.21.15.47:0/76700723 >> [v2:172.21.15.53:6833/4292385883,v1:172.21.15.53:6835/4292385883] conn(0x555cf456fea0 0x555cf4570280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:19.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.689+0000 7f675542a740 4 client.4638 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-27T10:52:19.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.689+0000 7f675542a740 1 -- 172.21.15.47:0/76700723 --> [v2:172.21.15.53:6833/4292385883,v1:172.21.15.53:6835/4292385883] -- command(tid 0: {"prefix": "status"}) -- 0x555cf45be460 con 0x555cf456fea0 2024-05-27T10:52:19.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.690+0000 7f674b400640 1 --2- 172.21.15.47:0/76700723 >> [v2:172.21.15.53:6833/4292385883,v1:172.21.15.53:6835/4292385883] conn(0x555cf456fea0 0x555cf4570280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:19.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.691+0000 7f674b400640 1 --2- 172.21.15.47:0/76700723 >> [v2:172.21.15.53:6833/4292385883,v1:172.21.15.53:6835/4292385883] conn(0x555cf456fea0 0x555cf4570280 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49f8ac2321f8fd97 server_cookie=e431acbe61c4e520 in_seq=0 out_seq=0 2024-05-27T10:52:19.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.691+0000 7f6738c00640 10 client.4638 ms_handle_connect on v2:172.21.15.53:6833/4292385883 2024-05-27T10:52:19.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.691+0000 7f6738c00640 1 -- 172.21.15.47:0/76700723 <== mds.0 v2:172.21.15.53:6833/4292385883 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x555cf45be460 con 0x555cf456fea0 2024-05-27T10:52:19.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.691+0000 7f6738c00640 10 client.4638 handle_command_reply: tid=0 2024-05-27T10:52:19.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.691+0000 7f675542a740 1 client.4638 shutdown 2024-05-27T10:52:19.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.692+0000 7f675542a740 1 -- 172.21.15.47:0/76700723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf45a0f60 msgr2=0x555cf4599270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:19.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.692+0000 7f675542a740 1 --2- 172.21.15.47:0/76700723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf45a0f60 0x555cf4599270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f673c00a960 tx=0x7f674c160ad0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.692+0000 7f675542a740 1 -- 172.21.15.47:0/76700723 shutdown_connections 2024-05-27T10:52:19.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.692+0000 7f675542a740 1 --2- 172.21.15.47:0/76700723 >> [v2:172.21.15.53:6833/4292385883,v1:172.21.15.53:6835/4292385883] conn(0x555cf456fea0 0x555cf4570280 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.692+0000 7f675542a740 1 --2- 172.21.15.47:0/76700723 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555cf45bd3e0 0x555cf45b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.692+0000 7f675542a740 1 --2- 172.21.15.47:0/76700723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cf45a0f60 0x555cf4599270 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.692+0000 7f675542a740 1 --2- 172.21.15.47:0/76700723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf459b3a0 0x555cf4598d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.692+0000 7f675542a740 1 -- 172.21.15.47:0/76700723 >> 172.21.15.47:0/76700723 conn(0x555cf459d2a0 msgr2=0x555cf45a1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:19.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.692+0000 7f6738c00640 0 client.4638 ms_handle_reset on v2:172.21.15.53:6833/4292385883 2024-05-27T10:52:19.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.692+0000 7f675542a740 1 -- 172.21.15.47:0/76700723 shutdown_connections 2024-05-27T10:52:19.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.692+0000 7f675542a740 1 -- 172.21.15.47:0/76700723 wait complete. 2024-05-27T10:52:19.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.692+0000 7f675542a740 20 client.4638 trim_cache size 0 max 16384 2024-05-27T10:52:19.697 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-27T10:52:19.697 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "7b0baa11-ae73-495b-918f-c8db2aa0510f", 2024-05-27T10:52:19.697 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-05-27T10:52:19.698 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4272, 2024-05-27T10:52:19.698 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-27T10:52:19.698 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-27T10:52:19.698 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-27T10:52:19.698 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 17.452057920000001, 2024-05-27T10:52:19.698 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 8, 2024-05-27T10:52:19.698 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 20, 2024-05-27T10:52:19.698 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 20, 2024-05-27T10:52:19.698 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 25.632017964999999 2024-05-27T10:52:19.698 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-27T10:52:19.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.693+0000 7f6752600640 1 -- 172.21.15.47:0/3013248104 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f672806c8f0 msgr2=0x7f672806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:19.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.693+0000 7f6752600640 1 --2- 172.21.15.47:0/3013248104 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f672806c8f0 0x7f672806edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f673c033000 tx=0x7f673c007000 comp rx=0 tx=0).stop 2024-05-27T10:52:19.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.693+0000 7f6752600640 1 -- 172.21.15.47:0/3013248104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6730004800 msgr2=0x7f674c142020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:19.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.693+0000 7f6752600640 1 --2- 172.21.15.47:0/3013248104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6730004800 0x7f674c142020 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f673400f4c0 tx=0x7f673400f980 comp rx=0 tx=0).stop 2024-05-27T10:52:19.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.693+0000 7f6752600640 1 -- 172.21.15.47:0/3013248104 shutdown_connections 2024-05-27T10:52:19.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.693+0000 7f6752600640 1 --2- 172.21.15.47:0/3013248104 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f672806c8f0 0x7f672806edb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.693+0000 7f6752600640 1 --2- 172.21.15.47:0/3013248104 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f674c13eaa0 0x7f674c13ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.693+0000 7f6752600640 1 --2- 172.21.15.47:0/3013248104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f674c13cf70 0x7f674c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.693+0000 7f6752600640 1 --2- 172.21.15.47:0/3013248104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6730004800 0x7f674c142020 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:19.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.693+0000 7f6752600640 1 -- 172.21.15.47:0/3013248104 >> 172.21.15.47:0/3013248104 conn(0x7f674c09aa40 msgr2=0x7f674c0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:19.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.693+0000 7f6752600640 1 -- 172.21.15.47:0/3013248104 shutdown_connections 2024-05-27T10:52:19.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:19.693+0000 7f6752600640 1 -- 172.21.15.47:0/3013248104 wait complete. 2024-05-27T10:52:19.709 INFO:teuthology.run_tasks:Running task sequential... 2024-05-27T10:52:19.720 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-27T10:52:19.720 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-27T10:52:19.721 INFO:teuthology.task.print:Enabling mgr modules 2024-05-27T10:52:19.721 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-27T10:52:19.798 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-27T10:52:19.798 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-27T10:52:19.798 INFO:tasks.ceph_fuse:client.0 config is {} 2024-05-27T10:52:19.798 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-27T10:52:19.798 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-27T10:52:19.798 INFO:tasks.ceph_fuse:client.2 config is {} 2024-05-27T10:52:19.798 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-27T10:52:19.798 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-27T10:52:19.799 INFO:tasks.ceph_fuse:client.1 config is {} 2024-05-27T10:52:19.799 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-27T10:52:19.799 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-27T10:52:19.799 INFO:tasks.ceph_fuse:client.3 config is {} 2024-05-27T10:52:19.799 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-27T10:52:19.799 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-27T10:52:19.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:19.799 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-27T10:52:19.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:19.860 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-05-27T10:52:19.952 INFO:teuthology.orchestra.run.smithi047.stderr:Cannot find device "ceph-brx" 2024-05-27T10:52:19.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T10:52:19.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:19.956 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-05-27T10:52:20.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:20.017 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link delete ceph-brx 2024-05-27T10:52:20.111 INFO:teuthology.orchestra.run.smithi053.stderr:Cannot find device "ceph-brx" 2024-05-27T10:52:20.117 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T10:52:20.117 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-27T10:52:20.118 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T10:52:20.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.339+0000 7f7b7b200640 1 Processor -- start 2024-05-27T10:52:20.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.339+0000 7f7b7b200640 1 -- start start 2024-05-27T10:52:20.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.341+0000 7f7b7b200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7b7c1638c0 0x7f7b7c071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:20.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.341+0000 7f7b7b200640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7b7c0d0a70 0x7f7b7c0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:20.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.341+0000 7f7b7b200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b7c0b3370 con 0x7f7b7c072120 2024-05-27T10:52:20.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.341+0000 7f7b7b200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f7b7c0726a0 con 0x7f7b7c1638c0 2024-05-27T10:52:20.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.341+0000 7f7b7b200640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f7b7c0b3610 con 0x7f7b7c0d0a70 2024-05-27T10:52:20.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.341+0000 7f7b79400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f7b7c072120 0x7f7b7c0d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60422/0 (socket says 172.21.15.47:60422) 2024-05-27T10:52:20.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.341+0000 7f7b79400640 1 -- 172.21.15.47:0/60806405 learned_addr learned my addr 172.21.15.47:0/60806405 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:20.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.341+0000 7f7b79e00640 1 --2- 172.21.15.47:0/60806405 >> v2:172.21.15.47:3300/0 conn(0x7f7b7c1638c0 0x7f7b7c071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:20.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.342+0000 7f7b7a800640 1 --2- 172.21.15.47:0/60806405 >> v2:172.21.15.53:3300/0 conn(0x7f7b7c0d0a70 0x7f7b7c0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:20.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.342+0000 7f7b78a00640 1 -- 172.21.15.47:0/60806405 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 240412163 0 0) 0x7f7b7c0b3370 con 0x7f7b7c072120 2024-05-27T10:52:20.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.342+0000 7f7b78a00640 1 -- 172.21.15.47:0/60806405 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b60003520 con 0x7f7b7c072120 2024-05-27T10:52:20.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.342+0000 7f7b79e00640 1 -- 172.21.15.47:0/60806405 >> v2:172.21.15.53:3300/0 conn(0x7f7b7c0d0a70 msgr2=0x7f7b7c0ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:20.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.342+0000 7f7b79e00640 1 --2- 172.21.15.47:0/60806405 >> v2:172.21.15.53:3300/0 conn(0x7f7b7c0d0a70 0x7f7b7c0ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:20.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.342+0000 7f7b79e00640 1 -- 172.21.15.47:0/60806405 >> v1:172.21.15.47:6789/0 conn(0x7f7b7c072120 legacy=0x7f7b7c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:20.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.342+0000 7f7b79e00640 1 -- 172.21.15.47:0/60806405 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7c0b38f0 con 0x7f7b7c1638c0 2024-05-27T10:52:20.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.342+0000 7f7b7a800640 1 --2- 172.21.15.47:0/60806405 >> v2:172.21.15.53:3300/0 conn(0x7f7b7c0d0a70 0x7f7b7c0ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:52:20.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.344+0000 7f7b79e00640 1 --2- 172.21.15.47:0/60806405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b7c1638c0 0x7f7b7c071be0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0733a0 tx=0x7f7b6c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713a1d30f7be3f8d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:20.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.344+0000 7f7b78a00640 1 -- 172.21.15.47:0/60806405 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c007740 con 0x7f7b7c1638c0 2024-05-27T10:52:20.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.344+0000 7f7b78a00640 1 -- 172.21.15.47:0/60806405 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b6c0078e0 con 0x7f7b7c1638c0 2024-05-27T10:52:20.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.344+0000 7f7b78a00640 1 -- 172.21.15.47:0/60806405 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c007cb0 con 0x7f7b7c1638c0 2024-05-27T10:52:20.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.345+0000 7f7b7b200640 1 -- 172.21.15.47:0/60806405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b7c1638c0 msgr2=0x7f7b7c071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:20.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.345+0000 7f7b7b200640 1 --2- 172.21.15.47:0/60806405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b7c1638c0 0x7f7b7c071be0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0733a0 tx=0x7f7b6c02a680 comp rx=0 tx=0).stop 2024-05-27T10:52:20.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.345+0000 7f7b7b200640 1 -- 172.21.15.47:0/60806405 shutdown_connections 2024-05-27T10:52:20.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.345+0000 7f7b7b200640 1 --2- 172.21.15.47:0/60806405 >> v2:172.21.15.53:3300/0 conn(0x7f7b7c0d0a70 0x7f7b7c0ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:20.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.345+0000 7f7b7b200640 1 --2- 172.21.15.47:0/60806405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b7c1638c0 0x7f7b7c071be0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:20.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.345+0000 7f7b7b200640 1 -- 172.21.15.47:0/60806405 >> 172.21.15.47:0/60806405 conn(0x7f7b7c06bb20 msgr2=0x7f7b7c06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:20.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.345+0000 7f7b7b200640 1 -- 172.21.15.47:0/60806405 shutdown_connections 2024-05-27T10:52:20.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.345+0000 7f7b7b200640 1 -- 172.21.15.47:0/60806405 wait complete. 2024-05-27T10:52:20.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.347+0000 7f7b7b200640 1 Processor -- start 2024-05-27T10:52:20.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.347+0000 7f7b7b200640 1 -- start start 2024-05-27T10:52:20.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.348+0000 7f7b7b200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b7c072120 0x7f7b7c1f8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:20.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.348+0000 7f7b7b200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b7c0d0a70 0x7f7b7c098ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:20.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.348+0000 7f7b7b200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7b7c1f5ca0 0x7f7b7c096920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:20.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.348+0000 7f7b7b200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7c0b4270 con 0x7f7b7c0d0a70 2024-05-27T10:52:20.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.348+0000 7f7b7b200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7c0b40f0 con 0x7f7b7c072120 2024-05-27T10:52:20.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.348+0000 7f7b7b200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f7b7c163ca0 con 0x7f7b7c1f5ca0 2024-05-27T10:52:20.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.348+0000 7f7b79400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b7c0d0a70 0x7f7b7c098ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:20.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.348+0000 7f7b79400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b7c0d0a70 0x7f7b7c098ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34734/0 (socket says 172.21.15.47:34734) 2024-05-27T10:52:20.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.348+0000 7f7b79400640 1 -- 172.21.15.47:0/174253579 learned_addr learned my addr 172.21.15.47:0/174253579 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:20.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.348+0000 7f7b79400640 1 -- 172.21.15.47:0/174253579 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7b7c1f5ca0 msgr2=0x7f7b7c096920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:20.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.348+0000 7f7b79400640 1 --2- 172.21.15.47:0/174253579 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7b7c1f5ca0 0x7f7b7c096920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:20.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.348+0000 7f7b79400640 1 -- 172.21.15.47:0/174253579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b7c072120 msgr2=0x7f7b7c1f8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:20.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.348+0000 7f7b79400640 1 --2- 172.21.15.47:0/174253579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b7c072120 0x7f7b7c1f8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:20.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.349+0000 7f7b79400640 1 -- 172.21.15.47:0/174253579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7c1f6150 con 0x7f7b7c0d0a70 2024-05-27T10:52:20.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.349+0000 7f7b79400640 1 --2- 172.21.15.47:0/174253579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b7c0d0a70 0x7f7b7c098ad0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7b6400c460 tx=0x7f7b6400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:20.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.349+0000 7f7b72000640 1 -- 172.21.15.47:0/174253579 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b64017070 con 0x7f7b7c0d0a70 2024-05-27T10:52:20.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.349+0000 7f7b72000640 1 -- 172.21.15.47:0/174253579 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b64005ce0 con 0x7f7b7c0d0a70 2024-05-27T10:52:20.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.349+0000 7f7b72000640 1 -- 172.21.15.47:0/174253579 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b64007290 con 0x7f7b7c0d0a70 2024-05-27T10:52:20.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.349+0000 7f7b7b200640 1 -- 172.21.15.47:0/174253579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b7c0991b0 con 0x7f7b7c0d0a70 2024-05-27T10:52:20.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.349+0000 7f7b7b200640 1 -- 172.21.15.47:0/174253579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b7c099770 con 0x7f7b7c0d0a70 2024-05-27T10:52:20.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.350+0000 7f7b7b200640 1 -- 172.21.15.47:0/174253579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b7c04fce0 con 0x7f7b7c0d0a70 2024-05-27T10:52:20.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.352+0000 7f7b72000640 1 -- 172.21.15.47:0/174253579 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7b6401a070 con 0x7f7b7c0d0a70 2024-05-27T10:52:20.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.352+0000 7f7b72000640 1 --2- 172.21.15.47:0/174253579 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7b5806c920 0x7f7b5806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:20.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.353+0000 7f7b72000640 1 -- 172.21.15.47:0/174253579 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7b6408ae30 con 0x7f7b7c0d0a70 2024-05-27T10:52:20.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.353+0000 7f7b79e00640 1 --2- 172.21.15.47:0/174253579 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7b5806c920 0x7f7b5806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:20.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.353+0000 7f7b79e00640 1 --2- 172.21.15.47:0/174253579 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7b5806c920 0x7f7b5806ede0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c034000 tx=0x7f7b6c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:20.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.357+0000 7f7b72000640 1 -- 172.21.15.47:0/174253579 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7b640592f0 con 0x7f7b7c0d0a70 2024-05-27T10:52:20.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.601+0000 7f7b7b200640 1 -- 172.21.15.47:0/174253579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7b7c0b5080 con 0x7f7b7c0d0a70 2024-05-27T10:52:20.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.602+0000 7f7b72000640 1 -- 172.21.15.47:0/174253579 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f7b64058bf0 con 0x7f7b7c0d0a70 2024-05-27T10:52:20.600 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-27T10:52:20.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.604+0000 7f7b7b200640 1 -- 172.21.15.47:0/174253579 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7b5806c920 msgr2=0x7f7b5806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:20.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.604+0000 7f7b7b200640 1 --2- 172.21.15.47:0/174253579 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7b5806c920 0x7f7b5806ede0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c034000 tx=0x7f7b6c02e000 comp rx=0 tx=0).stop 2024-05-27T10:52:20.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.604+0000 7f7b7b200640 1 -- 172.21.15.47:0/174253579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b7c0d0a70 msgr2=0x7f7b7c098ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:20.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.604+0000 7f7b7b200640 1 --2- 172.21.15.47:0/174253579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b7c0d0a70 0x7f7b7c098ad0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7b6400c460 tx=0x7f7b6400c920 comp rx=0 tx=0).stop 2024-05-27T10:52:20.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.604+0000 7f7b7b200640 1 -- 172.21.15.47:0/174253579 shutdown_connections 2024-05-27T10:52:20.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.604+0000 7f7b7b200640 1 --2- 172.21.15.47:0/174253579 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7b5806c920 0x7f7b5806ede0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:20.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.604+0000 7f7b7b200640 1 --2- 172.21.15.47:0/174253579 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7b7c1f5ca0 0x7f7b7c096920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:20.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.604+0000 7f7b7b200640 1 --2- 172.21.15.47:0/174253579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b7c0d0a70 0x7f7b7c098ad0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:20.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.604+0000 7f7b7b200640 1 --2- 172.21.15.47:0/174253579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b7c072120 0x7f7b7c1f8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:20.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.604+0000 7f7b7b200640 1 -- 172.21.15.47:0/174253579 >> 172.21.15.47:0/174253579 conn(0x7f7b7c06bb20 msgr2=0x7f7b7c0cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:20.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.605+0000 7f7b7b200640 1 -- 172.21.15.47:0/174253579 shutdown_connections 2024-05-27T10:52:20.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20.605+0000 7f7b7b200640 1 -- 172.21.15.47:0/174253579 wait complete. 2024-05-27T10:52:20.620 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-27T10:52:20.620 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T10:52:20.620 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-05-27T10:52:20.621 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-27T10:52:20.621 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-27T10:52:20.621 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-27T10:52:20.621 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T10:52:20.621 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T10:52:20.621 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-27T10:52:20.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:20.621 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-05-27T10:52:20.674 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T10:52:20.674 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T10:52:20.674 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T10:52:20.674 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:20.674 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-05-27T10:52:20.674 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:20.674 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T10:52:20.675 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-05-27T10:52:20.675 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-05-27T10:52:20.675 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T10:52:20.675 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-05-27T10:52:20.675 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-05-27T10:52:20.675 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T10:52:20.675 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-05-27T10:52:20.675 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-05-27T10:52:20.675 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-27T10:52:20.675 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42558sec preferred_lft 42558sec 2024-05-27T10:52:20.675 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link noprefixroute 2024-05-27T10:52:20.675 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:20.675 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T10:52:20.675 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-05-27T10:52:20.676 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-05-27T10:52:20.677 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-27T10:52:20.677 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T10:52:20.677 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-27T10:52:20.677 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add name ceph-brx type bridge 2024-05-27T10:52:20.677 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr flush dev ceph-brx 2024-05-27T10:52:20.677 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set ceph-brx up 2024-05-27T10:52:20.677 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-27T10:52:20.677 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-27T10:52:20.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T10:52:21.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:21.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:21.157 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T10:52:21.222 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-05-27T10:52:21.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:21.226 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-05-27T10:52:21.289 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-05-27T10:52:21.289 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T10:52:21.289 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-27T10:52:21.289 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-27T10:52:21.289 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T10:52:21.290 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T10:52:21.290 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-27T10:52:21.290 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-27T10:52:21.291 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-27T10:52:21.291 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-27T10:52:21.291 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-27T10:52:21.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T10:52:22.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:22.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:22.073 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-27T10:52:22.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:22.117 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-05-27T10:52:22.210 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T10:52:22.210 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-27T10:52:22.210 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T10:52:22.210 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-27T10:52:22.210 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-27T10:52:22.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T10:52:22.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:22.396 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-27T10:52:22.396 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T10:52:22.396 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-27T10:52:22.396 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-27T10:52:22.397 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-27T10:52:22.397 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-27T10:52:22.397 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-27T10:52:22.397 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-27T10:52:22.397 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-27T10:52:22.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T10:52:22.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:22.677 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T10:52:22.677 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-27T10:52:22.678 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-05-27T10:52:22.678 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.0 master ceph-brx 2024-05-27T10:52:22.678 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-27T10:52:22.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T10:52:22.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:22.862 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-27T10:52:22.862 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T10:52:22.863 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-27T10:52:22.904 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-27T10:52:22.904 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T10:52:22.904 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-27T10:52:22.989 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-05-27T10:52:23.099 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T10:52:23.146 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-05-27T10:52:23.146 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-05-27T10:52:23.146 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-05-27T10:52:23.146 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-05-27T10:52:23.146 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-05-27T10:52:23.146 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-05-27T10:52:23.146 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-05-27T10:52:23.146 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-05-27T10:52:23.146 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-05-27T10:52:23.147 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-05-27T10:52:23.147 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-05-27T10:52:23.147 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-05-27T10:52:23.147 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T10:52:23.147 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-05-27T10:52:23.147 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-05-27T10:52:23.147 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-05-27T10:52:23.147 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-05-27T10:52:23.147 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-05-27T10:52:23.147 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-05-27T10:52:23.147 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-05-27T10:52:23.147 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-27T10:52:23.147 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-27T10:52:23.147 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-05-27T10:52:23.148 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-05-27T10:52:23.148 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-05-27T10:52:23.148 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T10:52:23.148 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T10:52:23.148 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T10:52:23.148 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T10:52:23.148 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-05-27T10:52:23.148 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T10:52:23.148 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T10:52:23.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:23.149 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-05-27T10:52:23.191 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-27T10:52:23.192 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-27T10:52:23.240 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-05-27T10:52:23.307 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T10:52:23.347 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-05-27T10:52:23.347 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-05-27T10:52:23.347 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-05-27T10:52:23.347 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-05-27T10:52:23.347 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-05-27T10:52:23.347 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-05-27T10:52:23.348 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-05-27T10:52:23.348 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-05-27T10:52:23.348 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-05-27T10:52:23.348 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-05-27T10:52:23.348 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-05-27T10:52:23.348 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-05-27T10:52:23.348 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T10:52:23.348 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-05-27T10:52:23.348 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-05-27T10:52:23.348 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-05-27T10:52:23.348 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-05-27T10:52:23.348 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-05-27T10:52:23.348 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-05-27T10:52:23.348 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-05-27T10:52:23.349 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-27T10:52:23.349 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-27T10:52:23.349 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-05-27T10:52:23.349 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-05-27T10:52:23.349 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-05-27T10:52:23.349 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T10:52:23.349 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T10:52:23.349 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T10:52:23.349 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T10:52:23.349 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-05-27T10:52:23.349 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T10:52:23.349 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T10:52:23.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:23.350 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-05-27T10:52:23.423 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:2024-05-27T10:52:23.425+0000 7feb25b55480 -1 init, newargv = 0x556688457e10 newargc=15 2024-05-27T10:52:23.423 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[44058]: starting ceph client 2024-05-27T10:52:23.436 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[44058]: starting fuse 2024-05-27T10:52:23.438 INFO:teuthology.orchestra.run.smithi047.stdout:42 2024-05-27T10:52:23.439 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-05-27T10:52:23.439 DEBUG:teuthology.orchestra.run.smithi047:> sudo stdin-killer -- python3 -c ' 2024-05-27T10:52:23.439 DEBUG:teuthology.orchestra.run.smithi047:> import glob 2024-05-27T10:52:23.439 DEBUG:teuthology.orchestra.run.smithi047:> import re 2024-05-27T10:52:23.439 DEBUG:teuthology.orchestra.run.smithi047:> import os 2024-05-27T10:52:23.439 DEBUG:teuthology.orchestra.run.smithi047:> import subprocess 2024-05-27T10:52:23.439 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-27T10:52:23.440 DEBUG:teuthology.orchestra.run.smithi047:> def _find_admin_socket(client_name): 2024-05-27T10:52:23.440 DEBUG:teuthology.orchestra.run.smithi047:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-27T10:52:23.440 DEBUG:teuthology.orchestra.run.smithi047:> files = glob.glob(asok_path) 2024-05-27T10:52:23.440 DEBUG:teuthology.orchestra.run.smithi047:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-27T10:52:23.440 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-27T10:52:23.440 DEBUG:teuthology.orchestra.run.smithi047:> # Given a non-glob path, it better be there 2024-05-27T10:52:23.440 DEBUG:teuthology.orchestra.run.smithi047:> if "*" not in asok_path: 2024-05-27T10:52:23.440 DEBUG:teuthology.orchestra.run.smithi047:> assert(len(files) == 1) 2024-05-27T10:52:23.440 DEBUG:teuthology.orchestra.run.smithi047:> return files[0] 2024-05-27T10:52:23.440 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-27T10:52:23.440 DEBUG:teuthology.orchestra.run.smithi047:> for f in files: 2024-05-27T10:52:23.440 DEBUG:teuthology.orchestra.run.smithi047:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-27T10:52:23.440 DEBUG:teuthology.orchestra.run.smithi047:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-27T10:52:23.440 DEBUG:teuthology.orchestra.run.smithi047:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-27T10:52:23.440 DEBUG:teuthology.orchestra.run.smithi047:> contents = proc_f.read() 2024-05-27T10:52:23.441 DEBUG:teuthology.orchestra.run.smithi047:> if mountpoint in contents: 2024-05-27T10:52:23.441 DEBUG:teuthology.orchestra.run.smithi047:> return f 2024-05-27T10:52:23.441 DEBUG:teuthology.orchestra.run.smithi047:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-27T10:52:23.441 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-27T10:52:23.441 DEBUG:teuthology.orchestra.run.smithi047:> print(_find_admin_socket("client.0")) 2024-05-27T10:52:23.441 DEBUG:teuthology.orchestra.run.smithi047:> ' 2024-05-27T10:52:23.630 INFO:teuthology.orchestra.run.smithi047.stdout:/var/run/ceph/ceph-client.0.44058.asok 2024-05-27T10:52:23.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:23.647 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44058.asok 2024-05-27T10:52:23.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:23.648 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44058.asok status 2024-05-27T10:52:23.881 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-27T10:52:23.882 INFO:teuthology.orchestra.run.smithi047.stdout: "metadata": { 2024-05-27T10:52:23.882 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_sha1": "81797d879079e1a392b37a9c23a946594f658c50", 2024-05-27T10:52:23.882 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 19.0.0-3154-g81797d87 (81797d879079e1a392b37a9c23a946594f658c50) squid (dev)", 2024-05-27T10:52:23.882 INFO:teuthology.orchestra.run.smithi047.stdout: "entity_id": "0", 2024-05-27T10:52:23.882 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": "smithi047", 2024-05-27T10:52:23.882 INFO:teuthology.orchestra.run.smithi047.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-27T10:52:23.882 INFO:teuthology.orchestra.run.smithi047.stdout: "pid": "44058", 2024-05-27T10:52:23.882 INFO:teuthology.orchestra.run.smithi047.stdout: "root": "/" 2024-05-27T10:52:23.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:52:23.882 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_count": 0, 2024-05-27T10:52:23.882 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_pinned_count": 0, 2024-05-27T10:52:23.882 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4653, 2024-05-27T10:52:23.883 INFO:teuthology.orchestra.run.smithi047.stdout: "inst": { 2024-05-27T10:52:23.883 INFO:teuthology.orchestra.run.smithi047.stdout: "name": { 2024-05-27T10:52:23.883 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "client", 2024-05-27T10:52:23.883 INFO:teuthology.orchestra.run.smithi047.stdout: "num": 4653 2024-05-27T10:52:23.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:52:23.883 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-05-27T10:52:23.883 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-05-27T10:52:23.883 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.1:0", 2024-05-27T10:52:23.883 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 214332456 2024-05-27T10:52:23.883 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:52:23.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:52:23.883 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-05-27T10:52:23.883 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-05-27T10:52:23.883 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.1:0", 2024-05-27T10:52:23.884 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 214332456 2024-05-27T10:52:23.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:52:23.884 INFO:teuthology.orchestra.run.smithi047.stdout: "inst_str": "client.4653 192.168.0.1:0/214332456", 2024-05-27T10:52:23.884 INFO:teuthology.orchestra.run.smithi047.stdout: "addr_str": "192.168.0.1:0/214332456", 2024-05-27T10:52:23.884 INFO:teuthology.orchestra.run.smithi047.stdout: "inode_count": 1, 2024-05-27T10:52:23.884 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_epoch": 8, 2024-05-27T10:52:23.884 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch": 20, 2024-05-27T10:52:23.884 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch_barrier": 0, 2024-05-27T10:52:23.884 INFO:teuthology.orchestra.run.smithi047.stdout: "blocklisted": false, 2024-05-27T10:52:23.884 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs" 2024-05-27T10:52:23.884 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-27T10:52:23.896 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T10:52:24.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.112+0000 7f89f2c00640 1 Processor -- start 2024-05-27T10:52:24.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.112+0000 7f89f2c00640 1 -- start start 2024-05-27T10:52:24.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.114+0000 7f89f2c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89ec0d0a70 0x7f89ec06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:24.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.114+0000 7f89f2c00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f89ec15eb90 0x7f89ec15f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:24.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.114+0000 7f89f2c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89ec06fe40 con 0x7f89ec072330 2024-05-27T10:52:24.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.114+0000 7f89f2c00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f89ec072710 con 0x7f89ec15eb90 2024-05-27T10:52:24.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.114+0000 7f89f2c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f89ec15fb10 con 0x7f89ec0d0a70 2024-05-27T10:52:24.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.114+0000 7f89f1800640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f89ec072330 0x7f89ec0d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:42924/0 (socket says 172.21.15.47:42924) 2024-05-27T10:52:24.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.114+0000 7f89f1800640 1 -- 172.21.15.47:0/1366700612 learned_addr learned my addr 172.21.15.47:0/1366700612 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:24.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.115+0000 7f89f0e00640 1 --2- 172.21.15.47:0/1366700612 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89ec0d0a70 0x7f89ec06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:24.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.115+0000 7f89f2200640 1 --2- 172.21.15.47:0/1366700612 >> v2:172.21.15.53:3300/0 conn(0x7f89ec15eb90 0x7f89ec15f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:24.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.115+0000 7f89ebe00640 1 -- 172.21.15.47:0/1366700612 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1479428684 0 0) 0x7f89e0001110 con 0x7f89ec072330 2024-05-27T10:52:24.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.115+0000 7f89ebe00640 1 -- 172.21.15.47:0/1366700612 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89d4003520 con 0x7f89ec072330 2024-05-27T10:52:24.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.115+0000 7f89f2200640 1 -- 172.21.15.47:0/1366700612 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89ec0d0a70 msgr2=0x7f89ec06eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:24.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.115+0000 7f89f2200640 1 --2- 172.21.15.47:0/1366700612 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89ec0d0a70 0x7f89ec06eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:24.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.115+0000 7f89f2200640 1 -- 172.21.15.47:0/1366700612 >> v1:172.21.15.47:6789/0 conn(0x7f89ec072330 legacy=0x7f89ec0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:24.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.115+0000 7f89f2200640 1 -- 172.21.15.47:0/1366700612 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ec15f560 con 0x7f89ec15eb90 2024-05-27T10:52:24.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.117+0000 7f89f2200640 1 --2- 172.21.15.47:0/1366700612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89ec15eb90 0x7f89ec15f020 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009d90 tx=0x7f89e402a530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63eaa6e8f53f2916 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:24.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.117+0000 7f89ebe00640 1 -- 172.21.15.47:0/1366700612 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e4007740 con 0x7f89ec15eb90 2024-05-27T10:52:24.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.117+0000 7f89ebe00640 1 -- 172.21.15.47:0/1366700612 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e40078e0 con 0x7f89ec15eb90 2024-05-27T10:52:24.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.117+0000 7f89ebe00640 1 -- 172.21.15.47:0/1366700612 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e4007c90 con 0x7f89ec15eb90 2024-05-27T10:52:24.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.118+0000 7f89f2c00640 1 -- 172.21.15.47:0/1366700612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89ec15eb90 msgr2=0x7f89ec15f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:24.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.118+0000 7f89f2c00640 1 --2- 172.21.15.47:0/1366700612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89ec15eb90 0x7f89ec15f020 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009d90 tx=0x7f89e402a530 comp rx=0 tx=0).stop 2024-05-27T10:52:24.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.118+0000 7f89f2c00640 1 -- 172.21.15.47:0/1366700612 shutdown_connections 2024-05-27T10:52:24.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.118+0000 7f89f2c00640 1 --2- 172.21.15.47:0/1366700612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89ec15eb90 0x7f89ec15f020 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:24.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.118+0000 7f89f2c00640 1 --2- 172.21.15.47:0/1366700612 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89ec0d0a70 0x7f89ec06eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:24.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.118+0000 7f89f2c00640 1 -- 172.21.15.47:0/1366700612 >> 172.21.15.47:0/1366700612 conn(0x7f89ec06bb20 msgr2=0x7f89ec06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:24.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.118+0000 7f89f2c00640 1 -- 172.21.15.47:0/1366700612 shutdown_connections 2024-05-27T10:52:24.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.118+0000 7f89f2c00640 1 -- 172.21.15.47:0/1366700612 wait complete. 2024-05-27T10:52:24.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.120+0000 7f89f2c00640 1 Processor -- start 2024-05-27T10:52:24.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.120+0000 7f89f2c00640 1 -- start start 2024-05-27T10:52:24.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.121+0000 7f89f2c00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89ec072330 0x7f89ec14d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:24.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.121+0000 7f89f2c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89ec0d0a70 0x7f89ec14f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:24.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.121+0000 7f89f2c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89ec15eb90 0x7f89ec0b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:24.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.121+0000 7f89f2c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f89ec06dfd0 con 0x7f89ec0d0a70 2024-05-27T10:52:24.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.121+0000 7f89f2c00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f89ec06e620 con 0x7f89ec072330 2024-05-27T10:52:24.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.121+0000 7f89f2c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f89ec06e2b0 con 0x7f89ec15eb90 2024-05-27T10:52:24.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.121+0000 7f89f0e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89ec0d0a70 0x7f89ec14f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:24.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.122+0000 7f89f0e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89ec0d0a70 0x7f89ec14f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51868/0 (socket says 172.21.15.47:51868) 2024-05-27T10:52:24.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.122+0000 7f89f0e00640 1 -- 172.21.15.47:0/1494508142 learned_addr learned my addr 172.21.15.47:0/1494508142 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:24.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.122+0000 7f89f1800640 1 --2- 172.21.15.47:0/1494508142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89ec072330 0x7f89ec14d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:24.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.122+0000 7f89f2200640 1 --2- 172.21.15.47:0/1494508142 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89ec15eb90 0x7f89ec0b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:24.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.122+0000 7f89f0e00640 1 -- 172.21.15.47:0/1494508142 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89ec15eb90 msgr2=0x7f89ec0b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:24.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.122+0000 7f89f0e00640 1 --2- 172.21.15.47:0/1494508142 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89ec15eb90 0x7f89ec0b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:24.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.122+0000 7f89f0e00640 1 -- 172.21.15.47:0/1494508142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89ec072330 msgr2=0x7f89ec14d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:24.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.122+0000 7f89f0e00640 1 --2- 172.21.15.47:0/1494508142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89ec072330 0x7f89ec14d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:24.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.122+0000 7f89f0e00640 1 -- 172.21.15.47:0/1494508142 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ec0aff80 con 0x7f89ec0d0a70 2024-05-27T10:52:24.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.122+0000 7f89f2200640 1 --2- 172.21.15.47:0/1494508142 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89ec15eb90 0x7f89ec0b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:24.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.122+0000 7f89f0e00640 1 --2- 172.21.15.47:0/1494508142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89ec0d0a70 0x7f89ec14f310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f89d800e870 tx=0x7f89d800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:24.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.123+0000 7f89e9600640 1 -- 172.21.15.47:0/1494508142 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8017070 con 0x7f89ec0d0a70 2024-05-27T10:52:24.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.123+0000 7f89e9600640 1 -- 172.21.15.47:0/1494508142 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d800c940 con 0x7f89ec0d0a70 2024-05-27T10:52:24.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.123+0000 7f89e9600640 1 -- 172.21.15.47:0/1494508142 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d800cd30 con 0x7f89ec0d0a70 2024-05-27T10:52:24.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.123+0000 7f89f2c00640 1 -- 172.21.15.47:0/1494508142 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89ec0b0260 con 0x7f89ec0d0a70 2024-05-27T10:52:24.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.123+0000 7f89f2c00640 1 -- 172.21.15.47:0/1494508142 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89ec0b0820 con 0x7f89ec0d0a70 2024-05-27T10:52:24.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.124+0000 7f89f2c00640 1 -- 172.21.15.47:0/1494508142 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89ec04fce0 con 0x7f89ec0d0a70 2024-05-27T10:52:24.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.125+0000 7f89e9600640 1 -- 172.21.15.47:0/1494508142 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f89d801a070 con 0x7f89ec0d0a70 2024-05-27T10:52:24.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.127+0000 7f89e9600640 1 --2- 172.21.15.47:0/1494508142 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f89cc06c920 0x7f89cc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:24.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.127+0000 7f89e9600640 1 -- 172.21.15.47:0/1494508142 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f89d808bdb0 con 0x7f89ec0d0a70 2024-05-27T10:52:24.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.127+0000 7f89f1800640 1 --2- 172.21.15.47:0/1494508142 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f89cc06c920 0x7f89cc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:24.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.128+0000 7f89f1800640 1 --2- 172.21.15.47:0/1494508142 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f89cc06c920 0x7f89cc06ede0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f89e0007fd0 tx=0x7f89e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:24.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.132+0000 7f89e9600640 1 -- 172.21.15.47:0/1494508142 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f89d8090070 con 0x7f89ec0d0a70 2024-05-27T10:52:24.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.378+0000 7f89f2c00640 1 -- 172.21.15.47:0/1494508142 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f89ec0b5080 con 0x7f89ec0d0a70 2024-05-27T10:52:24.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.379+0000 7f89e9600640 1 -- 172.21.15.47:0/1494508142 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f89d805a140 con 0x7f89ec0d0a70 2024-05-27T10:52:24.377 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-27T10:52:24.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.382+0000 7f89f2c00640 1 -- 172.21.15.47:0/1494508142 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f89cc06c920 msgr2=0x7f89cc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:24.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.382+0000 7f89f2c00640 1 --2- 172.21.15.47:0/1494508142 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f89cc06c920 0x7f89cc06ede0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f89e0007fd0 tx=0x7f89e0009040 comp rx=0 tx=0).stop 2024-05-27T10:52:24.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.382+0000 7f89f2c00640 1 -- 172.21.15.47:0/1494508142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89ec0d0a70 msgr2=0x7f89ec14f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:24.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.382+0000 7f89f2c00640 1 --2- 172.21.15.47:0/1494508142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89ec0d0a70 0x7f89ec14f310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f89d800e870 tx=0x7f89d800ed30 comp rx=0 tx=0).stop 2024-05-27T10:52:24.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.382+0000 7f89f2c00640 1 -- 172.21.15.47:0/1494508142 shutdown_connections 2024-05-27T10:52:24.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.382+0000 7f89f2c00640 1 --2- 172.21.15.47:0/1494508142 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f89cc06c920 0x7f89cc06ede0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:24.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.382+0000 7f89f2c00640 1 --2- 172.21.15.47:0/1494508142 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89ec15eb90 0x7f89ec0b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:24.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.382+0000 7f89f2c00640 1 --2- 172.21.15.47:0/1494508142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89ec0d0a70 0x7f89ec14f310 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:24.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.382+0000 7f89f2c00640 1 --2- 172.21.15.47:0/1494508142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89ec072330 0x7f89ec14d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:24.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.382+0000 7f89f2c00640 1 -- 172.21.15.47:0/1494508142 >> 172.21.15.47:0/1494508142 conn(0x7f89ec06bb20 msgr2=0x7f89ec0b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:24.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.382+0000 7f89f2c00640 1 -- 172.21.15.47:0/1494508142 shutdown_connections 2024-05-27T10:52:24.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24.382+0000 7f89f2c00640 1 -- 172.21.15.47:0/1494508142 wait complete. 2024-05-27T10:52:24.398 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-27T10:52:24.398 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T10:52:24.398 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-05-27T10:52:24.398 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-27T10:52:24.398 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-27T10:52:24.398 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-27T10:52:24.398 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T10:52:24.398 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T10:52:24.398 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-27T10:52:24.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:24.399 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-05-27T10:52:24.452 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T10:52:24.452 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T10:52:24.452 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T10:52:24.452 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:24.452 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-05-27T10:52:24.452 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:24.452 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T10:52:24.453 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-05-27T10:52:24.453 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-05-27T10:52:24.453 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T10:52:24.453 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-05-27T10:52:24.453 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-05-27T10:52:24.453 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T10:52:24.453 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-05-27T10:52:24.453 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-05-27T10:52:24.453 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-27T10:52:24.453 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42554sec preferred_lft 42554sec 2024-05-27T10:52:24.453 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link noprefixroute 2024-05-27T10:52:24.453 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:24.453 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T10:52:24.453 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-05-27T10:52:24.454 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-05-27T10:52:24.454 INFO:teuthology.orchestra.run.smithi047.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T10:52:24.454 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether f6:38:c6:67:c8:23 brd ff:ff:ff:ff:ff:ff 2024-05-27T10:52:24.454 INFO:teuthology.orchestra.run.smithi047.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-27T10:52:24.454 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:24.454 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::fcdc:f9ff:fef0:43e8/64 scope link 2024-05-27T10:52:24.454 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:24.454 INFO:teuthology.orchestra.run.smithi047.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T10:52:24.454 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether f6:38:c6:67:c8:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T10:52:24.454 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::f438:c6ff:fe67:c823/64 scope link 2024-05-27T10:52:24.454 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:24.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:24.455 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T10:52:24.539 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-05-27T10:52:24.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:24.543 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-05-27T10:52:24.599 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-05-27T10:52:24.599 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T10:52:24.599 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-27T10:52:24.599 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-27T10:52:24.599 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T10:52:24.600 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T10:52:24.600 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-27T10:52:24.600 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-27T10:52:24.600 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-27T10:52:24.600 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-27T10:52:24.600 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-27T10:52:24.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T10:52:24.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:24.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:24.827 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-27T10:52:24.883 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-27T10:52:24.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:24.884 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-05-27T10:52:24.936 INFO:teuthology.orchestra.run.smithi047.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-27T10:52:24.937 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T10:52:24.937 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-27T10:52:24.937 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T10:52:24.937 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-27T10:52:24.937 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-27T10:52:25.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T10:52:25.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:25.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:25.127 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-27T10:52:25.200 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T10:52:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T10:52:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T10:52:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-05-27T10:52:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:25.201 INFO:teuthology.orchestra.run.smithi047.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T10:52:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 6e:a8:7e:b0:c2:e3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-27T10:52:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-27T10:52:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::6ca8:7eff:feb0:c2e3/64 scope link 2024-05-27T10:52:25.201 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:25.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:25.204 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-27T10:52:25.292 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T10:52:25.292 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T10:52:25.292 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T10:52:25.292 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:25.292 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-05-27T10:52:25.293 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:25.293 INFO:teuthology.orchestra.run.smithi047.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T10:52:25.293 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 6e:a8:7e:b0:c2:e3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-27T10:52:25.293 INFO:teuthology.orchestra.run.smithi047.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-27T10:52:25.293 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:25.293 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::6ca8:7eff:feb0:c2e3/64 scope link 2024-05-27T10:52:25.293 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:25.296 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-27T10:52:25.297 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T10:52:25.297 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-27T10:52:25.297 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-27T10:52:25.297 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-27T10:52:25.297 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-27T10:52:25.297 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-27T10:52:25.297 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-27T10:52:25.297 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-27T10:52:25.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T10:52:25.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:25.591 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T10:52:25.591 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-27T10:52:25.591 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.1 up 2024-05-27T10:52:25.591 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.1 master ceph-brx 2024-05-27T10:52:25.591 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-27T10:52:25.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T10:52:25.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:25.816 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-05-27T10:52:25.816 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T10:52:25.817 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-27T10:52:25.868 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-27T10:52:25.868 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T10:52:25.868 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-27T10:52:25.922 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-05-27T10:52:26.012 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T10:52:26.070 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-05-27T10:52:26.071 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-05-27T10:52:26.071 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-05-27T10:52:26.071 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-05-27T10:52:26.071 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-05-27T10:52:26.071 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-05-27T10:52:26.071 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-05-27T10:52:26.072 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-05-27T10:52:26.072 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-05-27T10:52:26.072 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-05-27T10:52:26.072 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-05-27T10:52:26.072 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-05-27T10:52:26.072 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T10:52:26.072 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-05-27T10:52:26.072 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-05-27T10:52:26.073 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-05-27T10:52:26.073 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-05-27T10:52:26.073 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-05-27T10:52:26.073 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-05-27T10:52:26.073 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-05-27T10:52:26.074 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-27T10:52:26.074 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-27T10:52:26.074 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-05-27T10:52:26.074 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-05-27T10:52:26.074 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-05-27T10:52:26.074 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T10:52:26.074 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T10:52:26.075 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T10:52:26.075 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T10:52:26.075 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-05-27T10:52:26.075 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T10:52:26.075 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T10:52:26.075 INFO:teuthology.orchestra.run.smithi047.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-27T10:52:26.075 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T10:52:26.075 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T10:52:26.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:26.076 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-05-27T10:52:26.133 INFO:teuthology.orchestra.run.smithi047.stdout:42 2024-05-27T10:52:26.133 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2024-05-27T10:52:26.133 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-05-27T10:52:26.141 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-05-27T10:52:26.211 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T10:52:26.256 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-05-27T10:52:26.256 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-05-27T10:52:26.256 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-05-27T10:52:26.256 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-05-27T10:52:26.256 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-05-27T10:52:26.256 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-05-27T10:52:26.256 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-05-27T10:52:26.256 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-05-27T10:52:26.256 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-05-27T10:52:26.257 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-05-27T10:52:26.257 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-05-27T10:52:26.257 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-05-27T10:52:26.257 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T10:52:26.257 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-05-27T10:52:26.257 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-05-27T10:52:26.257 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-05-27T10:52:26.257 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-05-27T10:52:26.257 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-05-27T10:52:26.257 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-05-27T10:52:26.257 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-05-27T10:52:26.257 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-27T10:52:26.258 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-27T10:52:26.258 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-05-27T10:52:26.258 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-05-27T10:52:26.258 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-05-27T10:52:26.258 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T10:52:26.258 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T10:52:26.258 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T10:52:26.258 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T10:52:26.258 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-05-27T10:52:26.258 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T10:52:26.258 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T10:52:26.258 INFO:teuthology.orchestra.run.smithi047.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-27T10:52:26.259 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T10:52:26.259 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T10:52:26.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:26.260 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-05-27T10:52:26.320 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi047.stderr:2024-05-27T10:52:26.322+0000 7f208d172480 -1 init, newargv = 0x562c3255e110 newargc=15 2024-05-27T10:52:26.320 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi047.stderr:ceph-fuse[44556]: starting ceph client 2024-05-27T10:52:26.331 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi047.stderr:ceph-fuse[44556]: starting fuse 2024-05-27T10:52:26.346 INFO:teuthology.orchestra.run.smithi047.stdout:42 2024-05-27T10:52:26.347 INFO:teuthology.orchestra.run.smithi047.stdout:43 2024-05-27T10:52:26.347 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 43] 2024-05-27T10:52:26.347 DEBUG:teuthology.orchestra.run.smithi047:> sudo stdin-killer -- python3 -c ' 2024-05-27T10:52:26.347 DEBUG:teuthology.orchestra.run.smithi047:> import glob 2024-05-27T10:52:26.347 DEBUG:teuthology.orchestra.run.smithi047:> import re 2024-05-27T10:52:26.347 DEBUG:teuthology.orchestra.run.smithi047:> import os 2024-05-27T10:52:26.347 DEBUG:teuthology.orchestra.run.smithi047:> import subprocess 2024-05-27T10:52:26.347 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-27T10:52:26.347 DEBUG:teuthology.orchestra.run.smithi047:> def _find_admin_socket(client_name): 2024-05-27T10:52:26.348 DEBUG:teuthology.orchestra.run.smithi047:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-05-27T10:52:26.348 DEBUG:teuthology.orchestra.run.smithi047:> files = glob.glob(asok_path) 2024-05-27T10:52:26.348 DEBUG:teuthology.orchestra.run.smithi047:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-05-27T10:52:26.348 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-27T10:52:26.348 DEBUG:teuthology.orchestra.run.smithi047:> # Given a non-glob path, it better be there 2024-05-27T10:52:26.348 DEBUG:teuthology.orchestra.run.smithi047:> if "*" not in asok_path: 2024-05-27T10:52:26.348 DEBUG:teuthology.orchestra.run.smithi047:> assert(len(files) == 1) 2024-05-27T10:52:26.348 DEBUG:teuthology.orchestra.run.smithi047:> return files[0] 2024-05-27T10:52:26.348 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-27T10:52:26.348 DEBUG:teuthology.orchestra.run.smithi047:> for f in files: 2024-05-27T10:52:26.348 DEBUG:teuthology.orchestra.run.smithi047:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-27T10:52:26.348 DEBUG:teuthology.orchestra.run.smithi047:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-27T10:52:26.348 DEBUG:teuthology.orchestra.run.smithi047:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-27T10:52:26.348 DEBUG:teuthology.orchestra.run.smithi047:> contents = proc_f.read() 2024-05-27T10:52:26.348 DEBUG:teuthology.orchestra.run.smithi047:> if mountpoint in contents: 2024-05-27T10:52:26.349 DEBUG:teuthology.orchestra.run.smithi047:> return f 2024-05-27T10:52:26.349 DEBUG:teuthology.orchestra.run.smithi047:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-27T10:52:26.349 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-27T10:52:26.349 DEBUG:teuthology.orchestra.run.smithi047:> print(_find_admin_socket("client.2")) 2024-05-27T10:52:26.349 DEBUG:teuthology.orchestra.run.smithi047:> ' 2024-05-27T10:52:26.549 INFO:teuthology.orchestra.run.smithi047.stdout:/var/run/ceph/ceph-client.2.44556.asok 2024-05-27T10:52:26.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:26.567 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.44556.asok 2024-05-27T10:52:26.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:26.567 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.44556.asok status 2024-05-27T10:52:26.808 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-27T10:52:26.808 INFO:teuthology.orchestra.run.smithi047.stdout: "metadata": { 2024-05-27T10:52:26.808 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_sha1": "81797d879079e1a392b37a9c23a946594f658c50", 2024-05-27T10:52:26.809 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 19.0.0-3154-g81797d87 (81797d879079e1a392b37a9c23a946594f658c50) squid (dev)", 2024-05-27T10:52:26.809 INFO:teuthology.orchestra.run.smithi047.stdout: "entity_id": "2", 2024-05-27T10:52:26.809 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": "smithi047", 2024-05-27T10:52:26.809 INFO:teuthology.orchestra.run.smithi047.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-05-27T10:52:26.809 INFO:teuthology.orchestra.run.smithi047.stdout: "pid": "44556", 2024-05-27T10:52:26.809 INFO:teuthology.orchestra.run.smithi047.stdout: "root": "/" 2024-05-27T10:52:26.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:52:26.809 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_count": 0, 2024-05-27T10:52:26.809 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_pinned_count": 0, 2024-05-27T10:52:26.809 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4668, 2024-05-27T10:52:26.809 INFO:teuthology.orchestra.run.smithi047.stdout: "inst": { 2024-05-27T10:52:26.809 INFO:teuthology.orchestra.run.smithi047.stdout: "name": { 2024-05-27T10:52:26.809 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "client", 2024-05-27T10:52:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: "num": 4668 2024-05-27T10:52:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:52:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-05-27T10:52:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-05-27T10:52:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.2:0", 2024-05-27T10:52:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 696064259 2024-05-27T10:52:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:52:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:52:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-05-27T10:52:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-05-27T10:52:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.2:0", 2024-05-27T10:52:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 696064259 2024-05-27T10:52:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:52:26.811 INFO:teuthology.orchestra.run.smithi047.stdout: "inst_str": "client.4668 192.168.0.2:0/696064259", 2024-05-27T10:52:26.811 INFO:teuthology.orchestra.run.smithi047.stdout: "addr_str": "192.168.0.2:0/696064259", 2024-05-27T10:52:26.811 INFO:teuthology.orchestra.run.smithi047.stdout: "inode_count": 1, 2024-05-27T10:52:26.811 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_epoch": 8, 2024-05-27T10:52:26.811 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch": 20, 2024-05-27T10:52:26.811 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch_barrier": 0, 2024-05-27T10:52:26.811 INFO:teuthology.orchestra.run.smithi047.stdout: "blocklisted": false, 2024-05-27T10:52:26.811 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs" 2024-05-27T10:52:26.811 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-27T10:52:26.823 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T10:52:27.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.042+0000 7fe011e00640 1 Processor -- start 2024-05-27T10:52:27.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.042+0000 7fe011e00640 1 -- start start 2024-05-27T10:52:27.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.044+0000 7fe011e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe00c0b1e00 0x7fe00c15ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:27.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.044+0000 7fe011e00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe00c146090 0x7fe00c0b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:27.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.044+0000 7fe011e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe00c146a50 con 0x7fe00c1464f0 2024-05-27T10:52:27.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.044+0000 7fe011e00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe00c146d30 con 0x7fe00c146090 2024-05-27T10:52:27.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.044+0000 7fe011e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe00c147010 con 0x7fe00c0b1e00 2024-05-27T10:52:27.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.044+0000 7fe011400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe00c1464f0 0x7fe00c147af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:42932/0 (socket says 172.21.15.47:42932) 2024-05-27T10:52:27.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.044+0000 7fe011400640 1 -- 172.21.15.47:0/3635211481 learned_addr learned my addr 172.21.15.47:0/3635211481 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:27.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.044+0000 7fe003e00640 1 --2- 172.21.15.47:0/3635211481 >> v2:172.21.15.53:3300/0 conn(0x7fe00c146090 0x7fe00c0b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:27.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.044+0000 7fe010a00640 1 --2- 172.21.15.47:0/3635211481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe00c0b1e00 0x7fe00c15ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:27.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.045+0000 7fe00be00640 1 -- 172.21.15.47:0/3635211481 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2764291684 0 0) 0x7fe00c146a50 con 0x7fe00c1464f0 2024-05-27T10:52:27.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.045+0000 7fe00be00640 1 -- 172.21.15.47:0/3635211481 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfec003520 con 0x7fe00c1464f0 2024-05-27T10:52:27.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.045+0000 7fe00be00640 1 -- 172.21.15.47:0/3635211481 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4102689074 0 0) 0x7fdfec003520 con 0x7fe00c1464f0 2024-05-27T10:52:27.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.045+0000 7fe00be00640 1 -- 172.21.15.47:0/3635211481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe00c0b1e00 msgr2=0x7fe00c15ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:27.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.045+0000 7fe00be00640 1 --2- 172.21.15.47:0/3635211481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe00c0b1e00 0x7fe00c15ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:27.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.045+0000 7fe00be00640 1 -- 172.21.15.47:0/3635211481 >> v2:172.21.15.53:3300/0 conn(0x7fe00c146090 msgr2=0x7fe00c0b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:27.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.045+0000 7fe00be00640 1 --2- 172.21.15.47:0/3635211481 >> v2:172.21.15.53:3300/0 conn(0x7fe00c146090 0x7fe00c0b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:27.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.045+0000 7fe00be00640 1 -- 172.21.15.47:0/3635211481 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00c1472f0 con 0x7fe00c1464f0 2024-05-27T10:52:27.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.045+0000 7fe00be00640 1 -- 172.21.15.47:0/3635211481 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7fe0040019f0 con 0x7fe00c1464f0 2024-05-27T10:52:27.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.045+0000 7fe00be00640 1 -- 172.21.15.47:0/3635211481 >> v1:172.21.15.47:6789/0 conn(0x7fe00c1464f0 legacy=0x7fe00c147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:27.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.045+0000 7fe00be00640 1 --2- 172.21.15.47:0/3635211481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfec0039b0 0x7fdfec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:27.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.045+0000 7fe00be00640 1 --2- 172.21.15.47:0/3635211481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe00c0b1e00 0x7fdfec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:27.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.045+0000 7fe00be00640 1 --2- 172.21.15.47:0/3635211481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfec004d40 0x7fdfec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:27.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.045+0000 7fe00be00640 1 -- 172.21.15.47:0/3635211481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c146d30 con 0x7fdfec004d40 2024-05-27T10:52:27.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.045+0000 7fe00be00640 1 -- 172.21.15.47:0/3635211481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c147010 con 0x7fdfec0039b0 2024-05-27T10:52:27.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.045+0000 7fe00be00640 1 -- 172.21.15.47:0/3635211481 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fdfec00ba90 con 0x7fe00c0b1e00 2024-05-27T10:52:27.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.046+0000 7fe011400640 1 --2- 172.21.15.47:0/3635211481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfec004d40 0x7fdfec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:27.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.046+0000 7fe010a00640 1 --2- 172.21.15.47:0/3635211481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfec0039b0 0x7fdfec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:27.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.046+0000 7fe011400640 1 -- 172.21.15.47:0/3635211481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe00c0b1e00 msgr2=0x7fdfec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:27.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.046+0000 7fe011400640 1 --2- 172.21.15.47:0/3635211481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe00c0b1e00 0x7fdfec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:27.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.046+0000 7fe011400640 1 -- 172.21.15.47:0/3635211481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfec0039b0 msgr2=0x7fdfec003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:27.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.046+0000 7fe011400640 1 --2- 172.21.15.47:0/3635211481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfec0039b0 0x7fdfec003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:27.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.046+0000 7fe011400640 1 -- 172.21.15.47:0/3635211481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfec003520 con 0x7fdfec004d40 2024-05-27T10:52:27.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.047+0000 7fe011400640 1 --2- 172.21.15.47:0/3635211481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfec004d40 0x7fdfec0051c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe00400a7a0 tx=0x7fdfec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfbc9ce8f0df35 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:27.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.048+0000 7fe00be00640 1 -- 172.21.15.47:0/3635211481 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00400a3f0 con 0x7fdfec004d40 2024-05-27T10:52:27.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.048+0000 7fe00be00640 1 -- 172.21.15.47:0/3635211481 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe00402f070 con 0x7fdfec004d40 2024-05-27T10:52:27.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.048+0000 7fe00be00640 1 -- 172.21.15.47:0/3635211481 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00402bc20 con 0x7fdfec004d40 2024-05-27T10:52:27.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.048+0000 7fe011e00640 1 -- 172.21.15.47:0/3635211481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfec004d40 msgr2=0x7fdfec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:27.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.048+0000 7fe011e00640 1 --2- 172.21.15.47:0/3635211481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfec004d40 0x7fdfec0051c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe00400a7a0 tx=0x7fdfec005830 comp rx=0 tx=0).stop 2024-05-27T10:52:27.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.048+0000 7fe011400640 1 -- 172.21.15.47:0/3635211481 reap_dead start 2024-05-27T10:52:27.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.048+0000 7fe011e00640 1 -- 172.21.15.47:0/3635211481 shutdown_connections 2024-05-27T10:52:27.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.048+0000 7fe011e00640 1 -- 172.21.15.47:0/3635211481 >> 172.21.15.47:0/3635211481 conn(0x7fe00c0b6790 msgr2=0x7fe00c0b6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:27.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.049+0000 7fe011e00640 1 -- 172.21.15.47:0/3635211481 shutdown_connections 2024-05-27T10:52:27.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.049+0000 7fe011e00640 1 -- 172.21.15.47:0/3635211481 wait complete. 2024-05-27T10:52:27.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.050+0000 7fe011e00640 1 Processor -- start 2024-05-27T10:52:27.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.051+0000 7fe011e00640 1 -- start start 2024-05-27T10:52:27.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.052+0000 7fe011e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdfec004d40 0x7fe00c1517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:27.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.052+0000 7fe011e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe00c09b3d0 0x7fe00c09ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:27.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.052+0000 7fe011e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe00c09cd30 0x7fe00c150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:27.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.052+0000 7fe011e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c0b2d30 con 0x7fe00c09cd30 2024-05-27T10:52:27.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.052+0000 7fe011e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c0b2bb0 con 0x7fe00c09b3d0 2024-05-27T10:52:27.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.052+0000 7fe011e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe00c148200 con 0x7fdfec004d40 2024-05-27T10:52:27.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.052+0000 7fe011400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe00c09cd30 0x7fe00c150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:27.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.052+0000 7fe011400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe00c09cd30 0x7fe00c150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51880/0 (socket says 172.21.15.47:51880) 2024-05-27T10:52:27.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.052+0000 7fe011400640 1 -- 172.21.15.47:0/174532328 learned_addr learned my addr 172.21.15.47:0/174532328 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:27.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.052+0000 7fe010a00640 1 --2- 172.21.15.47:0/174532328 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdfec004d40 0x7fe00c1517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:27.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.052+0000 7fe003e00640 1 --2- 172.21.15.47:0/174532328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe00c09b3d0 0x7fe00c09ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:27.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.052+0000 7fe011400640 1 -- 172.21.15.47:0/174532328 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdfec004d40 msgr2=0x7fe00c1517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:27.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.052+0000 7fe011400640 1 --2- 172.21.15.47:0/174532328 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdfec004d40 0x7fe00c1517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:27.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.052+0000 7fe011400640 1 -- 172.21.15.47:0/174532328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe00c09b3d0 msgr2=0x7fe00c09ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:27.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.052+0000 7fe011400640 1 --2- 172.21.15.47:0/174532328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe00c09b3d0 0x7fe00c09ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:27.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.052+0000 7fe011400640 1 -- 172.21.15.47:0/174532328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00c14ed90 con 0x7fe00c09cd30 2024-05-27T10:52:27.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.053+0000 7fe011400640 1 --2- 172.21.15.47:0/174532328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe00c09cd30 0x7fe00c150c10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe00400a7a0 tx=0x7fe004001cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:27.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.053+0000 7fe009600640 1 -- 172.21.15.47:0/174532328 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00400a3f0 con 0x7fe00c09cd30 2024-05-27T10:52:27.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.053+0000 7fe009600640 1 -- 172.21.15.47:0/174532328 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe004044070 con 0x7fe00c09cd30 2024-05-27T10:52:27.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.053+0000 7fe011e00640 1 -- 172.21.15.47:0/174532328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe00c14f070 con 0x7fe00c09cd30 2024-05-27T10:52:27.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.053+0000 7fe009600640 1 -- 172.21.15.47:0/174532328 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe004001f40 con 0x7fe00c09cd30 2024-05-27T10:52:27.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.053+0000 7fe011e00640 1 -- 172.21.15.47:0/174532328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe00c14f630 con 0x7fe00c09cd30 2024-05-27T10:52:27.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.054+0000 7fe011e00640 1 -- 172.21.15.47:0/174532328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe00c04fce0 con 0x7fe00c09cd30 2024-05-27T10:52:27.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.055+0000 7fe009600640 1 -- 172.21.15.47:0/174532328 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe004034670 con 0x7fe00c09cd30 2024-05-27T10:52:27.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.056+0000 7fe009600640 1 --2- 172.21.15.47:0/174532328 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdfe806c8f0 0x7fdfe806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:27.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.057+0000 7fe009600640 1 -- 172.21.15.47:0/174532328 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe0040ac3e0 con 0x7fe00c09cd30 2024-05-27T10:52:27.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.057+0000 7fe010a00640 1 --2- 172.21.15.47:0/174532328 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdfe806c8f0 0x7fdfe806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:27.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.057+0000 7fe010a00640 1 --2- 172.21.15.47:0/174532328 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdfe806c8f0 0x7fdfe806edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdff4009a10 tx=0x7fdff4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:27.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.061+0000 7fe009600640 1 -- 172.21.15.47:0/174532328 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe00407a6e0 con 0x7fe00c09cd30 2024-05-27T10:52:27.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.314+0000 7fe011e00640 1 -- 172.21.15.47:0/174532328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe00c0b6ba0 con 0x7fe00c09cd30 2024-05-27T10:52:27.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.315+0000 7fe009600640 1 -- 172.21.15.47:0/174532328 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fe004079fe0 con 0x7fe00c09cd30 2024-05-27T10:52:27.312 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-27T10:52:27.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.317+0000 7fe011e00640 1 -- 172.21.15.47:0/174532328 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdfe806c8f0 msgr2=0x7fdfe806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:27.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.317+0000 7fe011e00640 1 --2- 172.21.15.47:0/174532328 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdfe806c8f0 0x7fdfe806edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdff4009a10 tx=0x7fdff4008040 comp rx=0 tx=0).stop 2024-05-27T10:52:27.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.317+0000 7fe011e00640 1 -- 172.21.15.47:0/174532328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe00c09cd30 msgr2=0x7fe00c150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.317+0000 7fe011e00640 1 --2- 172.21.15.47:0/174532328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe00c09cd30 0x7fe00c150c10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe00400a7a0 tx=0x7fe004001cf0 comp rx=0 tx=0).stop 2024-05-27T10:52:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.317+0000 7fe011e00640 1 -- 172.21.15.47:0/174532328 shutdown_connections 2024-05-27T10:52:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.317+0000 7fe011e00640 1 --2- 172.21.15.47:0/174532328 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdfe806c8f0 0x7fdfe806edb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.317+0000 7fe011e00640 1 --2- 172.21.15.47:0/174532328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe00c09cd30 0x7fe00c150c10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.318+0000 7fe011e00640 1 --2- 172.21.15.47:0/174532328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe00c09b3d0 0x7fe00c09ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.318+0000 7fe011e00640 1 --2- 172.21.15.47:0/174532328 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdfec004d40 0x7fe00c1517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.318+0000 7fe011e00640 1 -- 172.21.15.47:0/174532328 >> 172.21.15.47:0/174532328 conn(0x7fe00c0b6790 msgr2=0x7fe00c06f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.318+0000 7fe011e00640 1 -- 172.21.15.47:0/174532328 shutdown_connections 2024-05-27T10:52:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:27.318+0000 7fe011e00640 1 -- 172.21.15.47:0/174532328 wait complete. 2024-05-27T10:52:27.336 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-27T10:52:27.336 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T10:52:27.336 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2024-05-27T10:52:27.336 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-27T10:52:27.336 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-27T10:52:27.336 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-27T10:52:27.337 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T10:52:27.337 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T10:52:27.337 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-27T10:52:27.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:27.337 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2024-05-27T10:52:27.398 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T10:52:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T10:52:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T10:52:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-05-27T10:52:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:27.398 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T10:52:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2024-05-27T10:52:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2024-05-27T10:52:27.399 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T10:52:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2024-05-27T10:52:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2024-05-27T10:52:27.399 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T10:52:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2024-05-27T10:52:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2024-05-27T10:52:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-27T10:52:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42557sec preferred_lft 42557sec 2024-05-27T10:52:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link noprefixroute 2024-05-27T10:52:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:27.399 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T10:52:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2024-05-27T10:52:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2024-05-27T10:52:27.400 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-27T10:52:27.401 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T10:52:27.401 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-05-27T10:52:27.401 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add name ceph-brx type bridge 2024-05-27T10:52:27.401 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr flush dev ceph-brx 2024-05-27T10:52:27.401 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set ceph-brx up 2024-05-27T10:52:27.401 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-27T10:52:27.401 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-05-27T10:52:27.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:52:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T10:52:27.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:52:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:27.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:27.895 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T10:52:27.962 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-05-27T10:52:27.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:27.965 DEBUG:teuthology.orchestra.run.smithi053:> route 2024-05-27T10:52:28.023 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2024-05-27T10:52:28.024 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T10:52:28.024 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-27T10:52:28.024 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-27T10:52:28.024 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T10:52:28.025 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T10:52:28.025 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-05-27T10:52:28.025 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-27T10:52:28.025 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-27T10:52:28.025 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-27T10:52:28.025 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-05-27T10:52:28.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:52:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T10:52:28.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:52:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:28.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:28.746 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-05-27T10:52:28.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:28.798 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list-id 2024-05-27T10:52:28.848 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T10:52:28.849 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-05-27T10:52:28.849 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T10:52:28.849 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-27T10:52:28.849 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-05-27T10:52:28.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:52:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T10:52:29.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:52:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:29.033 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-27T10:52:29.033 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T10:52:29.033 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-05-27T10:52:29.034 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-27T10:52:29.034 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-27T10:52:29.034 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-27T10:52:29.034 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-27T10:52:29.034 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-27T10:52:29.035 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-05-27T10:52:29.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:52:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T10:52:29.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:52:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:29.333 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T10:52:29.333 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-05-27T10:52:29.333 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2024-05-27T10:52:29.333 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set dev brx.0 master ceph-brx 2024-05-27T10:52:29.334 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-05-27T10:52:29.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:52:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T10:52:29.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:52:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:29.538 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-05-27T10:52:29.538 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T10:52:29.539 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-27T10:52:29.583 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-27T10:52:29.584 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T10:52:29.584 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-27T10:52:29.681 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-05-27T10:52:29.771 DEBUG:teuthology.orchestra.run.smithi053:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T10:52:29.831 INFO:teuthology.orchestra.run.smithi053.stdout:/proc 2024-05-27T10:52:29.832 INFO:teuthology.orchestra.run.smithi053.stdout:/sys 2024-05-27T10:52:29.832 INFO:teuthology.orchestra.run.smithi053.stdout:/dev 2024-05-27T10:52:29.832 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/security 2024-05-27T10:52:29.832 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/shm 2024-05-27T10:52:29.832 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/pts 2024-05-27T10:52:29.832 INFO:teuthology.orchestra.run.smithi053.stdout:/run 2024-05-27T10:52:29.832 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/cgroup 2024-05-27T10:52:29.832 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/pstore 2024-05-27T10:52:29.832 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/bpf 2024-05-27T10:52:29.832 INFO:teuthology.orchestra.run.smithi053.stdout:/ 2024-05-27T10:52:29.832 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/selinux 2024-05-27T10:52:29.832 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T10:52:29.832 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/mqueue 2024-05-27T10:52:29.832 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/debug 2024-05-27T10:52:29.833 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/hugepages 2024-05-27T10:52:29.833 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/tracing 2024-05-27T10:52:29.833 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/fuse/connections 2024-05-27T10:52:29.833 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/config 2024-05-27T10:52:29.833 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysctl.service 2024-05-27T10:52:29.833 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-27T10:52:29.833 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-27T10:52:29.833 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/nfs/rpc_pipefs 2024-05-27T10:52:29.833 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/1000 2024-05-27T10:52:29.833 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph 2024-05-27T10:52:29.833 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-4 2024-05-27T10:52:29.833 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-5 2024-05-27T10:52:29.833 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-6 2024-05-27T10:52:29.833 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-7 2024-05-27T10:52:29.834 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns 2024-05-27T10:52:29.834 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T10:52:29.834 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T10:52:29.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:29.835 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-05-27T10:52:29.892 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-27T10:52:29.892 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-05-27T10:52:29.902 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-05-27T10:52:29.967 DEBUG:teuthology.orchestra.run.smithi053:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T10:52:30.010 INFO:teuthology.orchestra.run.smithi053.stdout:/proc 2024-05-27T10:52:30.010 INFO:teuthology.orchestra.run.smithi053.stdout:/sys 2024-05-27T10:52:30.010 INFO:teuthology.orchestra.run.smithi053.stdout:/dev 2024-05-27T10:52:30.010 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/security 2024-05-27T10:52:30.010 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/shm 2024-05-27T10:52:30.010 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/pts 2024-05-27T10:52:30.010 INFO:teuthology.orchestra.run.smithi053.stdout:/run 2024-05-27T10:52:30.010 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/cgroup 2024-05-27T10:52:30.011 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/pstore 2024-05-27T10:52:30.011 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/bpf 2024-05-27T10:52:30.011 INFO:teuthology.orchestra.run.smithi053.stdout:/ 2024-05-27T10:52:30.011 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/selinux 2024-05-27T10:52:30.011 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T10:52:30.011 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/mqueue 2024-05-27T10:52:30.011 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/debug 2024-05-27T10:52:30.011 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/hugepages 2024-05-27T10:52:30.011 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/tracing 2024-05-27T10:52:30.011 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/fuse/connections 2024-05-27T10:52:30.011 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/config 2024-05-27T10:52:30.011 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysctl.service 2024-05-27T10:52:30.011 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-27T10:52:30.011 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-27T10:52:30.012 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/nfs/rpc_pipefs 2024-05-27T10:52:30.012 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/1000 2024-05-27T10:52:30.012 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph 2024-05-27T10:52:30.012 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-4 2024-05-27T10:52:30.012 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-5 2024-05-27T10:52:30.012 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-6 2024-05-27T10:52:30.012 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-7 2024-05-27T10:52:30.012 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns 2024-05-27T10:52:30.012 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T10:52:30.012 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T10:52:30.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:30.013 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-05-27T10:52:30.076 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi053.stderr:2024-05-27T10:52:30.079+0000 7f6816d1d480 -1 init, newargv = 0x55eeffea6a20 newargc=15 2024-05-27T10:52:30.077 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi053.stderr:ceph-fuse[41626]: starting ceph client 2024-05-27T10:52:30.088 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi053.stderr:ceph-fuse[41626]: starting fuse 2024-05-27T10:52:30.101 INFO:teuthology.orchestra.run.smithi053.stdout:42 2024-05-27T10:52:30.101 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-05-27T10:52:30.101 DEBUG:teuthology.orchestra.run.smithi053:> sudo stdin-killer -- python3 -c ' 2024-05-27T10:52:30.101 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2024-05-27T10:52:30.101 DEBUG:teuthology.orchestra.run.smithi053:> import re 2024-05-27T10:52:30.101 DEBUG:teuthology.orchestra.run.smithi053:> import os 2024-05-27T10:52:30.101 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2024-05-27T10:52:30.101 DEBUG:teuthology.orchestra.run.smithi053:> 2024-05-27T10:52:30.102 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2024-05-27T10:52:30.102 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-05-27T10:52:30.102 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2024-05-27T10:52:30.102 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-05-27T10:52:30.102 DEBUG:teuthology.orchestra.run.smithi053:> 2024-05-27T10:52:30.102 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2024-05-27T10:52:30.102 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2024-05-27T10:52:30.102 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2024-05-27T10:52:30.102 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2024-05-27T10:52:30.102 DEBUG:teuthology.orchestra.run.smithi053:> 2024-05-27T10:52:30.102 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2024-05-27T10:52:30.102 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-27T10:52:30.102 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-27T10:52:30.102 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-27T10:52:30.102 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2024-05-27T10:52:30.103 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2024-05-27T10:52:30.103 DEBUG:teuthology.orchestra.run.smithi053:> return f 2024-05-27T10:52:30.103 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-27T10:52:30.103 DEBUG:teuthology.orchestra.run.smithi053:> 2024-05-27T10:52:30.103 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.1")) 2024-05-27T10:52:30.103 DEBUG:teuthology.orchestra.run.smithi053:> ' 2024-05-27T10:52:30.306 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.1.41626.asok 2024-05-27T10:52:30.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:52:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:30.324 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.41626.asok 2024-05-27T10:52:30.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:30.325 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.41626.asok status 2024-05-27T10:52:30.564 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-05-27T10:52:30.564 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2024-05-27T10:52:30.564 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "81797d879079e1a392b37a9c23a946594f658c50", 2024-05-27T10:52:30.564 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 19.0.0-3154-g81797d87 (81797d879079e1a392b37a9c23a946594f658c50) squid (dev)", 2024-05-27T10:52:30.564 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "1", 2024-05-27T10:52:30.564 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2024-05-27T10:52:30.564 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-05-27T10:52:30.564 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "41626", 2024-05-27T10:52:30.564 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2024-05-27T10:52:30.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-05-27T10:52:30.564 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2024-05-27T10:52:30.565 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2024-05-27T10:52:30.565 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 4582, 2024-05-27T10:52:30.565 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2024-05-27T10:52:30.565 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2024-05-27T10:52:30.565 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2024-05-27T10:52:30.565 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 4582 2024-05-27T10:52:30.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-05-27T10:52:30.565 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-05-27T10:52:30.565 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-05-27T10:52:30.565 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-05-27T10:52:30.565 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 164040930 2024-05-27T10:52:30.565 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-05-27T10:52:30.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-05-27T10:52:30.565 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-05-27T10:52:30.566 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-05-27T10:52:30.566 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-05-27T10:52:30.566 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 164040930 2024-05-27T10:52:30.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-05-27T10:52:30.566 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.4582 192.168.0.1:0/164040930", 2024-05-27T10:52:30.566 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/164040930", 2024-05-27T10:52:30.566 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2024-05-27T10:52:30.566 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 8, 2024-05-27T10:52:30.566 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 20, 2024-05-27T10:52:30.566 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2024-05-27T10:52:30.566 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2024-05-27T10:52:30.566 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2024-05-27T10:52:30.566 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-05-27T10:52:30.579 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T10:52:30.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.801+0000 7f4199a00640 1 Processor -- start 2024-05-27T10:52:30.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.801+0000 7f4199a00640 1 -- start start 2024-05-27T10:52:30.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.802+0000 7f4199a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f419415e7d0 0x7f41940b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:30.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.802+0000 7f4199a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f419415ebb0 con 0x7f41940d0e10 2024-05-27T10:52:30.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.803+0000 7f4199a00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f419406e270 con 0x7f419406dcb0 2024-05-27T10:52:30.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.803+0000 7f4199a00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f419406e550 con 0x7f419415e7d0 2024-05-27T10:52:30.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.803+0000 7f4193400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f41940d0e10 0x7f41940ada50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:50980/0 (socket says 172.21.15.47:50980) 2024-05-27T10:52:30.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.803+0000 7f4193400640 1 -- 172.21.15.47:0/4123238786 learned_addr learned my addr 172.21.15.47:0/4123238786 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:30.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.803+0000 7f4192a00640 1 --2- 172.21.15.47:0/4123238786 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f419415e7d0 0x7f41940b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:30.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.803+0000 7f4191600640 1 -- 172.21.15.47:0/4123238786 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 189052181 0 0) 0x7f418c001110 con 0x7f41940d0e10 2024-05-27T10:52:30.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.804+0000 7f4191600640 1 -- 172.21.15.47:0/4123238786 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4178003520 con 0x7f41940d0e10 2024-05-27T10:52:30.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.804+0000 7f4191600640 1 -- 172.21.15.47:0/4123238786 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1011033252 0 0) 0x7f4178003520 con 0x7f41940d0e10 2024-05-27T10:52:30.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.804+0000 7f4191600640 1 -- 172.21.15.47:0/4123238786 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f419415e7d0 msgr2=0x7f41940b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:30.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.804+0000 7f4191600640 1 --2- 172.21.15.47:0/4123238786 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f419415e7d0 0x7f41940b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:30.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.804+0000 7f4191600640 1 -- 172.21.15.47:0/4123238786 >> v1:172.21.15.53:6789/0 conn(0x7f419406dcb0 legacy=0x7f41940d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:30.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.804+0000 7f4191600640 1 -- 172.21.15.47:0/4123238786 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419406e830 con 0x7f41940d0e10 2024-05-27T10:52:30.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.804+0000 7f4191600640 1 -- 172.21.15.47:0/4123238786 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f418c001840 con 0x7f41940d0e10 2024-05-27T10:52:30.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.804+0000 7f4191600640 1 -- 172.21.15.47:0/4123238786 >> v1:172.21.15.47:6789/0 conn(0x7f41940d0e10 legacy=0x7f41940ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:30.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.804+0000 7f4191600640 1 --2- 172.21.15.47:0/4123238786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41780039e0 0x7f4178003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:30.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.804+0000 7f4191600640 1 --2- 172.21.15.47:0/4123238786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4178004800 0x7f4178004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:30.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.804+0000 7f4191600640 1 --2- 172.21.15.47:0/4123238786 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f419415e7d0 0x7f4178005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:30.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.804+0000 7f4191600640 1 -- 172.21.15.47:0/4123238786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f419406e550 con 0x7f4178004800 2024-05-27T10:52:30.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.804+0000 7f4191600640 1 -- 172.21.15.47:0/4123238786 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f417800baf0 con 0x7f41780039e0 2024-05-27T10:52:30.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.804+0000 7f4191600640 1 -- 172.21.15.47:0/4123238786 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f417800bcf0 con 0x7f419415e7d0 2024-05-27T10:52:30.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.804+0000 7f4192000640 1 --2- 172.21.15.47:0/4123238786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4178004800 0x7f4178004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:30.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.805+0000 7f4192a00640 1 --2- 172.21.15.47:0/4123238786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41780039e0 0x7f4178003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:30.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.805+0000 7f4193400640 1 --2- 172.21.15.47:0/4123238786 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f419415e7d0 0x7f4178005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:30.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.805+0000 7f4192000640 1 -- 172.21.15.47:0/4123238786 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f419415e7d0 msgr2=0x7f4178005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:30.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.805+0000 7f4192000640 1 --2- 172.21.15.47:0/4123238786 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f419415e7d0 0x7f4178005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:30.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.805+0000 7f4192000640 1 -- 172.21.15.47:0/4123238786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41780039e0 msgr2=0x7f4178003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:30.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.805+0000 7f4192000640 1 --2- 172.21.15.47:0/4123238786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41780039e0 0x7f4178003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:30.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.805+0000 7f4192000640 1 -- 172.21.15.47:0/4123238786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4178003520 con 0x7f4178004800 2024-05-27T10:52:30.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.805+0000 7f4193400640 1 --2- 172.21.15.47:0/4123238786 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f419415e7d0 0x7f4178005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:30.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.806+0000 7f4192000640 1 --2- 172.21.15.47:0/4123238786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4178004800 0x7f4178004c80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f417c001750 tx=0x7f4178005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c75e9c990e2a14 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:30.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.806+0000 7f4191600640 1 -- 172.21.15.47:0/4123238786 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c001370 con 0x7f4178004800 2024-05-27T10:52:30.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.806+0000 7f4191600640 1 -- 172.21.15.47:0/4123238786 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c0052d0 con 0x7f4178004800 2024-05-27T10:52:30.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.806+0000 7f4191600640 1 -- 172.21.15.47:0/4123238786 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c02abe0 con 0x7f4178004800 2024-05-27T10:52:30.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.807+0000 7f4199a00640 1 -- 172.21.15.47:0/4123238786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4178004800 msgr2=0x7f4178004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:30.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.807+0000 7f4199a00640 1 --2- 172.21.15.47:0/4123238786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4178004800 0x7f4178004c80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f417c001750 tx=0x7f4178005830 comp rx=0 tx=0).stop 2024-05-27T10:52:30.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.807+0000 7f4193400640 1 -- 172.21.15.47:0/4123238786 reap_dead start 2024-05-27T10:52:30.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.807+0000 7f4199a00640 1 -- 172.21.15.47:0/4123238786 shutdown_connections 2024-05-27T10:52:30.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.807+0000 7f4199a00640 1 -- 172.21.15.47:0/4123238786 >> 172.21.15.47:0/4123238786 conn(0x7f419406bd60 msgr2=0x7f419406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:30.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.807+0000 7f4199a00640 1 -- 172.21.15.47:0/4123238786 shutdown_connections 2024-05-27T10:52:30.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.807+0000 7f4199a00640 1 -- 172.21.15.47:0/4123238786 wait complete. 2024-05-27T10:52:30.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.809+0000 7f4199a00640 1 Processor -- start 2024-05-27T10:52:30.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.809+0000 7f4199a00640 1 -- start start 2024-05-27T10:52:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.810+0000 7f4199a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4178004800 0x7f4194147760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.810+0000 7f4199a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f419414ae50 0x7f4194158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.810+0000 7f4199a00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41941592d0 0x7f4194157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.810+0000 7f4199a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f41940b3ce0 con 0x7f419414ae50 2024-05-27T10:52:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.810+0000 7f4199a00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f41940b3b60 con 0x7f41941592d0 2024-05-27T10:52:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.810+0000 7f4199a00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f41940b3e60 con 0x7f4178004800 2024-05-27T10:52:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.810+0000 7f4192000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f419414ae50 0x7f4194158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.810+0000 7f4192000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f419414ae50 0x7f4194158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37204/0 (socket says 172.21.15.47:37204) 2024-05-27T10:52:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.810+0000 7f4192000640 1 -- 172.21.15.47:0/1027690632 learned_addr learned my addr 172.21.15.47:0/1027690632 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.811+0000 7f4192000640 1 -- 172.21.15.47:0/1027690632 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4178004800 msgr2=0x7f4194147760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.811+0000 7f4192000640 1 --2- 172.21.15.47:0/1027690632 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4178004800 0x7f4194147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.811+0000 7f4192000640 1 -- 172.21.15.47:0/1027690632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41941592d0 msgr2=0x7f4194157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.811+0000 7f4192000640 1 --2- 172.21.15.47:0/1027690632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41941592d0 0x7f4194157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:30.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.811+0000 7f4192000640 1 -- 172.21.15.47:0/1027690632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4194149db0 con 0x7f419414ae50 2024-05-27T10:52:30.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.811+0000 7f4192000640 1 --2- 172.21.15.47:0/1027690632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f419414ae50 0x7f4194158d90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f417c008fd0 tx=0x7f417c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:30.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.811+0000 7f418aa00640 1 -- 172.21.15.47:0/1027690632 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c037040 con 0x7f419414ae50 2024-05-27T10:52:30.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.811+0000 7f418aa00640 1 -- 172.21.15.47:0/1027690632 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c005480 con 0x7f419414ae50 2024-05-27T10:52:30.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.811+0000 7f418aa00640 1 -- 172.21.15.47:0/1027690632 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c007a30 con 0x7f419414ae50 2024-05-27T10:52:30.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.811+0000 7f4199a00640 1 -- 172.21.15.47:0/1027690632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f419414a090 con 0x7f419414ae50 2024-05-27T10:52:30.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.812+0000 7f4199a00640 1 -- 172.21.15.47:0/1027690632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f419414a650 con 0x7f419414ae50 2024-05-27T10:52:30.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.813+0000 7f4199a00640 1 -- 172.21.15.47:0/1027690632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41941596f0 con 0x7f419414ae50 2024-05-27T10:52:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.814+0000 7f418aa00640 1 -- 172.21.15.47:0/1027690632 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f417c044020 con 0x7f419414ae50 2024-05-27T10:52:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.815+0000 7f418aa00640 1 --2- 172.21.15.47:0/1027690632 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f417006c920 0x7f417006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.815+0000 7f418aa00640 1 -- 172.21.15.47:0/1027690632 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f417c0ab880 con 0x7f419414ae50 2024-05-27T10:52:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.815+0000 7f4192a00640 1 --2- 172.21.15.47:0/1027690632 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f417006c920 0x7f417006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:30.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.816+0000 7f4192a00640 1 --2- 172.21.15.47:0/1027690632 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f417006c920 0x7f417006ede0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f41840042d0 tx=0x7f4184003990 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:30.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:30.819+0000 7f418aa00640 1 -- 172.21.15.47:0/1027690632 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f417c079c10 con 0x7f419414ae50 2024-05-27T10:52:31.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:31.061+0000 7f4199a00640 1 -- 172.21.15.47:0/1027690632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f41940689e0 con 0x7f419414ae50 2024-05-27T10:52:31.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:31.062+0000 7f418aa00640 1 -- 172.21.15.47:0/1027690632 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f417c079510 con 0x7f419414ae50 2024-05-27T10:52:31.060 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-27T10:52:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:31.064+0000 7f4199a00640 1 -- 172.21.15.47:0/1027690632 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f417006c920 msgr2=0x7f417006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:31.064+0000 7f4199a00640 1 --2- 172.21.15.47:0/1027690632 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f417006c920 0x7f417006ede0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f41840042d0 tx=0x7f4184003990 comp rx=0 tx=0).stop 2024-05-27T10:52:31.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:31.064+0000 7f4199a00640 1 -- 172.21.15.47:0/1027690632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f419414ae50 msgr2=0x7f4194158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:31.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:31.064+0000 7f4199a00640 1 --2- 172.21.15.47:0/1027690632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f419414ae50 0x7f4194158d90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f417c008fd0 tx=0x7f417c001120 comp rx=0 tx=0).stop 2024-05-27T10:52:31.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:31.065+0000 7f4199a00640 1 -- 172.21.15.47:0/1027690632 shutdown_connections 2024-05-27T10:52:31.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:31.065+0000 7f4199a00640 1 --2- 172.21.15.47:0/1027690632 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f417006c920 0x7f417006ede0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:31.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:31.065+0000 7f4199a00640 1 --2- 172.21.15.47:0/1027690632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41941592d0 0x7f4194157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:31.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:31.065+0000 7f4199a00640 1 --2- 172.21.15.47:0/1027690632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f419414ae50 0x7f4194158d90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:31.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:31.065+0000 7f4199a00640 1 --2- 172.21.15.47:0/1027690632 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4178004800 0x7f4194147760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:31.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:31.065+0000 7f4199a00640 1 -- 172.21.15.47:0/1027690632 >> 172.21.15.47:0/1027690632 conn(0x7f419406bd60 msgr2=0x7f41940b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:31.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:31.065+0000 7f4199a00640 1 -- 172.21.15.47:0/1027690632 shutdown_connections 2024-05-27T10:52:31.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:31.065+0000 7f4199a00640 1 -- 172.21.15.47:0/1027690632 wait complete. 2024-05-27T10:52:31.081 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-27T10:52:31.081 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T10:52:31.081 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2024-05-27T10:52:31.081 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-27T10:52:31.081 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-27T10:52:31.081 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-27T10:52:31.081 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T10:52:31.081 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T10:52:31.081 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-27T10:52:31.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:31.081 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2024-05-27T10:52:31.142 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T10:52:31.142 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T10:52:31.142 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T10:52:31.142 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:31.142 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-05-27T10:52:31.142 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:31.142 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T10:52:31.142 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2024-05-27T10:52:31.142 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2024-05-27T10:52:31.143 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T10:52:31.143 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2024-05-27T10:52:31.143 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2024-05-27T10:52:31.143 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T10:52:31.143 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2024-05-27T10:52:31.143 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2024-05-27T10:52:31.143 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-27T10:52:31.143 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42554sec preferred_lft 42554sec 2024-05-27T10:52:31.143 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link noprefixroute 2024-05-27T10:52:31.143 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:31.143 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T10:52:31.143 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2024-05-27T10:52:31.143 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2024-05-27T10:52:31.143 INFO:teuthology.orchestra.run.smithi053.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T10:52:31.144 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 86:9e:4f:31:c9:5d brd ff:ff:ff:ff:ff:ff 2024-05-27T10:52:31.144 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-27T10:52:31.144 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:31.144 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::2010:85ff:fe60:1813/64 scope link 2024-05-27T10:52:31.144 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:31.144 INFO:teuthology.orchestra.run.smithi053.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T10:52:31.144 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 86:9e:4f:31:c9:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T10:52:31.144 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::849e:4fff:fe31:c95d/64 scope link 2024-05-27T10:52:31.144 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:31.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:31.145 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T10:52:31.149 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T10:52:31.156 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T10:52:31.233 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-05-27T10:52:31.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:31.237 DEBUG:teuthology.orchestra.run.smithi053:> route 2024-05-27T10:52:31.336 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2024-05-27T10:52:31.336 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T10:52:31.336 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-27T10:52:31.336 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-27T10:52:31.336 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T10:52:31.337 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T10:52:31.337 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-05-27T10:52:31.337 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-27T10:52:31.337 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-27T10:52:31.337 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-27T10:52:31.337 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-05-27T10:52:31.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:52:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T10:52:31.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:52:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:31.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:31.606 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-05-27T10:52:31.655 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-27T10:52:31.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:31.656 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list-id 2024-05-27T10:52:31.754 INFO:teuthology.orchestra.run.smithi053.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-27T10:52:31.755 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T10:52:31.755 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-05-27T10:52:31.755 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-27T10:52:31.755 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-27T10:52:31.755 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-05-27T10:52:31.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:52:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T10:52:31.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:52:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:31.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:31.951 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-27T10:52:32.031 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T10:52:32.031 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T10:52:32.031 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T10:52:32.031 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:32.031 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-05-27T10:52:32.032 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:32.032 INFO:teuthology.orchestra.run.smithi053.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T10:52:32.032 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 32:67:0e:89:3a:2f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-27T10:52:32.032 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-27T10:52:32.032 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:32.032 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::3067:eff:fe89:3a2f/64 scope link 2024-05-27T10:52:32.032 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:32.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:32.036 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-27T10:52:32.124 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T10:52:32.124 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T10:52:32.124 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T10:52:32.124 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:32.124 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-05-27T10:52:32.124 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:32.124 INFO:teuthology.orchestra.run.smithi053.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T10:52:32.124 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 32:67:0e:89:3a:2f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-27T10:52:32.124 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-27T10:52:32.124 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:32.124 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::3067:eff:fe89:3a2f/64 scope link 2024-05-27T10:52:32.125 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:52:32.128 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-27T10:52:32.128 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T10:52:32.128 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-05-27T10:52:32.128 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-27T10:52:32.128 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-27T10:52:32.129 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-27T10:52:32.129 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-27T10:52:32.129 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-27T10:52:32.129 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-05-27T10:52:32.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:52:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T10:52:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:52:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:32.429 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T10:52:32.429 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-05-27T10:52:32.429 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.1 up 2024-05-27T10:52:32.429 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set dev brx.1 master ceph-brx 2024-05-27T10:52:32.429 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-05-27T10:52:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:52:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T10:52:32.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:52:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:32.648 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-05-27T10:52:32.648 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T10:52:32.649 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-27T10:52:32.702 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-27T10:52:32.702 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T10:52:32.703 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-27T10:52:32.755 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-05-27T10:52:32.833 DEBUG:teuthology.orchestra.run.smithi053:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T10:52:32.889 INFO:teuthology.orchestra.run.smithi053.stdout:/proc 2024-05-27T10:52:32.889 INFO:teuthology.orchestra.run.smithi053.stdout:/sys 2024-05-27T10:52:32.890 INFO:teuthology.orchestra.run.smithi053.stdout:/dev 2024-05-27T10:52:32.890 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/security 2024-05-27T10:52:32.890 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/shm 2024-05-27T10:52:32.890 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/pts 2024-05-27T10:52:32.890 INFO:teuthology.orchestra.run.smithi053.stdout:/run 2024-05-27T10:52:32.890 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/cgroup 2024-05-27T10:52:32.890 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/pstore 2024-05-27T10:52:32.890 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/bpf 2024-05-27T10:52:32.890 INFO:teuthology.orchestra.run.smithi053.stdout:/ 2024-05-27T10:52:32.890 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/selinux 2024-05-27T10:52:32.890 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T10:52:32.890 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/mqueue 2024-05-27T10:52:32.891 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/debug 2024-05-27T10:52:32.891 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/hugepages 2024-05-27T10:52:32.891 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/tracing 2024-05-27T10:52:32.891 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/fuse/connections 2024-05-27T10:52:32.891 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/config 2024-05-27T10:52:32.891 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysctl.service 2024-05-27T10:52:32.891 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-27T10:52:32.891 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-27T10:52:32.891 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/nfs/rpc_pipefs 2024-05-27T10:52:32.891 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/1000 2024-05-27T10:52:32.891 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph 2024-05-27T10:52:32.891 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-4 2024-05-27T10:52:32.891 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-5 2024-05-27T10:52:32.892 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-6 2024-05-27T10:52:32.892 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-7 2024-05-27T10:52:32.892 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns 2024-05-27T10:52:32.892 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T10:52:32.892 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T10:52:32.892 INFO:teuthology.orchestra.run.smithi053.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-27T10:52:32.892 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-27T10:52:32.892 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-27T10:52:32.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:32.893 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-05-27T10:52:32.950 INFO:teuthology.orchestra.run.smithi053.stdout:42 2024-05-27T10:52:32.951 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2024-05-27T10:52:32.951 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-05-27T10:52:32.957 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-05-27T10:52:33.034 DEBUG:teuthology.orchestra.run.smithi053:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T10:52:33.078 INFO:teuthology.orchestra.run.smithi053.stdout:/proc 2024-05-27T10:52:33.079 INFO:teuthology.orchestra.run.smithi053.stdout:/sys 2024-05-27T10:52:33.079 INFO:teuthology.orchestra.run.smithi053.stdout:/dev 2024-05-27T10:52:33.079 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/security 2024-05-27T10:52:33.079 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/shm 2024-05-27T10:52:33.079 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/pts 2024-05-27T10:52:33.079 INFO:teuthology.orchestra.run.smithi053.stdout:/run 2024-05-27T10:52:33.079 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/cgroup 2024-05-27T10:52:33.079 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/pstore 2024-05-27T10:52:33.079 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/bpf 2024-05-27T10:52:33.079 INFO:teuthology.orchestra.run.smithi053.stdout:/ 2024-05-27T10:52:33.079 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/selinux 2024-05-27T10:52:33.079 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T10:52:33.080 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/mqueue 2024-05-27T10:52:33.080 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/debug 2024-05-27T10:52:33.080 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/hugepages 2024-05-27T10:52:33.080 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/tracing 2024-05-27T10:52:33.080 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/fuse/connections 2024-05-27T10:52:33.080 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/config 2024-05-27T10:52:33.080 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysctl.service 2024-05-27T10:52:33.080 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-27T10:52:33.080 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-27T10:52:33.080 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/nfs/rpc_pipefs 2024-05-27T10:52:33.080 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/1000 2024-05-27T10:52:33.080 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph 2024-05-27T10:52:33.080 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-4 2024-05-27T10:52:33.081 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-5 2024-05-27T10:52:33.081 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-6 2024-05-27T10:52:33.081 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph/osd/ceph-7 2024-05-27T10:52:33.081 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns 2024-05-27T10:52:33.081 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T10:52:33.081 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T10:52:33.081 INFO:teuthology.orchestra.run.smithi053.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-27T10:52:33.081 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-27T10:52:33.081 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-27T10:52:33.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:33.082 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-05-27T10:52:33.137 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi053.stderr:2024-05-27T10:52:33.140+0000 7fa99f329480 -1 init, newargv = 0x555bc60d04d0 newargc=15 2024-05-27T10:52:33.137 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi053.stderr:ceph-fuse[42100]: starting ceph client 2024-05-27T10:52:33.146 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi053.stderr:ceph-fuse[42100]: starting fuse 2024-05-27T10:52:33.167 INFO:teuthology.orchestra.run.smithi053.stdout:42 2024-05-27T10:52:33.167 INFO:teuthology.orchestra.run.smithi053.stdout:43 2024-05-27T10:52:33.167 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 43] 2024-05-27T10:52:33.168 DEBUG:teuthology.orchestra.run.smithi053:> sudo stdin-killer -- python3 -c ' 2024-05-27T10:52:33.168 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2024-05-27T10:52:33.168 DEBUG:teuthology.orchestra.run.smithi053:> import re 2024-05-27T10:52:33.168 DEBUG:teuthology.orchestra.run.smithi053:> import os 2024-05-27T10:52:33.168 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2024-05-27T10:52:33.168 DEBUG:teuthology.orchestra.run.smithi053:> 2024-05-27T10:52:33.168 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2024-05-27T10:52:33.168 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-05-27T10:52:33.168 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2024-05-27T10:52:33.168 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-05-27T10:52:33.168 DEBUG:teuthology.orchestra.run.smithi053:> 2024-05-27T10:52:33.168 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2024-05-27T10:52:33.168 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2024-05-27T10:52:33.169 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2024-05-27T10:52:33.169 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2024-05-27T10:52:33.169 DEBUG:teuthology.orchestra.run.smithi053:> 2024-05-27T10:52:33.169 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2024-05-27T10:52:33.169 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-27T10:52:33.169 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-27T10:52:33.169 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-27T10:52:33.169 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2024-05-27T10:52:33.169 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2024-05-27T10:52:33.169 DEBUG:teuthology.orchestra.run.smithi053:> return f 2024-05-27T10:52:33.169 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-27T10:52:33.169 DEBUG:teuthology.orchestra.run.smithi053:> 2024-05-27T10:52:33.169 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.3")) 2024-05-27T10:52:33.170 DEBUG:teuthology.orchestra.run.smithi053:> ' 2024-05-27T10:52:33.370 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.3.42100.asok 2024-05-27T10:52:33.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-27T10:52:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:52:33.388 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.42100.asok 2024-05-27T10:52:33.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:33.388 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.42100.asok status 2024-05-27T10:52:33.626 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-05-27T10:52:33.626 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2024-05-27T10:52:33.626 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "81797d879079e1a392b37a9c23a946594f658c50", 2024-05-27T10:52:33.626 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 19.0.0-3154-g81797d87 (81797d879079e1a392b37a9c23a946594f658c50) squid (dev)", 2024-05-27T10:52:33.626 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "3", 2024-05-27T10:52:33.626 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2024-05-27T10:52:33.626 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-05-27T10:52:33.627 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "42100", 2024-05-27T10:52:33.627 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2024-05-27T10:52:33.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-05-27T10:52:33.627 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2024-05-27T10:52:33.627 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2024-05-27T10:52:33.627 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 4466, 2024-05-27T10:52:33.627 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2024-05-27T10:52:33.627 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2024-05-27T10:52:33.628 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2024-05-27T10:52:33.628 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 4466 2024-05-27T10:52:33.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-05-27T10:52:33.628 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-05-27T10:52:33.628 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-05-27T10:52:33.628 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:0", 2024-05-27T10:52:33.628 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1858546588 2024-05-27T10:52:33.628 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-05-27T10:52:33.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-05-27T10:52:33.628 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-05-27T10:52:33.628 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-05-27T10:52:33.628 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:0", 2024-05-27T10:52:33.628 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1858546588 2024-05-27T10:52:33.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-05-27T10:52:33.629 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.4466 172.21.15.53:0/1858546588", 2024-05-27T10:52:33.629 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "172.21.15.53:0/1858546588", 2024-05-27T10:52:33.629 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2024-05-27T10:52:33.629 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 8, 2024-05-27T10:52:33.629 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 20, 2024-05-27T10:52:33.629 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2024-05-27T10:52:33.629 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2024-05-27T10:52:33.629 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2024-05-27T10:52:33.629 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-05-27T10:52:33.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:33.641 DEBUG:teuthology.orchestra.run.smithi047:> stat --file-system '--printf=%T 2024-05-27T10:52:33.641 DEBUG:teuthology.orchestra.run.smithi047:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-27T10:52:33.704 INFO:teuthology.orchestra.run.smithi047.stdout:fuseblk 2024-05-27T10:52:33.704 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-27T10:52:33.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:33.704 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-27T10:52:33.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:33.799 DEBUG:teuthology.orchestra.run.smithi047:> stat --file-system '--printf=%T 2024-05-27T10:52:33.799 DEBUG:teuthology.orchestra.run.smithi047:> ' -- /home/ubuntu/cephtest/mnt.2 2024-05-27T10:52:33.858 INFO:teuthology.orchestra.run.smithi047.stdout:fuseblk 2024-05-27T10:52:33.859 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-05-27T10:52:33.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:33.859 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-27T10:52:33.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:33.960 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2024-05-27T10:52:33.961 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.1 2024-05-27T10:52:34.023 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2024-05-27T10:52:34.024 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-05-27T10:52:34.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:34.024 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-27T10:52:34.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:34.116 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2024-05-27T10:52:34.116 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.3 2024-05-27T10:52:34.174 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2024-05-27T10:52:34.174 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-05-27T10:52:34.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:34.175 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-27T10:52:34.269 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-27T10:52:34.529 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:52:34.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.751+0000 7f568e200640 1 Processor -- start 2024-05-27T10:52:34.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.752+0000 7f568e200640 1 -- start start 2024-05-27T10:52:34.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.753+0000 7f568e200640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f568815e7d0 0x7f56880b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:34.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.753+0000 7f568e200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f568806dcb0 0x7f56880d0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:34.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.753+0000 7f568e200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f56880d0c40 0x7f56880721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:34.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.753+0000 7f568e200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f568815ebb0 con 0x7f568806dcb0 2024-05-27T10:52:34.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.753+0000 7f568e200640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f568806e270 con 0x7f568815e7d0 2024-05-27T10:52:34.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.753+0000 7f568e200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f568806e550 con 0x7f56880d0c40 2024-05-27T10:52:34.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.754+0000 7f5686a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f568806dcb0 0x7f56880d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:34.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.754+0000 7f5686a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f568806dcb0 0x7f56880d0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37208/0 (socket says 172.21.15.47:37208) 2024-05-27T10:52:34.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.754+0000 7f5686a00640 1 -- 172.21.15.47:0/524408316 learned_addr learned my addr 172.21.15.47:0/524408316 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:34.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.754+0000 7f5687400640 1 --2- 172.21.15.47:0/524408316 >> v2:172.21.15.53:3300/0 conn(0x7f568815e7d0 0x7f56880b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:34.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.754+0000 7f5687e00640 1 --2- 172.21.15.47:0/524408316 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f56880d0c40 0x7f56880721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:34.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.754+0000 7f5686a00640 1 -- 172.21.15.47:0/524408316 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f56880d0c40 msgr2=0x7f56880721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:34.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.754+0000 7f5686a00640 1 --2- 172.21.15.47:0/524408316 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f56880d0c40 0x7f56880721a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:34.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.754+0000 7f5686a00640 1 -- 172.21.15.47:0/524408316 >> v2:172.21.15.53:3300/0 conn(0x7f568815e7d0 msgr2=0x7f56880b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:34.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.754+0000 7f5686a00640 1 --2- 172.21.15.47:0/524408316 >> v2:172.21.15.53:3300/0 conn(0x7f568815e7d0 0x7f56880b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:34.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.754+0000 7f5686a00640 1 -- 172.21.15.47:0/524408316 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f568806e830 con 0x7f568806dcb0 2024-05-27T10:52:34.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.756+0000 7f5686a00640 1 --2- 172.21.15.47:0/524408316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f568806dcb0 0x7f56880d0700 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f568806a580 tx=0x7f567402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14bee66a2f177138 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:34.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.756+0000 7f5686000640 1 -- 172.21.15.47:0/524408316 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5674037070 con 0x7f568806dcb0 2024-05-27T10:52:34.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.756+0000 7f5686000640 1 -- 172.21.15.47:0/524408316 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5674032440 con 0x7f568806dcb0 2024-05-27T10:52:34.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.756+0000 7f5686000640 1 -- 172.21.15.47:0/524408316 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5674032810 con 0x7f568806dcb0 2024-05-27T10:52:34.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.757+0000 7f568e200640 1 -- 172.21.15.47:0/524408316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f568806dcb0 msgr2=0x7f56880d0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:34.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.757+0000 7f568e200640 1 --2- 172.21.15.47:0/524408316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f568806dcb0 0x7f56880d0700 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f568806a580 tx=0x7f567402a1e0 comp rx=0 tx=0).stop 2024-05-27T10:52:34.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.757+0000 7f568e200640 1 -- 172.21.15.47:0/524408316 shutdown_connections 2024-05-27T10:52:34.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.757+0000 7f568e200640 1 --2- 172.21.15.47:0/524408316 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f56880d0c40 0x7f56880721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:34.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.757+0000 7f568e200640 1 --2- 172.21.15.47:0/524408316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f568806dcb0 0x7f56880d0700 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:34.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.757+0000 7f568e200640 1 --2- 172.21.15.47:0/524408316 >> v2:172.21.15.53:3300/0 conn(0x7f568815e7d0 0x7f56880b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:34.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.757+0000 7f568e200640 1 -- 172.21.15.47:0/524408316 >> 172.21.15.47:0/524408316 conn(0x7f568806bd60 msgr2=0x7f568806c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:34.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.757+0000 7f568e200640 1 -- 172.21.15.47:0/524408316 shutdown_connections 2024-05-27T10:52:34.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.757+0000 7f568e200640 1 -- 172.21.15.47:0/524408316 wait complete. 2024-05-27T10:52:34.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.759+0000 7f568e200640 1 Processor -- start 2024-05-27T10:52:34.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.759+0000 7f568e200640 1 -- start start 2024-05-27T10:52:34.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.760+0000 7f568e200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f568806dcb0 0x7f568814aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:34.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.760+0000 7f568e200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f56880d0c40 0x7f568809acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:34.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.760+0000 7f568e200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f568815e7d0 0x7f568809c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:34.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.760+0000 7f568e200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f56880726e0 con 0x7f568806dcb0 2024-05-27T10:52:34.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.760+0000 7f568e200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f56880b40a0 con 0x7f568815e7d0 2024-05-27T10:52:34.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.760+0000 7f568e200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5688072860 con 0x7f56880d0c40 2024-05-27T10:52:34.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.761+0000 7f5687400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f568806dcb0 0x7f568814aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:34.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.761+0000 7f5687400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f568806dcb0 0x7f568814aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37210/0 (socket says 172.21.15.47:37210) 2024-05-27T10:52:34.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.761+0000 7f5687400640 1 -- 172.21.15.47:0/3854535988 learned_addr learned my addr 172.21.15.47:0/3854535988 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:34.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.761+0000 7f5686a00640 1 --2- 172.21.15.47:0/3854535988 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f56880d0c40 0x7f568809acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:34.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.761+0000 7f5687e00640 1 --2- 172.21.15.47:0/3854535988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f568815e7d0 0x7f568809c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:34.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.761+0000 7f5687400640 1 -- 172.21.15.47:0/3854535988 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f56880d0c40 msgr2=0x7f568809acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:34.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.761+0000 7f5687400640 1 --2- 172.21.15.47:0/3854535988 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f56880d0c40 0x7f568809acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:34.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.761+0000 7f5687400640 1 -- 172.21.15.47:0/3854535988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f568815e7d0 msgr2=0x7f568809c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:34.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.761+0000 7f5687400640 1 --2- 172.21.15.47:0/3854535988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f568815e7d0 0x7f568809c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:34.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.761+0000 7f5687400640 1 -- 172.21.15.47:0/3854535988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56881e7ad0 con 0x7f568806dcb0 2024-05-27T10:52:34.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.762+0000 7f5687400640 1 --2- 172.21.15.47:0/3854535988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f568806dcb0 0x7f568814aab0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5678007e70 tx=0x7f567800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:34.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.762+0000 7f567f400640 1 -- 172.21.15.47:0/3854535988 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678014620 con 0x7f568806dcb0 2024-05-27T10:52:34.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.762+0000 7f567f400640 1 -- 172.21.15.47:0/3854535988 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5678019070 con 0x7f568806dcb0 2024-05-27T10:52:34.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.762+0000 7f567f400640 1 -- 172.21.15.47:0/3854535988 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678014a00 con 0x7f568806dcb0 2024-05-27T10:52:34.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.762+0000 7f568e200640 1 -- 172.21.15.47:0/3854535988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f568814b8a0 con 0x7f568806dcb0 2024-05-27T10:52:34.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.763+0000 7f568e200640 1 -- 172.21.15.47:0/3854535988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f568814be60 con 0x7f568806dcb0 2024-05-27T10:52:34.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.764+0000 7f568e200640 1 -- 172.21.15.47:0/3854535988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56880689e0 con 0x7f568806dcb0 2024-05-27T10:52:34.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.765+0000 7f567f400640 1 -- 172.21.15.47:0/3854535988 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5678014ba0 con 0x7f568806dcb0 2024-05-27T10:52:34.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.766+0000 7f567f400640 1 --2- 172.21.15.47:0/3854535988 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f566806c8f0 0x7f566806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:34.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.766+0000 7f567f400640 1 -- 172.21.15.47:0/3854535988 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f567808c490 con 0x7f568806dcb0 2024-05-27T10:52:34.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.766+0000 7f5686a00640 1 --2- 172.21.15.47:0/3854535988 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f566806c8f0 0x7f566806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:34.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.767+0000 7f5686a00640 1 --2- 172.21.15.47:0/3854535988 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f566806c8f0 0x7f566806edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5674034000 tx=0x7f567402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:34.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.772+0000 7f567f400640 1 -- 172.21.15.47:0/3854535988 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f567805a820 con 0x7f568806dcb0 2024-05-27T10:52:34.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.980+0000 7f568e200640 1 -- 172.21.15.47:0/3854535988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56880aeed0 con 0x7f568806dcb0 2024-05-27T10:52:34.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.983+0000 7f567f400640 1 -- 172.21.15.47:0/3854535988 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16521 (secure 0 0 0) 0x7f567805a120 con 0x7f568806dcb0 2024-05-27T10:52:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:34.982 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:03.257638+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:52:34.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.986+0000 7f568e200640 1 -- 172.21.15.47:0/3854535988 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f566806c8f0 msgr2=0x7f566806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:34.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.986+0000 7f568e200640 1 --2- 172.21.15.47:0/3854535988 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f566806c8f0 0x7f566806edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5674034000 tx=0x7f567402e000 comp rx=0 tx=0).stop 2024-05-27T10:52:34.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.986+0000 7f568e200640 1 -- 172.21.15.47:0/3854535988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f568806dcb0 msgr2=0x7f568814aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:34.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.986+0000 7f568e200640 1 --2- 172.21.15.47:0/3854535988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f568806dcb0 0x7f568814aab0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5678007e70 tx=0x7f567800e4b0 comp rx=0 tx=0).stop 2024-05-27T10:52:34.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.986+0000 7f568e200640 1 -- 172.21.15.47:0/3854535988 shutdown_connections 2024-05-27T10:52:34.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.986+0000 7f568e200640 1 --2- 172.21.15.47:0/3854535988 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f566806c8f0 0x7f566806edb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:34.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.986+0000 7f568e200640 1 --2- 172.21.15.47:0/3854535988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f568815e7d0 0x7f568809c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:34.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.986+0000 7f568e200640 1 --2- 172.21.15.47:0/3854535988 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f56880d0c40 0x7f568809acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:34.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.986+0000 7f568e200640 1 --2- 172.21.15.47:0/3854535988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f568806dcb0 0x7f568814aab0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:34.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.986+0000 7f568e200640 1 -- 172.21.15.47:0/3854535988 >> 172.21.15.47:0/3854535988 conn(0x7f568806bd60 msgr2=0x7f56880ada50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:34.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.987+0000 7f568e200640 1 -- 172.21.15.47:0/3854535988 shutdown_connections 2024-05-27T10:52:34.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:34.987+0000 7f568e200640 1 -- 172.21.15.47:0/3854535988 wait complete. 2024-05-27T10:52:35.004 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T10:51:55.073251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T10:51:59.202702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T10:52:00.664039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T10:52:35.004 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T10:52:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.219+0000 7fb349e00640 1 Processor -- start 2024-05-27T10:52:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.219+0000 7fb349e00640 1 -- start start 2024-05-27T10:52:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.220+0000 7fb349e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb34415e630 0x7fb3440d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:35.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.220+0000 7fb349e00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3440b6670 0x7fb3440d3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:35.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.220+0000 7fb349e00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3440ced40 con 0x7fb3440cfde0 2024-05-27T10:52:35.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.220+0000 7fb349e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb3440cf950 con 0x7fb34415e630 2024-05-27T10:52:35.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.220+0000 7fb349e00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fb3440cf020 con 0x7fb3440b6670 2024-05-27T10:52:35.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.221+0000 7fb348a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb34415e630 0x7fb3440d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:35.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.221+0000 7fb348a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb34415e630 0x7fb3440d3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37212/0 (socket says 172.21.15.47:37212) 2024-05-27T10:52:35.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.221+0000 7fb348a00640 1 -- 172.21.15.47:0/3087347593 learned_addr learned my addr 172.21.15.47:0/3087347593 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:35.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.221+0000 7fb349400640 1 --2- 172.21.15.47:0/3087347593 >> v2:172.21.15.53:3300/0 conn(0x7fb3440b6670 0x7fb3440d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:35.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.221+0000 7fb348a00640 1 -- 172.21.15.47:0/3087347593 >> v2:172.21.15.53:3300/0 conn(0x7fb3440b6670 msgr2=0x7fb3440d3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:35.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.221+0000 7fb348a00640 1 --2- 172.21.15.47:0/3087347593 >> v2:172.21.15.53:3300/0 conn(0x7fb3440b6670 0x7fb3440d3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.221+0000 7fb348a00640 1 -- 172.21.15.47:0/3087347593 >> v1:172.21.15.53:6789/0 conn(0x7fb3440cfde0 legacy=0x7fb3440b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:35.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.222+0000 7fb348a00640 1 -- 172.21.15.47:0/3087347593 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3440cf300 con 0x7fb34415e630 2024-05-27T10:52:35.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.222+0000 7fb349400640 1 --2- 172.21.15.47:0/3087347593 >> v2:172.21.15.53:3300/0 conn(0x7fb3440b6670 0x7fb3440d3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:52:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.223+0000 7fb348a00640 1 --2- 172.21.15.47:0/3087347593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb34415e630 0x7fb3440d3230 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb3440cb540 tx=0x7fb33402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4339313f32bcc4c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.223+0000 7fb343e00640 1 -- 172.21.15.47:0/3087347593 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb334036070 con 0x7fb34415e630 2024-05-27T10:52:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.223+0000 7fb343e00640 1 -- 172.21.15.47:0/3087347593 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb334031600 con 0x7fb34415e630 2024-05-27T10:52:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.223+0000 7fb343e00640 1 -- 172.21.15.47:0/3087347593 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3340319d0 con 0x7fb34415e630 2024-05-27T10:52:35.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.224+0000 7fb349e00640 1 -- 172.21.15.47:0/3087347593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb34415e630 msgr2=0x7fb3440d3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:35.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.224+0000 7fb349e00640 1 --2- 172.21.15.47:0/3087347593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb34415e630 0x7fb3440d3230 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb3440cb540 tx=0x7fb33402a6f0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.224+0000 7fb349e00640 1 -- 172.21.15.47:0/3087347593 shutdown_connections 2024-05-27T10:52:35.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.224+0000 7fb349e00640 1 --2- 172.21.15.47:0/3087347593 >> v2:172.21.15.53:3300/0 conn(0x7fb3440b6670 0x7fb3440d3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.224+0000 7fb349e00640 1 --2- 172.21.15.47:0/3087347593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb34415e630 0x7fb3440d3230 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.224+0000 7fb349e00640 1 -- 172.21.15.47:0/3087347593 >> 172.21.15.47:0/3087347593 conn(0x7fb34408bfd0 msgr2=0x7fb3440d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:35.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.224+0000 7fb349e00640 1 -- 172.21.15.47:0/3087347593 shutdown_connections 2024-05-27T10:52:35.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.224+0000 7fb349e00640 1 -- 172.21.15.47:0/3087347593 wait complete. 2024-05-27T10:52:35.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.226+0000 7fb349e00640 1 Processor -- start 2024-05-27T10:52:35.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.226+0000 7fb349e00640 1 -- start start 2024-05-27T10:52:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.227+0000 7fb349e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3440b6670 0x7fb344155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.227+0000 7fb349e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb3440cfde0 0x7fb34406c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.227+0000 7fb349e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb34415e630 0x7fb34406ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.227+0000 7fb349e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb34415eb90 con 0x7fb34415e630 2024-05-27T10:52:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.227+0000 7fb349e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb34415ea10 con 0x7fb3440b6670 2024-05-27T10:52:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.227+0000 7fb349e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb3441685f0 con 0x7fb3440cfde0 2024-05-27T10:52:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.227+0000 7fb349400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb34415e630 0x7fb34406ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.227+0000 7fb349400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb34415e630 0x7fb34406ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37222/0 (socket says 172.21.15.47:37222) 2024-05-27T10:52:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.227+0000 7fb349400640 1 -- 172.21.15.47:0/696535315 learned_addr learned my addr 172.21.15.47:0/696535315 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:35.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.227+0000 7fb348a00640 1 --2- 172.21.15.47:0/696535315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3440b6670 0x7fb344155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.227+0000 7fb349400640 1 -- 172.21.15.47:0/696535315 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb3440cfde0 msgr2=0x7fb34406c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.227+0000 7fb349400640 1 --2- 172.21.15.47:0/696535315 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb3440cfde0 0x7fb34406c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.228+0000 7fb349400640 1 -- 172.21.15.47:0/696535315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3440b6670 msgr2=0x7fb344155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.228+0000 7fb349400640 1 --2- 172.21.15.47:0/696535315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3440b6670 0x7fb344155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.228+0000 7fb349400640 1 -- 172.21.15.47:0/696535315 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3440b8a40 con 0x7fb34415e630 2024-05-27T10:52:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.228+0000 7fb349400640 1 --2- 172.21.15.47:0/696535315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb34415e630 0x7fb34406ccc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00e7e0 tx=0x7fb33c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.228+0000 7fb341600640 1 -- 172.21.15.47:0/696535315 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c00f040 con 0x7fb34415e630 2024-05-27T10:52:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.228+0000 7fb341600640 1 -- 172.21.15.47:0/696535315 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb33c004030 con 0x7fb34415e630 2024-05-27T10:52:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.228+0000 7fb341600640 1 -- 172.21.15.47:0/696535315 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c0043e0 con 0x7fb34415e630 2024-05-27T10:52:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.228+0000 7fb349e00640 1 -- 172.21.15.47:0/696535315 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3440b8d20 con 0x7fb34415e630 2024-05-27T10:52:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.228+0000 7fb349e00640 1 -- 172.21.15.47:0/696535315 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3440b92e0 con 0x7fb34415e630 2024-05-27T10:52:35.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.229+0000 7fb349e00640 1 -- 172.21.15.47:0/696535315 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb34404fce0 con 0x7fb34415e630 2024-05-27T10:52:35.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.230+0000 7fb341600640 1 -- 172.21.15.47:0/696535315 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb33c00c6d0 con 0x7fb34415e630 2024-05-27T10:52:35.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.231+0000 7fb341600640 1 --2- 172.21.15.47:0/696535315 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb32006c8f0 0x7fb32006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:35.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.231+0000 7fb341600640 1 -- 172.21.15.47:0/696535315 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb33c08bbf0 con 0x7fb34415e630 2024-05-27T10:52:35.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.232+0000 7fb348a00640 1 --2- 172.21.15.47:0/696535315 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb32006c8f0 0x7fb32006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:35.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.232+0000 7fb348a00640 1 --2- 172.21.15.47:0/696535315 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb32006c8f0 0x7fb32006edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb334033000 tx=0x7fb334009000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:35.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.235+0000 7fb341600640 1 -- 172.21.15.47:0/696535315 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb33c017020 con 0x7fb34415e630 2024-05-27T10:52:35.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.436+0000 7fb349e00640 1 -- 172.21.15.47:0/696535315 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb3440d1d00 con 0x7fb34415e630 2024-05-27T10:52:35.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.437+0000 7fb341600640 1 -- 172.21.15.47:0/696535315 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fb33c05a010 con 0x7fb34415e630 2024-05-27T10:52:35.435 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-27T10:52:35.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.440+0000 7fb349e00640 1 -- 172.21.15.47:0/696535315 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb32006c8f0 msgr2=0x7fb32006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:35.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.440+0000 7fb349e00640 1 --2- 172.21.15.47:0/696535315 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb32006c8f0 0x7fb32006edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb334033000 tx=0x7fb334009000 comp rx=0 tx=0).stop 2024-05-27T10:52:35.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.440+0000 7fb349e00640 1 -- 172.21.15.47:0/696535315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb34415e630 msgr2=0x7fb34406ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:35.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.440+0000 7fb349e00640 1 --2- 172.21.15.47:0/696535315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb34415e630 0x7fb34406ccc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00e7e0 tx=0x7fb33c00eca0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.440+0000 7fb349e00640 1 -- 172.21.15.47:0/696535315 shutdown_connections 2024-05-27T10:52:35.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.440+0000 7fb349e00640 1 --2- 172.21.15.47:0/696535315 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb32006c8f0 0x7fb32006edb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.440+0000 7fb349e00640 1 --2- 172.21.15.47:0/696535315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb34415e630 0x7fb34406ccc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.440+0000 7fb349e00640 1 --2- 172.21.15.47:0/696535315 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb3440cfde0 0x7fb34406c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.440+0000 7fb349e00640 1 --2- 172.21.15.47:0/696535315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3440b6670 0x7fb344155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.440+0000 7fb349e00640 1 -- 172.21.15.47:0/696535315 >> 172.21.15.47:0/696535315 conn(0x7fb34408bfd0 msgr2=0x7fb3440d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:35.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.440+0000 7fb349e00640 1 -- 172.21.15.47:0/696535315 shutdown_connections 2024-05-27T10:52:35.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.440+0000 7fb349e00640 1 -- 172.21.15.47:0/696535315 wait complete. 2024-05-27T10:52:35.457 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T10:52:35.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.675+0000 7fd775600640 1 Processor -- start 2024-05-27T10:52:35.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.675+0000 7fd775600640 1 -- start start 2024-05-27T10:52:35.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.677+0000 7fd775600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd77015e630 0x7fd7700d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:35.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.677+0000 7fd775600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7700ced40 con 0x7fd7700cfde0 2024-05-27T10:52:35.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.677+0000 7fd775600640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7700cf020 con 0x7fd7700b6670 2024-05-27T10:52:35.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.677+0000 7fd775600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd7700cf950 con 0x7fd77015e630 2024-05-27T10:52:35.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.677+0000 7fd76f400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd7700cfde0 0x7fd7700b5f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:50996/0 (socket says 172.21.15.47:50996) 2024-05-27T10:52:35.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.677+0000 7fd76f400640 1 -- 172.21.15.47:0/3725601722 learned_addr learned my addr 172.21.15.47:0/3725601722 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:35.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.678+0000 7fd76ea00640 1 -- 172.21.15.47:0/3725601722 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2176164684 0 0) 0x7fd7700ced40 con 0x7fd7700cfde0 2024-05-27T10:52:35.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.678+0000 7fd76ea00640 1 -- 172.21.15.47:0/3725601722 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd754003520 con 0x7fd7700cfde0 2024-05-27T10:52:35.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.678+0000 7fd76fe00640 1 --2- 172.21.15.47:0/3725601722 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd77015e630 0x7fd7700d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:35.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.678+0000 7fd76ea00640 1 -- 172.21.15.47:0/3725601722 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 995879720 0 0) 0x7fd754003520 con 0x7fd7700cfde0 2024-05-27T10:52:35.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.678+0000 7fd76ea00640 1 -- 172.21.15.47:0/3725601722 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd77015e630 msgr2=0x7fd7700d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:35.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.678+0000 7fd76ea00640 1 --2- 172.21.15.47:0/3725601722 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd77015e630 0x7fd7700d3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.678+0000 7fd76ea00640 1 -- 172.21.15.47:0/3725601722 >> v1:172.21.15.53:6789/0 conn(0x7fd7700b6670 legacy=0x7fd7701685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:35.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.678+0000 7fd76ea00640 1 -- 172.21.15.47:0/3725601722 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7700cf300 con 0x7fd7700cfde0 2024-05-27T10:52:35.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.678+0000 7fd76ea00640 1 -- 172.21.15.47:0/3725601722 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7fd75c001670 con 0x7fd7700cfde0 2024-05-27T10:52:35.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.678+0000 7fd76ea00640 1 -- 172.21.15.47:0/3725601722 >> v1:172.21.15.47:6789/0 conn(0x7fd7700cfde0 legacy=0x7fd7700b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:35.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.678+0000 7fd76ea00640 1 --2- 172.21.15.47:0/3725601722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7540039e0 0x7fd754003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:35.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.679+0000 7fd76ea00640 1 --2- 172.21.15.47:0/3725601722 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd77015e630 0x7fd754004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:35.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.679+0000 7fd76ea00640 1 --2- 172.21.15.47:0/3725601722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd754004d90 0x7fd754005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:35.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.679+0000 7fd76ea00640 1 -- 172.21.15.47:0/3725601722 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd7700cf950 con 0x7fd754004d90 2024-05-27T10:52:35.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.679+0000 7fd76ea00640 1 -- 172.21.15.47:0/3725601722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd75400bb80 con 0x7fd7540039e0 2024-05-27T10:52:35.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.679+0000 7fd76ea00640 1 -- 172.21.15.47:0/3725601722 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd75400bd80 con 0x7fd77015e630 2024-05-27T10:52:35.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.679+0000 7fd774c00640 1 --2- 172.21.15.47:0/3725601722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd754004d90 0x7fd754005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:35.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.679+0000 7fd76fe00640 1 --2- 172.21.15.47:0/3725601722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7540039e0 0x7fd754003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:35.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.679+0000 7fd76f400640 1 --2- 172.21.15.47:0/3725601722 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd77015e630 0x7fd754004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:35.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.679+0000 7fd774c00640 1 -- 172.21.15.47:0/3725601722 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd77015e630 msgr2=0x7fd754004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:35.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.679+0000 7fd774c00640 1 --2- 172.21.15.47:0/3725601722 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd77015e630 0x7fd754004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.679+0000 7fd774c00640 1 -- 172.21.15.47:0/3725601722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7540039e0 msgr2=0x7fd754003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:35.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.679+0000 7fd774c00640 1 --2- 172.21.15.47:0/3725601722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7540039e0 0x7fd754003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.679+0000 7fd774c00640 1 -- 172.21.15.47:0/3725601722 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd754003520 con 0x7fd754004d90 2024-05-27T10:52:35.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.679+0000 7fd76fe00640 1 --2- 172.21.15.47:0/3725601722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7540039e0 0x7fd754003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:35.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.680+0000 7fd774c00640 1 --2- 172.21.15.47:0/3725601722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd754004d90 0x7fd754005210 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd77008e4e0 tx=0x7fd754005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6af52d5e618467 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:35.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.681+0000 7fd76ea00640 1 -- 172.21.15.47:0/3725601722 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd768001a70 con 0x7fd754004d90 2024-05-27T10:52:35.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.681+0000 7fd76ea00640 1 -- 172.21.15.47:0/3725601722 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd76802ae10 con 0x7fd754004d90 2024-05-27T10:52:35.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.681+0000 7fd76ea00640 1 -- 172.21.15.47:0/3725601722 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd768003bb0 con 0x7fd754004d90 2024-05-27T10:52:35.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.681+0000 7fd775600640 1 -- 172.21.15.47:0/3725601722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd754004d90 msgr2=0x7fd754005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:35.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.681+0000 7fd775600640 1 --2- 172.21.15.47:0/3725601722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd754004d90 0x7fd754005210 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd77008e4e0 tx=0x7fd754005830 comp rx=0 tx=0).stop 2024-05-27T10:52:35.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.681+0000 7fd774c00640 1 -- 172.21.15.47:0/3725601722 reap_dead start 2024-05-27T10:52:35.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.681+0000 7fd775600640 1 -- 172.21.15.47:0/3725601722 shutdown_connections 2024-05-27T10:52:35.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.681+0000 7fd775600640 1 -- 172.21.15.47:0/3725601722 >> 172.21.15.47:0/3725601722 conn(0x7fd77008bfd0 msgr2=0x7fd7700d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:35.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.681+0000 7fd775600640 1 -- 172.21.15.47:0/3725601722 shutdown_connections 2024-05-27T10:52:35.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.681+0000 7fd775600640 1 -- 172.21.15.47:0/3725601722 wait complete. 2024-05-27T10:52:35.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.683+0000 7fd775600640 1 Processor -- start 2024-05-27T10:52:35.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.683+0000 7fd775600640 1 -- start start 2024-05-27T10:52:35.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.684+0000 7fd775600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd754004d90 0x7fd77015f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:35.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.684+0000 7fd775600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd770157330 0x7fd7701610f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:35.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.684+0000 7fd775600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd770161630 0x7fd7700b8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:35.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.684+0000 7fd775600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd77015eb90 con 0x7fd754004d90 2024-05-27T10:52:35.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.684+0000 7fd775600640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd77015ea10 con 0x7fd770157330 2024-05-27T10:52:35.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.684+0000 7fd775600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd7700d3230 con 0x7fd770161630 2024-05-27T10:52:35.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.684+0000 7fd76fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd754004d90 0x7fd77015f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:35.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.684+0000 7fd76fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd754004d90 0x7fd77015f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37234/0 (socket says 172.21.15.47:37234) 2024-05-27T10:52:35.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.684+0000 7fd76fe00640 1 -- 172.21.15.47:0/928776925 learned_addr learned my addr 172.21.15.47:0/928776925 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:35.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.685+0000 7fd76fe00640 1 -- 172.21.15.47:0/928776925 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd770161630 msgr2=0x7fd7700b8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:35.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.685+0000 7fd76fe00640 1 --2- 172.21.15.47:0/928776925 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd770161630 0x7fd7700b8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.685+0000 7fd76fe00640 1 -- 172.21.15.47:0/928776925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd770157330 msgr2=0x7fd7701610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:35.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.685+0000 7fd76fe00640 1 --2- 172.21.15.47:0/928776925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd770157330 0x7fd7701610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.685+0000 7fd76fe00640 1 -- 172.21.15.47:0/928776925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77015fc60 con 0x7fd754004d90 2024-05-27T10:52:35.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.685+0000 7fd76fe00640 1 --2- 172.21.15.47:0/928776925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd754004d90 0x7fd77015f720 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd76000e7e0 tx=0x7fd76000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:35.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.685+0000 7fd767e00640 1 -- 172.21.15.47:0/928776925 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd760017070 con 0x7fd754004d90 2024-05-27T10:52:35.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.685+0000 7fd767e00640 1 -- 172.21.15.47:0/928776925 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd76000c5f0 con 0x7fd754004d90 2024-05-27T10:52:35.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.686+0000 7fd767e00640 1 -- 172.21.15.47:0/928776925 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76000f040 con 0x7fd754004d90 2024-05-27T10:52:35.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.686+0000 7fd775600640 1 -- 172.21.15.47:0/928776925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7700cb1b0 con 0x7fd754004d90 2024-05-27T10:52:35.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.686+0000 7fd775600640 1 -- 172.21.15.47:0/928776925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7700cc500 con 0x7fd754004d90 2024-05-27T10:52:35.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.687+0000 7fd775600640 1 -- 172.21.15.47:0/928776925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7700cc010 con 0x7fd754004d90 2024-05-27T10:52:35.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.688+0000 7fd767e00640 1 -- 172.21.15.47:0/928776925 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd76001a070 con 0x7fd754004d90 2024-05-27T10:52:35.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.689+0000 7fd767e00640 1 --2- 172.21.15.47:0/928776925 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd75006c8f0 0x7fd75006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:35.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.689+0000 7fd767e00640 1 -- 172.21.15.47:0/928776925 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd76008b740 con 0x7fd754004d90 2024-05-27T10:52:35.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.689+0000 7fd76f400640 1 --2- 172.21.15.47:0/928776925 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd75006c8f0 0x7fd75006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:35.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.690+0000 7fd76f400640 1 --2- 172.21.15.47:0/928776925 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd75006c8f0 0x7fd75006edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd75c000c00 tx=0x7fd75c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:35.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.693+0000 7fd767e00640 1 -- 172.21.15.47:0/928776925 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd760059a40 con 0x7fd754004d90 2024-05-27T10:52:35.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.886+0000 7fd775600640 1 -- 172.21.15.47:0/928776925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd77008e600 con 0x7fd754004d90 2024-05-27T10:52:35.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.887+0000 7fd767e00640 1 -- 172.21.15.47:0/928776925 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fd760059340 con 0x7fd754004d90 2024-05-27T10:52:35.885 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-27T10:52:35.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.889+0000 7fd775600640 1 -- 172.21.15.47:0/928776925 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd75006c8f0 msgr2=0x7fd75006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:35.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.890+0000 7fd775600640 1 --2- 172.21.15.47:0/928776925 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd75006c8f0 0x7fd75006edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd75c000c00 tx=0x7fd75c009040 comp rx=0 tx=0).stop 2024-05-27T10:52:35.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.890+0000 7fd775600640 1 -- 172.21.15.47:0/928776925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd754004d90 msgr2=0x7fd77015f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:35.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.890+0000 7fd775600640 1 --2- 172.21.15.47:0/928776925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd754004d90 0x7fd77015f720 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd76000e7e0 tx=0x7fd76000eca0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.890+0000 7fd775600640 1 -- 172.21.15.47:0/928776925 shutdown_connections 2024-05-27T10:52:35.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.890+0000 7fd775600640 1 --2- 172.21.15.47:0/928776925 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd75006c8f0 0x7fd75006edb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.890+0000 7fd775600640 1 --2- 172.21.15.47:0/928776925 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd770161630 0x7fd7700b8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.890+0000 7fd775600640 1 --2- 172.21.15.47:0/928776925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd770157330 0x7fd7701610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.890+0000 7fd775600640 1 --2- 172.21.15.47:0/928776925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd754004d90 0x7fd77015f720 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:35.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.890+0000 7fd775600640 1 -- 172.21.15.47:0/928776925 >> 172.21.15.47:0/928776925 conn(0x7fd77008bfd0 msgr2=0x7fd7700d3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:35.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.890+0000 7fd775600640 1 -- 172.21.15.47:0/928776925 shutdown_connections 2024-05-27T10:52:35.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:35.890+0000 7fd775600640 1 -- 172.21.15.47:0/928776925 wait complete. 2024-05-27T10:52:35.907 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T10:52:36.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.112+0000 7fbeccc00640 1 Processor -- start 2024-05-27T10:52:36.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.113+0000 7fbeccc00640 1 -- start start 2024-05-27T10:52:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.114+0000 7fbeccc00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbec80cc740 0x7fbec80cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.114+0000 7fbeccc00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec80ce5c0 con 0x7fbec80d0970 2024-05-27T10:52:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.114+0000 7fbeccc00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec80ce8a0 con 0x7fbec80d0590 2024-05-27T10:52:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.114+0000 7fbeccc00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fbec806da80 con 0x7fbec80cc740 2024-05-27T10:52:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.114+0000 7fbec6a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbec80d0970 0x7fbec80cc030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51002/0 (socket says 172.21.15.47:51002) 2024-05-27T10:52:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.114+0000 7fbec6a00640 1 -- 172.21.15.47:0/86207718 learned_addr learned my addr 172.21.15.47:0/86207718 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:36.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.115+0000 7fbec7e00640 1 --2- 172.21.15.47:0/86207718 >> v2:172.21.15.53:3300/0 conn(0x7fbec80cc740 0x7fbec80cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:36.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.115+0000 7fbec6000640 1 -- 172.21.15.47:0/86207718 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 524317552 0 0) 0x7fbec80ce5c0 con 0x7fbec80d0970 2024-05-27T10:52:36.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.115+0000 7fbec6000640 1 -- 172.21.15.47:0/86207718 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbeac003520 con 0x7fbec80d0970 2024-05-27T10:52:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.115+0000 7fbec6000640 1 -- 172.21.15.47:0/86207718 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 841289962 0 0) 0x7fbeac003520 con 0x7fbec80d0970 2024-05-27T10:52:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.115+0000 7fbec6000640 1 -- 172.21.15.47:0/86207718 >> v2:172.21.15.53:3300/0 conn(0x7fbec80cc740 msgr2=0x7fbec80cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.115+0000 7fbec6000640 1 --2- 172.21.15.47:0/86207718 >> v2:172.21.15.53:3300/0 conn(0x7fbec80cc740 0x7fbec80cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.115+0000 7fbec6000640 1 -- 172.21.15.47:0/86207718 >> v1:172.21.15.53:6789/0 conn(0x7fbec80d0590 legacy=0x7fbec815c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.115+0000 7fbec6000640 1 -- 172.21.15.47:0/86207718 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec80ceb80 con 0x7fbec80d0970 2024-05-27T10:52:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.115+0000 7fbec6000640 1 -- 172.21.15.47:0/86207718 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7fbeb4001670 con 0x7fbec80d0970 2024-05-27T10:52:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.115+0000 7fbec6000640 1 -- 172.21.15.47:0/86207718 >> v1:172.21.15.47:6789/0 conn(0x7fbec80d0970 legacy=0x7fbec80cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.115+0000 7fbec6000640 1 --2- 172.21.15.47:0/86207718 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbeac003a00 0x7fbeac003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.115+0000 7fbec6000640 1 --2- 172.21.15.47:0/86207718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbeac004800 0x7fbeac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.115+0000 7fbec6000640 1 --2- 172.21.15.47:0/86207718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbeac005290 0x7fbeac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.115+0000 7fbec6000640 1 -- 172.21.15.47:0/86207718 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbec806da80 con 0x7fbeac005290 2024-05-27T10:52:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.115+0000 7fbec6000640 1 -- 172.21.15.47:0/86207718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac00c1e0 con 0x7fbeac004800 2024-05-27T10:52:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.115+0000 7fbec6000640 1 -- 172.21.15.47:0/86207718 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbeac00c3e0 con 0x7fbeac003a00 2024-05-27T10:52:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.116+0000 7fbec7e00640 1 --2- 172.21.15.47:0/86207718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbeac005290 0x7fbeac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.116+0000 7fbec7400640 1 --2- 172.21.15.47:0/86207718 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbeac003a00 0x7fbeac003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.116+0000 7fbec7e00640 1 -- 172.21.15.47:0/86207718 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbeac003a00 msgr2=0x7fbeac003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.116+0000 7fbec6a00640 1 --2- 172.21.15.47:0/86207718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbeac004800 0x7fbeac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.116+0000 7fbec7e00640 1 --2- 172.21.15.47:0/86207718 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbeac003a00 0x7fbeac003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.116+0000 7fbec7e00640 1 -- 172.21.15.47:0/86207718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbeac004800 msgr2=0x7fbeac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.116+0000 7fbec7e00640 1 --2- 172.21.15.47:0/86207718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbeac004800 0x7fbeac004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.116+0000 7fbec7e00640 1 -- 172.21.15.47:0/86207718 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeac003520 con 0x7fbeac005290 2024-05-27T10:52:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.117+0000 7fbec7e00640 1 -- 172.21.15.47:0/86207718 reap_dead start 2024-05-27T10:52:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.118+0000 7fbec7e00640 1 --2- 172.21.15.47:0/86207718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbeac005290 0x7fbeac00b9c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbec0007330 tx=0x7fbeac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5851a4e7cefdc441 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.118+0000 7fbec6000640 1 -- 172.21.15.47:0/86207718 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec0009be0 con 0x7fbeac005290 2024-05-27T10:52:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.118+0000 7fbec6000640 1 -- 172.21.15.47:0/86207718 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec0003b90 con 0x7fbeac005290 2024-05-27T10:52:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.118+0000 7fbec6000640 1 -- 172.21.15.47:0/86207718 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec0004020 con 0x7fbeac005290 2024-05-27T10:52:36.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.119+0000 7fbeccc00640 1 -- 172.21.15.47:0/86207718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbeac005290 msgr2=0x7fbeac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:36.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.119+0000 7fbeccc00640 1 --2- 172.21.15.47:0/86207718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbeac005290 0x7fbeac00b9c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbec0007330 tx=0x7fbeac005830 comp rx=0 tx=0).stop 2024-05-27T10:52:36.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.119+0000 7fbeccc00640 1 -- 172.21.15.47:0/86207718 shutdown_connections 2024-05-27T10:52:36.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.119+0000 7fbeccc00640 1 --2- 172.21.15.47:0/86207718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbeac005290 0x7fbeac00b9c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:36.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.119+0000 7fbeccc00640 1 -- 172.21.15.47:0/86207718 >> 172.21.15.47:0/86207718 conn(0x7fbec806bb20 msgr2=0x7fbec806bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:36.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.119+0000 7fbeccc00640 1 -- 172.21.15.47:0/86207718 shutdown_connections 2024-05-27T10:52:36.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.119+0000 7fbeccc00640 1 -- 172.21.15.47:0/86207718 wait complete. 2024-05-27T10:52:36.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.121+0000 7fbeccc00640 1 Processor -- start 2024-05-27T10:52:36.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.121+0000 7fbeccc00640 1 -- start start 2024-05-27T10:52:36.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.122+0000 7fbeccc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbeac005290 0x7fbec814ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:36.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.122+0000 7fbeccc00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbec814dd20 0x7fbec8145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:36.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.122+0000 7fbeccc00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbec815db90 0x7fbec815e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:36.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.122+0000 7fbeccc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbec80ce160 con 0x7fbeac005290 2024-05-27T10:52:36.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.122+0000 7fbeccc00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbec80cdfe0 con 0x7fbec814dd20 2024-05-27T10:52:36.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.122+0000 7fbeccc00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbec80ce2e0 con 0x7fbec815db90 2024-05-27T10:52:36.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.122+0000 7fbec7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbeac005290 0x7fbec814ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:36.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.122+0000 7fbec7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbeac005290 0x7fbec814ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37248/0 (socket says 172.21.15.47:37248) 2024-05-27T10:52:36.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.122+0000 7fbec7400640 1 -- 172.21.15.47:0/3725112474 learned_addr learned my addr 172.21.15.47:0/3725112474 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:36.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.122+0000 7fbec7400640 1 -- 172.21.15.47:0/3725112474 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbec815db90 msgr2=0x7fbec815e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:36.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.122+0000 7fbec7400640 1 --2- 172.21.15.47:0/3725112474 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbec815db90 0x7fbec815e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:36.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.122+0000 7fbec7400640 1 -- 172.21.15.47:0/3725112474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbec814dd20 msgr2=0x7fbec8145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:36.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.122+0000 7fbec6a00640 1 --2- 172.21.15.47:0/3725112474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbec814dd20 0x7fbec8145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:36.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.122+0000 7fbec7400640 1 --2- 172.21.15.47:0/3725112474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbec814dd20 0x7fbec8145f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:36.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.122+0000 7fbec7400640 1 -- 172.21.15.47:0/3725112474 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec8152000 con 0x7fbeac005290 2024-05-27T10:52:36.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.122+0000 7fbec6a00640 1 --2- 172.21.15.47:0/3725112474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbec814dd20 0x7fbec8145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:36.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.123+0000 7fbec7400640 1 --2- 172.21.15.47:0/3725112474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbeac005290 0x7fbec814ef00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800e3e0 tx=0x7fbeb800e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:36.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.123+0000 7fbebf400640 1 -- 172.21.15.47:0/3725112474 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb80135f0 con 0x7fbeac005290 2024-05-27T10:52:36.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.123+0000 7fbebf400640 1 -- 172.21.15.47:0/3725112474 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb8019070 con 0x7fbeac005290 2024-05-27T10:52:36.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.123+0000 7fbebf400640 1 -- 172.21.15.47:0/3725112474 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb80139d0 con 0x7fbeac005290 2024-05-27T10:52:36.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.123+0000 7fbeccc00640 1 -- 172.21.15.47:0/3725112474 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec81522e0 con 0x7fbeac005290 2024-05-27T10:52:36.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.123+0000 7fbeccc00640 1 -- 172.21.15.47:0/3725112474 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec81f0250 con 0x7fbeac005290 2024-05-27T10:52:36.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.124+0000 7fbeccc00640 1 -- 172.21.15.47:0/3725112474 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec804fce0 con 0x7fbeac005290 2024-05-27T10:52:36.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.125+0000 7fbebf400640 1 -- 172.21.15.47:0/3725112474 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbeb8013b70 con 0x7fbeac005290 2024-05-27T10:52:36.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.126+0000 7fbebf400640 1 --2- 172.21.15.47:0/3725112474 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbea806c920 0x7fbea806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:36.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.126+0000 7fbebf400640 1 -- 172.21.15.47:0/3725112474 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbeb808ba00 con 0x7fbeac005290 2024-05-27T10:52:36.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.127+0000 7fbec6a00640 1 --2- 172.21.15.47:0/3725112474 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbea806c920 0x7fbea806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:36.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.127+0000 7fbec6a00640 1 --2- 172.21.15.47:0/3725112474 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbea806c920 0x7fbea806ede0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbec815e6e0 tx=0x7fbeb4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:36.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.130+0000 7fbebf400640 1 -- 172.21.15.47:0/3725112474 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbeb8023020 con 0x7fbeac005290 2024-05-27T10:52:36.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.324+0000 7fbeccc00640 1 -- 172.21.15.47:0/3725112474 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbec8169110 con 0x7fbeac005290 2024-05-27T10:52:36.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.325+0000 7fbebf400640 1 -- 172.21.15.47:0/3725112474 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fbeb8059d90 con 0x7fbeac005290 2024-05-27T10:52:36.323 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-27T10:52:36.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.327+0000 7fbeccc00640 1 -- 172.21.15.47:0/3725112474 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbea806c920 msgr2=0x7fbea806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:36.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.327+0000 7fbeccc00640 1 --2- 172.21.15.47:0/3725112474 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbea806c920 0x7fbea806ede0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbec815e6e0 tx=0x7fbeb4009040 comp rx=0 tx=0).stop 2024-05-27T10:52:36.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.327+0000 7fbeccc00640 1 -- 172.21.15.47:0/3725112474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbeac005290 msgr2=0x7fbec814ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:36.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.327+0000 7fbeccc00640 1 --2- 172.21.15.47:0/3725112474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbeac005290 0x7fbec814ef00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800e3e0 tx=0x7fbeb800e8a0 comp rx=0 tx=0).stop 2024-05-27T10:52:36.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.328+0000 7fbeccc00640 1 -- 172.21.15.47:0/3725112474 shutdown_connections 2024-05-27T10:52:36.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.328+0000 7fbeccc00640 1 --2- 172.21.15.47:0/3725112474 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbea806c920 0x7fbea806ede0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:36.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.328+0000 7fbeccc00640 1 --2- 172.21.15.47:0/3725112474 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbec815db90 0x7fbec815e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:36.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.328+0000 7fbeccc00640 1 --2- 172.21.15.47:0/3725112474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbec814dd20 0x7fbec8145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:36.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.328+0000 7fbeccc00640 1 --2- 172.21.15.47:0/3725112474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbeac005290 0x7fbec814ef00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:36.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.328+0000 7fbeccc00640 1 -- 172.21.15.47:0/3725112474 >> 172.21.15.47:0/3725112474 conn(0x7fbec806bb20 msgr2=0x7fbec81535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:36.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.328+0000 7fbeccc00640 1 -- 172.21.15.47:0/3725112474 shutdown_connections 2024-05-27T10:52:36.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.328+0000 7fbeccc00640 1 -- 172.21.15.47:0/3725112474 wait complete. 2024-05-27T10:52:36.343 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:52:36.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.548+0000 7f455d000640 1 Processor -- start 2024-05-27T10:52:36.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.548+0000 7f455d000640 1 -- start start 2024-05-27T10:52:36.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.549+0000 7f455d000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f455806d240 0x7f455806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:36.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.549+0000 7f455d000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f455806ca40 0x7f45580d3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:36.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.550+0000 7f455d000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45580cebc0 con 0x7f455815eaa0 2024-05-27T10:52:36.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.550+0000 7f455d000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f45580cf4b0 con 0x7f455806d240 2024-05-27T10:52:36.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.550+0000 7f455d000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f455806db60 con 0x7f455806ca40 2024-05-27T10:52:36.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.550+0000 7f4557400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f455806d240 0x7f455806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:36.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.550+0000 7f4556a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f455815eaa0 0x7f45580cf940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51016/0 (socket says 172.21.15.47:51016) 2024-05-27T10:52:36.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.550+0000 7f4556a00640 1 -- 172.21.15.47:0/3333659082 learned_addr learned my addr 172.21.15.47:0/3333659082 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:36.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.551+0000 7f4557400640 1 -- 172.21.15.47:0/3333659082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f455806ca40 msgr2=0x7f45580d3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:36.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.551+0000 7f4557e00640 1 --2- 172.21.15.47:0/3333659082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f455806ca40 0x7f45580d3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:36.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.551+0000 7f4557400640 1 --2- 172.21.15.47:0/3333659082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f455806ca40 0x7f45580d3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:36.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.551+0000 7f4557400640 1 -- 172.21.15.47:0/3333659082 >> v1:172.21.15.47:6789/0 conn(0x7f455815eaa0 legacy=0x7f45580cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:36.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.551+0000 7f4557400640 1 -- 172.21.15.47:0/3333659082 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45580cee60 con 0x7f455806d240 2024-05-27T10:52:36.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.551+0000 7f4557e00640 1 --2- 172.21.15.47:0/3333659082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f455806ca40 0x7f45580d3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:36.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.551+0000 7f4556000640 1 -- 172.21.15.47:0/3333659082 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 980123247 0 0) 0x7f45580cebc0 con 0x7f455815eaa0 2024-05-27T10:52:36.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.552+0000 7f4557400640 1 --2- 172.21.15.47:0/3333659082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f455806d240 0x7f455806d620 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f45480097a0 tx=0x7f454802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe91a2dc1c9ed57 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:36.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.552+0000 7f4556000640 1 -- 172.21.15.47:0/3333659082 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548037070 con 0x7f455806d240 2024-05-27T10:52:36.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.552+0000 7f4556000640 1 -- 172.21.15.47:0/3333659082 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4548032440 con 0x7f455806d240 2024-05-27T10:52:36.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.552+0000 7f4556000640 1 -- 172.21.15.47:0/3333659082 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548032810 con 0x7f455806d240 2024-05-27T10:52:36.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.553+0000 7f455d000640 1 -- 172.21.15.47:0/3333659082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f455806d240 msgr2=0x7f455806d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:36.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.553+0000 7f455d000640 1 --2- 172.21.15.47:0/3333659082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f455806d240 0x7f455806d620 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f45480097a0 tx=0x7f454802a180 comp rx=0 tx=0).stop 2024-05-27T10:52:36.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.553+0000 7f455d000640 1 -- 172.21.15.47:0/3333659082 shutdown_connections 2024-05-27T10:52:36.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.553+0000 7f455d000640 1 --2- 172.21.15.47:0/3333659082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f455806ca40 0x7f45580d3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:36.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.553+0000 7f455d000640 1 --2- 172.21.15.47:0/3333659082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f455806d240 0x7f455806d620 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:36.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.553+0000 7f455d000640 1 -- 172.21.15.47:0/3333659082 >> 172.21.15.47:0/3333659082 conn(0x7f455808bfd0 msgr2=0x7f45580d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:36.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.553+0000 7f455d000640 1 -- 172.21.15.47:0/3333659082 shutdown_connections 2024-05-27T10:52:36.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.553+0000 7f455d000640 1 -- 172.21.15.47:0/3333659082 wait complete. 2024-05-27T10:52:36.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.555+0000 7f455d000640 1 Processor -- start 2024-05-27T10:52:36.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.555+0000 7f455d000640 1 -- start start 2024-05-27T10:52:36.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.556+0000 7f455d000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f455806ca40 0x7f45581f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:36.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.556+0000 7f455d000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f455806d240 0x7f45581f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:36.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.556+0000 7f455d000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f455815eaa0 0x7f45580b96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:36.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.556+0000 7f455d000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f45580b10a0 con 0x7f455815eaa0 2024-05-27T10:52:36.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.556+0000 7f455d000640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f455806cf40 con 0x7f455806d240 2024-05-27T10:52:36.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.556+0000 7f455d000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f45580b1220 con 0x7f455806ca40 2024-05-27T10:52:36.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.556+0000 7f4557e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f455815eaa0 0x7f45580b96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:36.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.556+0000 7f4557e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f455815eaa0 0x7f45580b96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37262/0 (socket says 172.21.15.47:37262) 2024-05-27T10:52:36.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.556+0000 7f4557e00640 1 -- 172.21.15.47:0/3170099744 learned_addr learned my addr 172.21.15.47:0/3170099744 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:36.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.557+0000 7f4556a00640 1 --2- 172.21.15.47:0/3170099744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f455806d240 0x7f45581f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:36.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.557+0000 7f4557e00640 1 -- 172.21.15.47:0/3170099744 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f455806ca40 msgr2=0x7f45581f4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:36.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.557+0000 7f4557e00640 1 --2- 172.21.15.47:0/3170099744 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f455806ca40 0x7f45581f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:36.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.557+0000 7f4557e00640 1 -- 172.21.15.47:0/3170099744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f455806d240 msgr2=0x7f45581f6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:36.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.557+0000 7f4557e00640 1 --2- 172.21.15.47:0/3170099744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f455806d240 0x7f45581f6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:36.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.557+0000 7f4557e00640 1 -- 172.21.15.47:0/3170099744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45580c8d40 con 0x7f455815eaa0 2024-05-27T10:52:36.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.557+0000 7f4556a00640 1 --2- 172.21.15.47:0/3170099744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f455806d240 0x7f45581f6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:36.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.557+0000 7f4557e00640 1 --2- 172.21.15.47:0/3170099744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f455815eaa0 0x7f45580b96c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f455000cdb0 tx=0x7f455000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:36.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.557+0000 7f454f400640 1 -- 172.21.15.47:0/3170099744 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455000f680 con 0x7f455815eaa0 2024-05-27T10:52:36.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.557+0000 7f454f400640 1 -- 172.21.15.47:0/3170099744 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f455000f840 con 0x7f455815eaa0 2024-05-27T10:52:36.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.557+0000 7f454f400640 1 -- 172.21.15.47:0/3170099744 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455000fc30 con 0x7f455815eaa0 2024-05-27T10:52:36.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.557+0000 7f455d000640 1 -- 172.21.15.47:0/3170099744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45580b7290 con 0x7f455815eaa0 2024-05-27T10:52:36.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.557+0000 7f455d000640 1 -- 172.21.15.47:0/3170099744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45580b7850 con 0x7f455815eaa0 2024-05-27T10:52:36.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.559+0000 7f455d000640 1 -- 172.21.15.47:0/3170099744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f455804fce0 con 0x7f455815eaa0 2024-05-27T10:52:36.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.560+0000 7f454f400640 1 -- 172.21.15.47:0/3170099744 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f455000e3e0 con 0x7f455815eaa0 2024-05-27T10:52:36.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.561+0000 7f454f400640 1 --2- 172.21.15.47:0/3170099744 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f453406c8f0 0x7f453406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:36.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.561+0000 7f454f400640 1 -- 172.21.15.47:0/3170099744 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f455008c890 con 0x7f455815eaa0 2024-05-27T10:52:36.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.561+0000 7f4557400640 1 --2- 172.21.15.47:0/3170099744 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f453406c8f0 0x7f453406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:36.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.562+0000 7f4557400640 1 --2- 172.21.15.47:0/3170099744 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f453406c8f0 0x7f453406edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4548034000 tx=0x7f454802c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:36.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.565+0000 7f454f400640 1 -- 172.21.15.47:0/3170099744 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4550014030 con 0x7f455815eaa0 2024-05-27T10:52:36.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.770+0000 7f455d000640 1 -- 172.21.15.47:0/3170099744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45580d3cb0 con 0x7f455815eaa0 2024-05-27T10:52:36.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.772+0000 7f454f400640 1 -- 172.21.15.47:0/3170099744 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16521 (secure 0 0 0) 0x7f45500152b0 con 0x7f455815eaa0 2024-05-27T10:52:36.770 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:36.770 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:03.257638+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:52:36.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.775+0000 7f455d000640 1 -- 172.21.15.47:0/3170099744 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f453406c8f0 msgr2=0x7f453406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:36.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.775+0000 7f455d000640 1 --2- 172.21.15.47:0/3170099744 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f453406c8f0 0x7f453406edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4548034000 tx=0x7f454802c000 comp rx=0 tx=0).stop 2024-05-27T10:52:36.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.775+0000 7f455d000640 1 -- 172.21.15.47:0/3170099744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f455815eaa0 msgr2=0x7f45580b96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:36.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.775+0000 7f455d000640 1 --2- 172.21.15.47:0/3170099744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f455815eaa0 0x7f45580b96c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f455000cdb0 tx=0x7f455000a650 comp rx=0 tx=0).stop 2024-05-27T10:52:36.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.775+0000 7f455d000640 1 -- 172.21.15.47:0/3170099744 shutdown_connections 2024-05-27T10:52:36.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.775+0000 7f455d000640 1 --2- 172.21.15.47:0/3170099744 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f453406c8f0 0x7f453406edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:36.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.775+0000 7f455d000640 1 --2- 172.21.15.47:0/3170099744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f455815eaa0 0x7f45580b96c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:36.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.775+0000 7f455d000640 1 --2- 172.21.15.47:0/3170099744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f455806d240 0x7f45581f6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:36.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.775+0000 7f455d000640 1 --2- 172.21.15.47:0/3170099744 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f455806ca40 0x7f45581f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:36.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.775+0000 7f455d000640 1 -- 172.21.15.47:0/3170099744 >> 172.21.15.47:0/3170099744 conn(0x7f455808bfd0 msgr2=0x7f4558161050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:36.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.775+0000 7f455d000640 1 -- 172.21.15.47:0/3170099744 shutdown_connections 2024-05-27T10:52:36.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.775+0000 7f455d000640 1 -- 172.21.15.47:0/3170099744 wait complete. 2024-05-27T10:52:36.793 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T10:51:55.073251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T10:51:59.202702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T10:52:00.664039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T10:52:36.794 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T10:52:36.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.999+0000 7ff1ff200640 1 Processor -- start 2024-05-27T10:52:36.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:36.999+0000 7ff1ff200640 1 -- start start 2024-05-27T10:52:36.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.001+0000 7ff1ff200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff20006da80 0x7ff2000d0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:36.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.001+0000 7ff1ff200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2000d0c70 con 0x7ff20015c510 2024-05-27T10:52:36.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.001+0000 7ff1ff200640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2000b4620 con 0x7ff2000d0860 2024-05-27T10:52:36.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.001+0000 7ff1ff200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff2000b43e0 con 0x7ff20006da80 2024-05-27T10:52:36.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.001+0000 7ff1fde00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff20015c510 0x7ff2000b3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51022/0 (socket says 172.21.15.47:51022) 2024-05-27T10:52:36.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.001+0000 7ff1fde00640 1 -- 172.21.15.47:0/3196826530 learned_addr learned my addr 172.21.15.47:0/3196826530 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:36.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.001+0000 7ff1fd400640 1 --2- 172.21.15.47:0/3196826530 >> v2:172.21.15.47:3300/0 conn(0x7ff20006da80 0x7ff2000d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:37.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.002+0000 7ff1fd400640 1 -- 172.21.15.47:0/3196826530 >> v1:172.21.15.53:6789/0 conn(0x7ff2000d0860 legacy=0x7ff2000ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:37.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.002+0000 7ff1fd400640 1 -- 172.21.15.47:0/3196826530 >> v1:172.21.15.47:6789/0 conn(0x7ff20015c510 legacy=0x7ff2000b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:37.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.002+0000 7ff1fd400640 1 -- 172.21.15.47:0/3196826530 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2000b4900 con 0x7ff20006da80 2024-05-27T10:52:37.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.002+0000 7ff1fca00640 1 -- 172.21.15.47:0/3196826530 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3360178086 0 0) 0x7ff1f0001490 con 0x7ff20015c510 2024-05-27T10:52:37.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.003+0000 7ff1fd400640 1 --2- 172.21.15.47:0/3196826530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff20006da80 0x7ff2000d0320 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80097a0 tx=0x7ff1e802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53027b8dc3f2bccb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:37.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.003+0000 7ff1fca00640 1 -- 172.21.15.47:0/3196826530 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8037070 con 0x7ff20006da80 2024-05-27T10:52:37.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.003+0000 7ff1fca00640 1 -- 172.21.15.47:0/3196826530 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e8032440 con 0x7ff20006da80 2024-05-27T10:52:37.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.003+0000 7ff1fca00640 1 -- 172.21.15.47:0/3196826530 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8032810 con 0x7ff20006da80 2024-05-27T10:52:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.004+0000 7ff1ff200640 1 -- 172.21.15.47:0/3196826530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff20006da80 msgr2=0x7ff2000d0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.004+0000 7ff1ff200640 1 --2- 172.21.15.47:0/3196826530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff20006da80 0x7ff2000d0320 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80097a0 tx=0x7ff1e802a230 comp rx=0 tx=0).stop 2024-05-27T10:52:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.004+0000 7ff1ff200640 1 -- 172.21.15.47:0/3196826530 shutdown_connections 2024-05-27T10:52:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.004+0000 7ff1ff200640 1 --2- 172.21.15.47:0/3196826530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff20006da80 0x7ff2000d0320 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.004+0000 7ff1ff200640 1 -- 172.21.15.47:0/3196826530 >> 172.21.15.47:0/3196826530 conn(0x7ff20006bb20 msgr2=0x7ff20006bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.004+0000 7ff1ff200640 1 -- 172.21.15.47:0/3196826530 shutdown_connections 2024-05-27T10:52:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.004+0000 7ff1ff200640 1 -- 172.21.15.47:0/3196826530 wait complete. 2024-05-27T10:52:37.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.006+0000 7ff1ff200640 1 Processor -- start 2024-05-27T10:52:37.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.006+0000 7ff1ff200640 1 -- start start 2024-05-27T10:52:37.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.007+0000 7ff1ff200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff20006da80 0x7ff20014d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.007+0000 7ff1ff200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff2000d0860 0x7ff20015e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.007+0000 7ff1ff200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff20015c510 0x7ff2000b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.007+0000 7ff1ff200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff20015c8f0 con 0x7ff20006da80 2024-05-27T10:52:37.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.007+0000 7ff1ff200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff2000b4ec0 con 0x7ff20015c510 2024-05-27T10:52:37.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.007+0000 7ff1ff200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff2000cf100 con 0x7ff2000d0860 2024-05-27T10:52:37.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.007+0000 7ff1fde00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff20006da80 0x7ff20014d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:37.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.007+0000 7ff1fde00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff20006da80 0x7ff20014d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37290/0 (socket says 172.21.15.47:37290) 2024-05-27T10:52:37.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.007+0000 7ff1fde00640 1 -- 172.21.15.47:0/1895202747 learned_addr learned my addr 172.21.15.47:0/1895202747 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:37.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.008+0000 7ff1fde00640 1 -- 172.21.15.47:0/1895202747 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff2000d0860 msgr2=0x7ff20015e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:37.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.008+0000 7ff1fde00640 1 --2- 172.21.15.47:0/1895202747 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff2000d0860 0x7ff20015e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.008+0000 7ff1fde00640 1 -- 172.21.15.47:0/1895202747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff20015c510 msgr2=0x7ff2000b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:37.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.008+0000 7ff1fde00640 1 --2- 172.21.15.47:0/1895202747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff20015c510 0x7ff2000b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.008+0000 7ff1fde00640 1 -- 172.21.15.47:0/1895202747 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff200156170 con 0x7ff20006da80 2024-05-27T10:52:37.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.008+0000 7ff1fde00640 1 --2- 172.21.15.47:0/1895202747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff20006da80 0x7ff20014d4e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000c780 tx=0x7ff1f000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:37.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.008+0000 7ff1f6000640 1 -- 172.21.15.47:0/1895202747 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0018070 con 0x7ff20006da80 2024-05-27T10:52:37.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.008+0000 7ff1f6000640 1 -- 172.21.15.47:0/1895202747 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f000a640 con 0x7ff20006da80 2024-05-27T10:52:37.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.008+0000 7ff1f6000640 1 -- 172.21.15.47:0/1895202747 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f000aa70 con 0x7ff20006da80 2024-05-27T10:52:37.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.008+0000 7ff1ff200640 1 -- 172.21.15.47:0/1895202747 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff200156450 con 0x7ff20006da80 2024-05-27T10:52:37.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.008+0000 7ff1ff200640 1 -- 172.21.15.47:0/1895202747 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff200156a10 con 0x7ff20006da80 2024-05-27T10:52:37.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.010+0000 7ff1ff200640 1 -- 172.21.15.47:0/1895202747 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff20004fce0 con 0x7ff20006da80 2024-05-27T10:52:37.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.011+0000 7ff1f6000640 1 -- 172.21.15.47:0/1895202747 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff1f000ac10 con 0x7ff20006da80 2024-05-27T10:52:37.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.011+0000 7ff1f6000640 1 --2- 172.21.15.47:0/1895202747 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff1dc06c8f0 0x7ff1dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.012+0000 7ff1f6000640 1 -- 172.21.15.47:0/1895202747 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff1f008b2a0 con 0x7ff20006da80 2024-05-27T10:52:37.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.012+0000 7ff1fd400640 1 --2- 172.21.15.47:0/1895202747 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff1dc06c8f0 0x7ff1dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:37.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.013+0000 7ff1fd400640 1 --2- 172.21.15.47:0/1895202747 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff1dc06c8f0 0x7ff1dc06edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8034000 tx=0x7ff1e802c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:37.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.017+0000 7ff1f6000640 1 -- 172.21.15.47:0/1895202747 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff2000d0c70 con 0x7ff20006da80 2024-05-27T10:52:37.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.219+0000 7ff1ff200640 1 -- 172.21.15.47:0/1895202747 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff2000ae500 con 0x7ff20006da80 2024-05-27T10:52:37.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.220+0000 7ff1f6000640 1 -- 172.21.15.47:0/1895202747 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7ff1f0059630 con 0x7ff20006da80 2024-05-27T10:52:37.218 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-27T10:52:37.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.222+0000 7ff1ff200640 1 -- 172.21.15.47:0/1895202747 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff1dc06c8f0 msgr2=0x7ff1dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:37.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.222+0000 7ff1ff200640 1 --2- 172.21.15.47:0/1895202747 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff1dc06c8f0 0x7ff1dc06edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8034000 tx=0x7ff1e802c000 comp rx=0 tx=0).stop 2024-05-27T10:52:37.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.222+0000 7ff1ff200640 1 -- 172.21.15.47:0/1895202747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff20006da80 msgr2=0x7ff20014d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:37.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.222+0000 7ff1ff200640 1 --2- 172.21.15.47:0/1895202747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff20006da80 0x7ff20014d4e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000c780 tx=0x7ff1f000cc40 comp rx=0 tx=0).stop 2024-05-27T10:52:37.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.223+0000 7ff1ff200640 1 -- 172.21.15.47:0/1895202747 shutdown_connections 2024-05-27T10:52:37.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.223+0000 7ff1ff200640 1 --2- 172.21.15.47:0/1895202747 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff1dc06c8f0 0x7ff1dc06edb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.223+0000 7ff1ff200640 1 --2- 172.21.15.47:0/1895202747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff20015c510 0x7ff2000b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.223+0000 7ff1ff200640 1 --2- 172.21.15.47:0/1895202747 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff2000d0860 0x7ff20015e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.223+0000 7ff1ff200640 1 --2- 172.21.15.47:0/1895202747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff20006da80 0x7ff20014d4e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.223+0000 7ff1ff200640 1 -- 172.21.15.47:0/1895202747 >> 172.21.15.47:0/1895202747 conn(0x7ff20006bb20 msgr2=0x7ff20006bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:37.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.223+0000 7ff1ff200640 1 -- 172.21.15.47:0/1895202747 shutdown_connections 2024-05-27T10:52:37.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.223+0000 7ff1ff200640 1 -- 172.21.15.47:0/1895202747 wait complete. 2024-05-27T10:52:37.238 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T10:52:37.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.440+0000 7f6130a00640 1 Processor -- start 2024-05-27T10:52:37.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.440+0000 7f6130a00640 1 -- start start 2024-05-27T10:52:37.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.441+0000 7f6130a00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f612c06da80 0x7f612c0d0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.441+0000 7f6130a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f612c0d0c70 con 0x7f612c0d0860 2024-05-27T10:52:37.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.442+0000 7f6130a00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f612c0b4620 con 0x7f612c15c510 2024-05-27T10:52:37.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.442+0000 7f6130a00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f612c0b43e0 con 0x7f612c06da80 2024-05-27T10:52:37.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.442+0000 7f612b200640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f612c0d0860 0x7f612c0ce9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51030/0 (socket says 172.21.15.47:51030) 2024-05-27T10:52:37.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.442+0000 7f612b200640 1 -- 172.21.15.47:0/1375389747 learned_addr learned my addr 172.21.15.47:0/1375389747 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:37.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.442+0000 7f6129e00640 1 --2- 172.21.15.47:0/1375389747 >> v2:172.21.15.53:3300/0 conn(0x7f612c06da80 0x7f612c0d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:37.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.442+0000 7f6129400640 1 -- 172.21.15.47:0/1375389747 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 676655221 0 0) 0x7f6124001490 con 0x7f612c0d0860 2024-05-27T10:52:37.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.443+0000 7f6129400640 1 -- 172.21.15.47:0/1375389747 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6110003520 con 0x7f612c0d0860 2024-05-27T10:52:37.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.443+0000 7f6129400640 1 -- 172.21.15.47:0/1375389747 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3008544921 0 0) 0x7f6110003520 con 0x7f612c0d0860 2024-05-27T10:52:37.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.443+0000 7f6129400640 1 -- 172.21.15.47:0/1375389747 >> v2:172.21.15.53:3300/0 conn(0x7f612c06da80 msgr2=0x7f612c0d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:37.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.443+0000 7f6129400640 1 --2- 172.21.15.47:0/1375389747 >> v2:172.21.15.53:3300/0 conn(0x7f612c06da80 0x7f612c0d0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.443+0000 7f6129400640 1 -- 172.21.15.47:0/1375389747 >> v1:172.21.15.53:6789/0 conn(0x7f612c15c510 legacy=0x7f612c0b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:37.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.443+0000 7f6129400640 1 -- 172.21.15.47:0/1375389747 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612c0b4900 con 0x7f612c0d0860 2024-05-27T10:52:37.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.443+0000 7f6129400640 1 -- 172.21.15.47:0/1375389747 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f6124001bc0 con 0x7f612c0d0860 2024-05-27T10:52:37.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.443+0000 7f6129400640 1 -- 172.21.15.47:0/1375389747 >> v1:172.21.15.47:6789/0 conn(0x7f612c0d0860 legacy=0x7f612c0ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:37.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.443+0000 7f6129400640 1 --2- 172.21.15.47:0/1375389747 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f61100039b0 0x7f6110003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.443+0000 7f6129400640 1 --2- 172.21.15.47:0/1375389747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6110004800 0x7f6110004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.443+0000 7f6129400640 1 --2- 172.21.15.47:0/1375389747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61100051c0 0x7f611000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.443+0000 7f6129400640 1 -- 172.21.15.47:0/1375389747 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f612c0b43e0 con 0x7f6110004800 2024-05-27T10:52:37.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.443+0000 7f6129400640 1 -- 172.21.15.47:0/1375389747 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f611000c060 con 0x7f61100051c0 2024-05-27T10:52:37.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.443+0000 7f6129400640 1 -- 172.21.15.47:0/1375389747 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f611000c260 con 0x7f61100039b0 2024-05-27T10:52:37.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.443+0000 7f6129e00640 1 --2- 172.21.15.47:0/1375389747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6110004800 0x7f6110004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:37.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.444+0000 7f612b200640 1 --2- 172.21.15.47:0/1375389747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61100051c0 0x7f611000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:37.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.444+0000 7f612a800640 1 --2- 172.21.15.47:0/1375389747 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f61100039b0 0x7f6110003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:37.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.444+0000 7f6129e00640 1 -- 172.21.15.47:0/1375389747 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f61100039b0 msgr2=0x7f6110003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:37.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.444+0000 7f6129e00640 1 --2- 172.21.15.47:0/1375389747 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f61100039b0 0x7f6110003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.444+0000 7f6129e00640 1 -- 172.21.15.47:0/1375389747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61100051c0 msgr2=0x7f611000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:37.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.444+0000 7f6129e00640 1 --2- 172.21.15.47:0/1375389747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61100051c0 0x7f611000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.444+0000 7f6129e00640 1 -- 172.21.15.47:0/1375389747 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6110003520 con 0x7f6110004800 2024-05-27T10:52:37.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.444+0000 7f612b200640 1 -- 172.21.15.47:0/1375389747 reap_dead start 2024-05-27T10:52:37.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.445+0000 7f6129e00640 1 --2- 172.21.15.47:0/1375389747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6110004800 0x7f6110004c80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f611c009ac0 tx=0x7f6110005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c62ff9e3d93cb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:37.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.445+0000 7f6129400640 1 -- 172.21.15.47:0/1375389747 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c036070 con 0x7f6110004800 2024-05-27T10:52:37.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.445+0000 7f6129400640 1 -- 172.21.15.47:0/1375389747 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f611c031400 con 0x7f6110004800 2024-05-27T10:52:37.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.445+0000 7f6129400640 1 -- 172.21.15.47:0/1375389747 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c009690 con 0x7f6110004800 2024-05-27T10:52:37.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.446+0000 7f6130a00640 1 -- 172.21.15.47:0/1375389747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6110004800 msgr2=0x7f6110004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:37.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.446+0000 7f6130a00640 1 --2- 172.21.15.47:0/1375389747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6110004800 0x7f6110004c80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f611c009ac0 tx=0x7f6110005830 comp rx=0 tx=0).stop 2024-05-27T10:52:37.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.446+0000 7f6130a00640 1 -- 172.21.15.47:0/1375389747 shutdown_connections 2024-05-27T10:52:37.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.446+0000 7f6130a00640 1 --2- 172.21.15.47:0/1375389747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6110004800 0x7f6110004c80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.446+0000 7f6130a00640 1 -- 172.21.15.47:0/1375389747 >> 172.21.15.47:0/1375389747 conn(0x7f612c06bb20 msgr2=0x7f612c06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:37.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.446+0000 7f6130a00640 1 -- 172.21.15.47:0/1375389747 shutdown_connections 2024-05-27T10:52:37.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.446+0000 7f6130a00640 1 -- 172.21.15.47:0/1375389747 wait complete. 2024-05-27T10:52:37.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.448+0000 7f6130a00640 1 Processor -- start 2024-05-27T10:52:37.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.448+0000 7f6130a00640 1 -- start start 2024-05-27T10:52:37.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.449+0000 7f6130a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6110004800 0x7f612c157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.449+0000 7f6130a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f612c14f2d0 0x7f612c1f4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.449+0000 7f6130a00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f612c159400 0x7f612c159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.449+0000 7f6130a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f612c15c8f0 con 0x7f612c14f2d0 2024-05-27T10:52:37.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.449+0000 7f6130a00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f612c0b4ec0 con 0x7f612c159400 2024-05-27T10:52:37.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.449+0000 7f6130a00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f612c0d0320 con 0x7f6110004800 2024-05-27T10:52:37.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.449+0000 7f6129e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f612c14f2d0 0x7f612c1f4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:37.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.449+0000 7f6129e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f612c14f2d0 0x7f612c1f4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37296/0 (socket says 172.21.15.47:37296) 2024-05-27T10:52:37.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.449+0000 7f6129e00640 1 -- 172.21.15.47:0/2368268691 learned_addr learned my addr 172.21.15.47:0/2368268691 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.450+0000 7f612b200640 1 --2- 172.21.15.47:0/2368268691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f612c159400 0x7f612c159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.450+0000 7f612a800640 1 --2- 172.21.15.47:0/2368268691 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6110004800 0x7f612c157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.450+0000 7f6129e00640 1 -- 172.21.15.47:0/2368268691 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6110004800 msgr2=0x7f612c157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.450+0000 7f6129e00640 1 --2- 172.21.15.47:0/2368268691 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6110004800 0x7f612c157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.450+0000 7f6129e00640 1 -- 172.21.15.47:0/2368268691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f612c159400 msgr2=0x7f612c159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.450+0000 7f6129e00640 1 --2- 172.21.15.47:0/2368268691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f612c159400 0x7f612c159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.450+0000 7f6129e00640 1 -- 172.21.15.47:0/2368268691 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612c1580d0 con 0x7f612c14f2d0 2024-05-27T10:52:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.450+0000 7f612a800640 1 --2- 172.21.15.47:0/2368268691 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6110004800 0x7f612c157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:37.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.450+0000 7f612b200640 1 --2- 172.21.15.47:0/2368268691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f612c159400 0x7f612c159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:37.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.450+0000 7f6129e00640 1 --2- 172.21.15.47:0/2368268691 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f612c14f2d0 0x7f612c1f4630 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f611c009be0 tx=0x7f611c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:37.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.451+0000 7f6122a00640 1 -- 172.21.15.47:0/2368268691 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c03f020 con 0x7f612c14f2d0 2024-05-27T10:52:37.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.451+0000 7f6122a00640 1 -- 172.21.15.47:0/2368268691 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f611c037040 con 0x7f612c14f2d0 2024-05-27T10:52:37.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.451+0000 7f6130a00640 1 -- 172.21.15.47:0/2368268691 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f612c1583b0 con 0x7f612c14f2d0 2024-05-27T10:52:37.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.451+0000 7f6122a00640 1 -- 172.21.15.47:0/2368268691 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c036070 con 0x7f612c14f2d0 2024-05-27T10:52:37.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.451+0000 7f6130a00640 1 -- 172.21.15.47:0/2368268691 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f612c15d2a0 con 0x7f612c14f2d0 2024-05-27T10:52:37.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.452+0000 7f6130a00640 1 -- 172.21.15.47:0/2368268691 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f612c04fce0 con 0x7f612c14f2d0 2024-05-27T10:52:37.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.453+0000 7f6122a00640 1 -- 172.21.15.47:0/2368268691 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f611c042020 con 0x7f612c14f2d0 2024-05-27T10:52:37.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.454+0000 7f6122a00640 1 --2- 172.21.15.47:0/2368268691 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f610806c920 0x7f610806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.454+0000 7f6122a00640 1 -- 172.21.15.47:0/2368268691 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f611c0abca0 con 0x7f612c14f2d0 2024-05-27T10:52:37.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.454+0000 7f612a800640 1 --2- 172.21.15.47:0/2368268691 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f610806c920 0x7f610806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:37.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.455+0000 7f612a800640 1 --2- 172.21.15.47:0/2368268691 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f610806c920 0x7f610806ede0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f612c0515e0 tx=0x7f6114009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:37.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.458+0000 7f6122a00640 1 -- 172.21.15.47:0/2368268691 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f611c049030 con 0x7f612c14f2d0 2024-05-27T10:52:37.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.663+0000 7f6130a00640 1 -- 172.21.15.47:0/2368268691 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f612c0ce430 con 0x7f612c14f2d0 2024-05-27T10:52:37.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.665+0000 7f6122a00640 1 -- 172.21.15.47:0/2368268691 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f611c07a0f0 con 0x7f612c14f2d0 2024-05-27T10:52:37.662 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-27T10:52:37.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.667+0000 7f6130a00640 1 -- 172.21.15.47:0/2368268691 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f610806c920 msgr2=0x7f610806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:37.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.667+0000 7f6130a00640 1 --2- 172.21.15.47:0/2368268691 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f610806c920 0x7f610806ede0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f612c0515e0 tx=0x7f6114009040 comp rx=0 tx=0).stop 2024-05-27T10:52:37.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.667+0000 7f6130a00640 1 -- 172.21.15.47:0/2368268691 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f612c14f2d0 msgr2=0x7f612c1f4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:37.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.667+0000 7f6130a00640 1 --2- 172.21.15.47:0/2368268691 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f612c14f2d0 0x7f612c1f4630 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f611c009be0 tx=0x7f611c004730 comp rx=0 tx=0).stop 2024-05-27T10:52:37.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.667+0000 7f6130a00640 1 -- 172.21.15.47:0/2368268691 shutdown_connections 2024-05-27T10:52:37.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.667+0000 7f6130a00640 1 --2- 172.21.15.47:0/2368268691 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f610806c920 0x7f610806ede0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.667+0000 7f6130a00640 1 --2- 172.21.15.47:0/2368268691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f612c159400 0x7f612c159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.667+0000 7f6130a00640 1 --2- 172.21.15.47:0/2368268691 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f612c14f2d0 0x7f612c1f4630 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.667+0000 7f6130a00640 1 --2- 172.21.15.47:0/2368268691 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6110004800 0x7f612c157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.667+0000 7f6130a00640 1 -- 172.21.15.47:0/2368268691 >> 172.21.15.47:0/2368268691 conn(0x7f612c06bb20 msgr2=0x7f612c160050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:37.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.667+0000 7f6130a00640 1 -- 172.21.15.47:0/2368268691 shutdown_connections 2024-05-27T10:52:37.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.668+0000 7f6130a00640 1 -- 172.21.15.47:0/2368268691 wait complete. 2024-05-27T10:52:37.685 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T10:52:37.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.891+0000 7f6c56000640 1 Processor -- start 2024-05-27T10:52:37.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.892+0000 7f6c56000640 1 -- start start 2024-05-27T10:52:37.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.893+0000 7f6c56000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c5015c510 0x7f6c500b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.893+0000 7f6c56000640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6c500d0a30 0x7f6c500ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.893+0000 7f6c56000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c500b4620 con 0x7f6c5006da80 2024-05-27T10:52:37.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.893+0000 7f6c56000640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f6c500b4900 con 0x7f6c500d0a30 2024-05-27T10:52:37.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.893+0000 7f6c56000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f6c500b4be0 con 0x7f6c5015c510 2024-05-27T10:52:37.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.894+0000 7f6c4fe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f6c5006da80 0x7f6c500d0320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51036/0 (socket says 172.21.15.47:51036) 2024-05-27T10:52:37.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.894+0000 7f6c4fe00640 1 -- 172.21.15.47:0/3228625465 learned_addr learned my addr 172.21.15.47:0/3228625465 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:37.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.894+0000 7f6c55600640 1 --2- 172.21.15.47:0/3228625465 >> v2:172.21.15.53:3300/0 conn(0x7f6c500d0a30 0x7f6c500ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:37.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.894+0000 7f6c54c00640 1 --2- 172.21.15.47:0/3228625465 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c5015c510 0x7f6c500b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:37.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.894+0000 7f6c4f400640 1 -- 172.21.15.47:0/3228625465 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2617538074 0 0) 0x7f6c500b4620 con 0x7f6c5006da80 2024-05-27T10:52:37.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.894+0000 7f6c4f400640 1 -- 172.21.15.47:0/3228625465 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c38003520 con 0x7f6c5006da80 2024-05-27T10:52:37.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.894+0000 7f6c4f400640 1 -- 172.21.15.47:0/3228625465 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2978394946 0 0) 0x7f6c38003520 con 0x7f6c5006da80 2024-05-27T10:52:37.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.894+0000 7f6c4f400640 1 -- 172.21.15.47:0/3228625465 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c5015c510 msgr2=0x7f6c500b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:37.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.894+0000 7f6c4f400640 1 --2- 172.21.15.47:0/3228625465 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c5015c510 0x7f6c500b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.894+0000 7f6c4f400640 1 -- 172.21.15.47:0/3228625465 >> v2:172.21.15.53:3300/0 conn(0x7f6c500d0a30 msgr2=0x7f6c500ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.894+0000 7f6c4f400640 1 --2- 172.21.15.47:0/3228625465 >> v2:172.21.15.53:3300/0 conn(0x7f6c500d0a30 0x7f6c500ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.895+0000 7f6c4f400640 1 -- 172.21.15.47:0/3228625465 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c500b4ec0 con 0x7f6c5006da80 2024-05-27T10:52:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.895+0000 7f6c4f400640 1 -- 172.21.15.47:0/3228625465 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f6c3c001670 con 0x7f6c5006da80 2024-05-27T10:52:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.895+0000 7f6c4f400640 1 -- 172.21.15.47:0/3228625465 >> v1:172.21.15.47:6789/0 conn(0x7f6c5006da80 legacy=0x7f6c500d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.895+0000 7f6c4f400640 1 --2- 172.21.15.47:0/3228625465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c380039b0 0x7f6c38003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.895+0000 7f6c4f400640 1 --2- 172.21.15.47:0/3228625465 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c5015c510 0x7f6c38004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.895+0000 7f6c4f400640 1 --2- 172.21.15.47:0/3228625465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c38004d40 0x7f6c380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.895+0000 7f6c4f400640 1 -- 172.21.15.47:0/3228625465 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6c500b4900 con 0x7f6c380039b0 2024-05-27T10:52:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.895+0000 7f6c4f400640 1 -- 172.21.15.47:0/3228625465 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6c500b4be0 con 0x7f6c38004d40 2024-05-27T10:52:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.895+0000 7f6c4f400640 1 -- 172.21.15.47:0/3228625465 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f6c3800b9c0 con 0x7f6c5015c510 2024-05-27T10:52:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.895+0000 7f6c54c00640 1 --2- 172.21.15.47:0/3228625465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c380039b0 0x7f6c38003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.895+0000 7f6c54c00640 1 -- 172.21.15.47:0/3228625465 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c5015c510 msgr2=0x7f6c38004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.895+0000 7f6c54c00640 1 --2- 172.21.15.47:0/3228625465 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c5015c510 0x7f6c38004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.895+0000 7f6c54c00640 1 -- 172.21.15.47:0/3228625465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c38004d40 msgr2=0x7f6c380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:37.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.895+0000 7f6c54c00640 1 --2- 172.21.15.47:0/3228625465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c38004d40 0x7f6c380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.895+0000 7f6c54c00640 1 -- 172.21.15.47:0/3228625465 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c38003520 con 0x7f6c380039b0 2024-05-27T10:52:37.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.896+0000 7f6c54c00640 1 --2- 172.21.15.47:0/3228625465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c380039b0 0x7f6c38003dd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009ac0 tx=0x7f6c38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0507174c1688b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:37.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.897+0000 7f6c4f400640 1 -- 172.21.15.47:0/3228625465 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c44036070 con 0x7f6c380039b0 2024-05-27T10:52:37.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.897+0000 7f6c4f400640 1 -- 172.21.15.47:0/3228625465 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c44031400 con 0x7f6c380039b0 2024-05-27T10:52:37.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.897+0000 7f6c4f400640 1 -- 172.21.15.47:0/3228625465 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c44009690 con 0x7f6c380039b0 2024-05-27T10:52:37.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.897+0000 7f6c56000640 1 -- 172.21.15.47:0/3228625465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c380039b0 msgr2=0x7f6c38003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:37.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.897+0000 7f6c56000640 1 --2- 172.21.15.47:0/3228625465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c380039b0 0x7f6c38003dd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009ac0 tx=0x7f6c38005830 comp rx=0 tx=0).stop 2024-05-27T10:52:37.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.897+0000 7f6c55600640 1 -- 172.21.15.47:0/3228625465 reap_dead start 2024-05-27T10:52:37.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.897+0000 7f6c56000640 1 -- 172.21.15.47:0/3228625465 shutdown_connections 2024-05-27T10:52:37.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.897+0000 7f6c56000640 1 -- 172.21.15.47:0/3228625465 >> 172.21.15.47:0/3228625465 conn(0x7f6c5006bb20 msgr2=0x7f6c5006bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:37.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.897+0000 7f6c56000640 1 -- 172.21.15.47:0/3228625465 shutdown_connections 2024-05-27T10:52:37.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.897+0000 7f6c56000640 1 -- 172.21.15.47:0/3228625465 wait complete. 2024-05-27T10:52:37.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.899+0000 7f6c56000640 1 Processor -- start 2024-05-27T10:52:37.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.899+0000 7f6c56000640 1 -- start start 2024-05-27T10:52:37.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.900+0000 7f6c56000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c380039b0 0x7f6c50099890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.900+0000 7f6c56000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c500b0d50 0x7f6c500b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.900+0000 7f6c56000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c501e6240 0x7f6c501e66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.900+0000 7f6c56000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6c500b3e50 con 0x7f6c380039b0 2024-05-27T10:52:37.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.900+0000 7f6c56000640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6c500b3cd0 con 0x7f6c500b0d50 2024-05-27T10:52:37.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.900+0000 7f6c56000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f6c500b3fd0 con 0x7f6c501e6240 2024-05-27T10:52:37.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.900+0000 7f6c54c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c380039b0 0x7f6c50099890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:37.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.900+0000 7f6c54c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c380039b0 0x7f6c50099890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37308/0 (socket says 172.21.15.47:37308) 2024-05-27T10:52:37.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.900+0000 7f6c54c00640 1 -- 172.21.15.47:0/3567292703 learned_addr learned my addr 172.21.15.47:0/3567292703 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:37.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.901+0000 7f6c4fe00640 1 --2- 172.21.15.47:0/3567292703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c500b0d50 0x7f6c500b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:37.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.901+0000 7f6c54c00640 1 -- 172.21.15.47:0/3567292703 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c501e6240 msgr2=0x7f6c501e66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:37.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.901+0000 7f6c54c00640 1 --2- 172.21.15.47:0/3567292703 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c501e6240 0x7f6c501e66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.901+0000 7f6c54c00640 1 -- 172.21.15.47:0/3567292703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c500b0d50 msgr2=0x7f6c500b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:37.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.901+0000 7f6c54c00640 1 --2- 172.21.15.47:0/3567292703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c500b0d50 0x7f6c500b11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:37.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.901+0000 7f6c54c00640 1 -- 172.21.15.47:0/3567292703 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c501e7010 con 0x7f6c380039b0 2024-05-27T10:52:37.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.901+0000 7f6c4fe00640 1 --2- 172.21.15.47:0/3567292703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c500b0d50 0x7f6c500b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:37.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.901+0000 7f6c54c00640 1 --2- 172.21.15.47:0/3567292703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c380039b0 0x7f6c50099890 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009be0 tx=0x7f6c44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:37.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.902+0000 7f6c4cc00640 1 -- 172.21.15.47:0/3567292703 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c44040020 con 0x7f6c380039b0 2024-05-27T10:52:37.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.902+0000 7f6c4cc00640 1 -- 172.21.15.47:0/3567292703 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c44003b40 con 0x7f6c380039b0 2024-05-27T10:52:37.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.902+0000 7f6c4cc00640 1 -- 172.21.15.47:0/3567292703 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c44036040 con 0x7f6c380039b0 2024-05-27T10:52:37.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.902+0000 7f6c56000640 1 -- 172.21.15.47:0/3567292703 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c501e72f0 con 0x7f6c380039b0 2024-05-27T10:52:37.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.902+0000 7f6c56000640 1 -- 172.21.15.47:0/3567292703 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c501e78b0 con 0x7f6c380039b0 2024-05-27T10:52:37.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.903+0000 7f6c56000640 1 -- 172.21.15.47:0/3567292703 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c5004fce0 con 0x7f6c380039b0 2024-05-27T10:52:37.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.904+0000 7f6c4cc00640 1 -- 172.21.15.47:0/3567292703 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c44043020 con 0x7f6c380039b0 2024-05-27T10:52:37.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.905+0000 7f6c4cc00640 1 --2- 172.21.15.47:0/3567292703 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6c3006c8f0 0x7f6c3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:37.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.905+0000 7f6c4cc00640 1 -- 172.21.15.47:0/3567292703 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6c440abbe0 con 0x7f6c380039b0 2024-05-27T10:52:37.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.905+0000 7f6c4fe00640 1 --2- 172.21.15.47:0/3567292703 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6c3006c8f0 0x7f6c3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:37.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.906+0000 7f6c4fe00640 1 --2- 172.21.15.47:0/3567292703 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6c3006c8f0 0x7f6c3006edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6c501514c0 tx=0x7f6c3c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:37.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:37.909+0000 7f6c4cc00640 1 -- 172.21.15.47:0/3567292703 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6c4404a070 con 0x7f6c380039b0 2024-05-27T10:52:38.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.108+0000 7f6c56000640 1 -- 172.21.15.47:0/3567292703 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6c500ce430 con 0x7f6c380039b0 2024-05-27T10:52:38.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.109+0000 7f6c4cc00640 1 -- 172.21.15.47:0/3567292703 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f6c440044e0 con 0x7f6c380039b0 2024-05-27T10:52:38.107 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-27T10:52:38.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.111+0000 7f6c56000640 1 -- 172.21.15.47:0/3567292703 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6c3006c8f0 msgr2=0x7f6c3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:38.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.111+0000 7f6c56000640 1 --2- 172.21.15.47:0/3567292703 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6c3006c8f0 0x7f6c3006edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6c501514c0 tx=0x7f6c3c009040 comp rx=0 tx=0).stop 2024-05-27T10:52:38.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.111+0000 7f6c56000640 1 -- 172.21.15.47:0/3567292703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c380039b0 msgr2=0x7f6c50099890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:38.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.111+0000 7f6c56000640 1 --2- 172.21.15.47:0/3567292703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c380039b0 0x7f6c50099890 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009be0 tx=0x7f6c44004730 comp rx=0 tx=0).stop 2024-05-27T10:52:38.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.111+0000 7f6c56000640 1 -- 172.21.15.47:0/3567292703 shutdown_connections 2024-05-27T10:52:38.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.111+0000 7f6c56000640 1 --2- 172.21.15.47:0/3567292703 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6c3006c8f0 0x7f6c3006edb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:38.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.111+0000 7f6c56000640 1 --2- 172.21.15.47:0/3567292703 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c501e6240 0x7f6c501e66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:38.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.111+0000 7f6c56000640 1 --2- 172.21.15.47:0/3567292703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c500b0d50 0x7f6c500b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:38.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.111+0000 7f6c56000640 1 --2- 172.21.15.47:0/3567292703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c380039b0 0x7f6c50099890 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:38.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.111+0000 7f6c56000640 1 -- 172.21.15.47:0/3567292703 >> 172.21.15.47:0/3567292703 conn(0x7f6c5006bb20 msgr2=0x7f6c500ce8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:38.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.112+0000 7f6c56000640 1 -- 172.21.15.47:0/3567292703 shutdown_connections 2024-05-27T10:52:38.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.112+0000 7f6c56000640 1 -- 172.21.15.47:0/3567292703 wait complete. 2024-05-27T10:52:38.127 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:52:38.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.333+0000 7f05ade00640 1 Processor -- start 2024-05-27T10:52:38.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.333+0000 7f05ade00640 1 -- start start 2024-05-27T10:52:38.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.335+0000 7f05ade00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05a815c520 0x7f05a80c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:38.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.335+0000 7f05ade00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f05a8160130 0x7f05a8160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:38.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.335+0000 7f05ade00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05a8160a80 con 0x7f05a8070480 2024-05-27T10:52:38.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.335+0000 7f05ade00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f05a80708a0 con 0x7f05a8160130 2024-05-27T10:52:38.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.335+0000 7f05ade00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f05a809aee0 con 0x7f05a815c520 2024-05-27T10:52:38.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.335+0000 7f05a7e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f05a8070480 0x7f05a80d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51052/0 (socket says 172.21.15.47:51052) 2024-05-27T10:52:38.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.335+0000 7f05a7e00640 1 -- 172.21.15.47:0/3192626870 learned_addr learned my addr 172.21.15.47:0/3192626870 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:38.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.335+0000 7f05ad400640 1 --2- 172.21.15.47:0/3192626870 >> v2:172.21.15.47:3300/0 conn(0x7f05a8160130 0x7f05a8160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:38.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.335+0000 7f05aca00640 1 --2- 172.21.15.47:0/3192626870 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05a815c520 0x7f05a80c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:38.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.335+0000 7f05a7400640 1 -- 172.21.15.47:0/3192626870 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2050580646 0 0) 0x7f0594001110 con 0x7f05a8070480 2024-05-27T10:52:38.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.336+0000 7f05a7400640 1 -- 172.21.15.47:0/3192626870 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f058c003520 con 0x7f05a8070480 2024-05-27T10:52:38.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.336+0000 7f05ad400640 1 -- 172.21.15.47:0/3192626870 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05a815c520 msgr2=0x7f05a80c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:38.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.336+0000 7f05ad400640 1 --2- 172.21.15.47:0/3192626870 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05a815c520 0x7f05a80c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:38.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.336+0000 7f05ad400640 1 -- 172.21.15.47:0/3192626870 >> v1:172.21.15.47:6789/0 conn(0x7f05a8070480 legacy=0x7f05a80d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:38.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.336+0000 7f05ad400640 1 -- 172.21.15.47:0/3192626870 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a80c91b0 con 0x7f05a8160130 2024-05-27T10:52:38.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.337+0000 7f05ad400640 1 --2- 172.21.15.47:0/3192626870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a8160130 0x7f05a8160540 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f05a00097a0 tx=0x7f05a002a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c886c7e4ef435560 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:38.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.337+0000 7f05a7400640 1 -- 172.21.15.47:0/3192626870 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a0037070 con 0x7f05a8160130 2024-05-27T10:52:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.337+0000 7f05a7400640 1 -- 172.21.15.47:0/3192626870 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a002ae40 con 0x7f05a8160130 2024-05-27T10:52:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.337+0000 7f05a7400640 1 -- 172.21.15.47:0/3192626870 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a0032660 con 0x7f05a8160130 2024-05-27T10:52:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.338+0000 7f05ade00640 1 -- 172.21.15.47:0/3192626870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a8160130 msgr2=0x7f05a8160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.338+0000 7f05ade00640 1 --2- 172.21.15.47:0/3192626870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a8160130 0x7f05a8160540 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f05a00097a0 tx=0x7f05a002a0f0 comp rx=0 tx=0).stop 2024-05-27T10:52:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.338+0000 7f05ade00640 1 -- 172.21.15.47:0/3192626870 shutdown_connections 2024-05-27T10:52:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.338+0000 7f05ade00640 1 --2- 172.21.15.47:0/3192626870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a8160130 0x7f05a8160540 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.338+0000 7f05ade00640 1 --2- 172.21.15.47:0/3192626870 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05a815c520 0x7f05a80c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.338+0000 7f05ade00640 1 -- 172.21.15.47:0/3192626870 >> 172.21.15.47:0/3192626870 conn(0x7f05a80d2320 msgr2=0x7f05a80d2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.338+0000 7f05ade00640 1 -- 172.21.15.47:0/3192626870 shutdown_connections 2024-05-27T10:52:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.338+0000 7f05ade00640 1 -- 172.21.15.47:0/3192626870 wait complete. 2024-05-27T10:52:38.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.339+0000 7f05ade00640 1 Processor -- start 2024-05-27T10:52:38.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.340+0000 7f05ade00640 1 -- start start 2024-05-27T10:52:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.340+0000 7f05ade00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05a8070480 0x7f05a80ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.341+0000 7f05ade00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a815c520 0x7f05a806e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.341+0000 7f05ade00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05a8160130 0x7f05a80b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.341+0000 7f05ade00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f05a809ab70 con 0x7f05a815c520 2024-05-27T10:52:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.341+0000 7f05ade00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f05a8070dd0 con 0x7f05a8160130 2024-05-27T10:52:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.341+0000 7f05ade00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f05a80710b0 con 0x7f05a8070480 2024-05-27T10:52:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.341+0000 7f05a7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a815c520 0x7f05a806e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.341+0000 7f05a7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a815c520 0x7f05a806e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37338/0 (socket says 172.21.15.47:37338) 2024-05-27T10:52:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.341+0000 7f05a7e00640 1 -- 172.21.15.47:0/1476623929 learned_addr learned my addr 172.21.15.47:0/1476623929 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:38.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.341+0000 7f05ad400640 1 --2- 172.21.15.47:0/1476623929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05a8160130 0x7f05a80b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:38.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.341+0000 7f05aca00640 1 --2- 172.21.15.47:0/1476623929 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05a8070480 0x7f05a80ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.341+0000 7f05a7e00640 1 -- 172.21.15.47:0/1476623929 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05a8070480 msgr2=0x7f05a80ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.341+0000 7f05a7e00640 1 --2- 172.21.15.47:0/1476623929 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05a8070480 0x7f05a80ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.341+0000 7f05a7e00640 1 -- 172.21.15.47:0/1476623929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05a8160130 msgr2=0x7f05a80b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.341+0000 7f05a7e00640 1 --2- 172.21.15.47:0/1476623929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05a8160130 0x7f05a80b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.341+0000 7f05a7e00640 1 -- 172.21.15.47:0/1476623929 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a80c9640 con 0x7f05a815c520 2024-05-27T10:52:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.341+0000 7f05ad400640 1 --2- 172.21.15.47:0/1476623929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05a8160130 0x7f05a80b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.342+0000 7f05a7e00640 1 --2- 172.21.15.47:0/1476623929 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a815c520 0x7f05a806e3a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f059400c3d0 tx=0x7f059400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.342+0000 7f05a4c00640 1 -- 172.21.15.47:0/1476623929 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0594017070 con 0x7f05a815c520 2024-05-27T10:52:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.342+0000 7f05a4c00640 1 -- 172.21.15.47:0/1476623929 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0594005ce0 con 0x7f05a815c520 2024-05-27T10:52:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.342+0000 7f05a4c00640 1 -- 172.21.15.47:0/1476623929 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0594007310 con 0x7f05a815c520 2024-05-27T10:52:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.342+0000 7f05ade00640 1 -- 172.21.15.47:0/1476623929 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a80c9920 con 0x7f05a815c520 2024-05-27T10:52:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.342+0000 7f05ade00640 1 -- 172.21.15.47:0/1476623929 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a806e8e0 con 0x7f05a815c520 2024-05-27T10:52:38.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.343+0000 7f05ade00640 1 -- 172.21.15.47:0/1476623929 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a80c93d0 con 0x7f05a815c520 2024-05-27T10:52:38.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.344+0000 7f05a4c00640 1 -- 172.21.15.47:0/1476623929 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f059401a070 con 0x7f05a815c520 2024-05-27T10:52:38.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.345+0000 7f05a4c00640 1 --2- 172.21.15.47:0/1476623929 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f058806c8f0 0x7f058806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:38.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.345+0000 7f05a4c00640 1 -- 172.21.15.47:0/1476623929 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f059408b060 con 0x7f05a815c520 2024-05-27T10:52:38.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.346+0000 7f05aca00640 1 --2- 172.21.15.47:0/1476623929 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f058806c8f0 0x7f058806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:38.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.346+0000 7f05aca00640 1 --2- 172.21.15.47:0/1476623929 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f058806c8f0 0x7f058806edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0598009f30 tx=0x7f059800b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:38.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.350+0000 7f05a4c00640 1 -- 172.21.15.47:0/1476623929 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f05a8160a80 con 0x7f05a815c520 2024-05-27T10:52:38.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.556+0000 7f05ade00640 1 -- 172.21.15.47:0/1476623929 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05a80d2f80 con 0x7f05a815c520 2024-05-27T10:52:38.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.559+0000 7f05a4c00640 1 -- 172.21.15.47:0/1476623929 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16521 (secure 0 0 0) 0x7f0594059360 con 0x7f05a815c520 2024-05-27T10:52:38.557 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:38.558 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:03.257638+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:52:38.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.562+0000 7f05ade00640 1 -- 172.21.15.47:0/1476623929 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f058806c8f0 msgr2=0x7f058806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:38.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.562+0000 7f05ade00640 1 --2- 172.21.15.47:0/1476623929 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f058806c8f0 0x7f058806edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0598009f30 tx=0x7f059800b040 comp rx=0 tx=0).stop 2024-05-27T10:52:38.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.562+0000 7f05ade00640 1 -- 172.21.15.47:0/1476623929 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a815c520 msgr2=0x7f05a806e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:38.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.562+0000 7f05ade00640 1 --2- 172.21.15.47:0/1476623929 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a815c520 0x7f05a806e3a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f059400c3d0 tx=0x7f059400c890 comp rx=0 tx=0).stop 2024-05-27T10:52:38.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.562+0000 7f05ade00640 1 -- 172.21.15.47:0/1476623929 shutdown_connections 2024-05-27T10:52:38.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.562+0000 7f05ade00640 1 --2- 172.21.15.47:0/1476623929 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f058806c8f0 0x7f058806edb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:38.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.562+0000 7f05ade00640 1 --2- 172.21.15.47:0/1476623929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05a8160130 0x7f05a80b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:38.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.562+0000 7f05ade00640 1 --2- 172.21.15.47:0/1476623929 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a815c520 0x7f05a806e3a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:38.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.562+0000 7f05ade00640 1 --2- 172.21.15.47:0/1476623929 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05a8070480 0x7f05a80ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:38.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.562+0000 7f05ade00640 1 -- 172.21.15.47:0/1476623929 >> 172.21.15.47:0/1476623929 conn(0x7f05a80d2320 msgr2=0x7f05a80d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:38.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.562+0000 7f05ade00640 1 -- 172.21.15.47:0/1476623929 shutdown_connections 2024-05-27T10:52:38.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.562+0000 7f05ade00640 1 -- 172.21.15.47:0/1476623929 wait complete. 2024-05-27T10:52:38.581 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T10:51:55.073251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T10:51:59.202702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T10:52:00.664039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T10:52:38.581 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T10:52:38.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.801+0000 7ffb76c00640 1 Processor -- start 2024-05-27T10:52:38.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.802+0000 7ffb76c00640 1 -- start start 2024-05-27T10:52:38.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.804+0000 7ffb76c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb7015ea00 0x7ffb700d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:38.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.804+0000 7ffb76c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ffb70162c90 0x7ffb7006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:38.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.804+0000 7ffb76c00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb700cf4c0 con 0x7ffb700d2f90 2024-05-27T10:52:38.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.804+0000 7ffb76c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ffb700cf760 con 0x7ffb70162c90 2024-05-27T10:52:38.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.804+0000 7ffb76c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ffb700cfa40 con 0x7ffb7015ea00 2024-05-27T10:52:38.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.804+0000 7ffb74c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ffb70162c90 0x7ffb7006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:38.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.804+0000 7ffb74c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ffb70162c90 0x7ffb7006cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37340/0 (socket says 172.21.15.47:37340) 2024-05-27T10:52:38.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.804+0000 7ffb74c00640 1 -- 172.21.15.47:0/162488474 learned_addr learned my addr 172.21.15.47:0/162488474 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:38.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.804+0000 7ffb6fe00640 1 --2- 172.21.15.47:0/162488474 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb7015ea00 0x7ffb700d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:38.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.805+0000 7ffb74c00640 1 -- 172.21.15.47:0/162488474 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb7015ea00 msgr2=0x7ffb700d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:38.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.805+0000 7ffb74c00640 1 --2- 172.21.15.47:0/162488474 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb7015ea00 0x7ffb700d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:38.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.805+0000 7ffb74c00640 1 -- 172.21.15.47:0/162488474 >> v1:172.21.15.53:6789/0 conn(0x7ffb700d2f90 legacy=0x7ffb70162580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:38.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.805+0000 7ffb74c00640 1 -- 172.21.15.47:0/162488474 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb700cfd20 con 0x7ffb70162c90 2024-05-27T10:52:38.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.806+0000 7ffb74c00640 1 --2- 172.21.15.47:0/162488474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb70162c90 0x7ffb7006cab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009e50 tx=0x7ffb6802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6c8746809c02f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:38.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.806+0000 7ffb6ea00640 1 -- 172.21.15.47:0/162488474 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb68036070 con 0x7ffb70162c90 2024-05-27T10:52:38.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.806+0000 7ffb6ea00640 1 -- 172.21.15.47:0/162488474 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb68031600 con 0x7ffb70162c90 2024-05-27T10:52:38.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.806+0000 7ffb6ea00640 1 -- 172.21.15.47:0/162488474 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb680319d0 con 0x7ffb70162c90 2024-05-27T10:52:38.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.807+0000 7ffb76c00640 1 -- 172.21.15.47:0/162488474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb70162c90 msgr2=0x7ffb7006cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:38.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.807+0000 7ffb76c00640 1 --2- 172.21.15.47:0/162488474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb70162c90 0x7ffb7006cab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009e50 tx=0x7ffb6802a710 comp rx=0 tx=0).stop 2024-05-27T10:52:38.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.807+0000 7ffb76c00640 1 -- 172.21.15.47:0/162488474 shutdown_connections 2024-05-27T10:52:38.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.807+0000 7ffb76c00640 1 --2- 172.21.15.47:0/162488474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb70162c90 0x7ffb7006cab0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:38.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.807+0000 7ffb76c00640 1 --2- 172.21.15.47:0/162488474 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb7015ea00 0x7ffb700d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:38.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.807+0000 7ffb76c00640 1 -- 172.21.15.47:0/162488474 >> 172.21.15.47:0/162488474 conn(0x7ffb7008bfd0 msgr2=0x7ffb700d4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:38.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.807+0000 7ffb76c00640 1 -- 172.21.15.47:0/162488474 shutdown_connections 2024-05-27T10:52:38.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.807+0000 7ffb76c00640 1 -- 172.21.15.47:0/162488474 wait complete. 2024-05-27T10:52:38.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.809+0000 7ffb76c00640 1 Processor -- start 2024-05-27T10:52:38.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.809+0000 7ffb76c00640 1 -- start start 2024-05-27T10:52:38.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.810+0000 7ffb76c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb700d2f90 0x7ffb7015d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:38.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.810+0000 7ffb76c00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb7015ea00 0x7ffb70161130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:38.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.810+0000 7ffb76c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb70162c90 0x7ffb70161670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:38.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.810+0000 7ffb76c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffb700d0a60 con 0x7ffb70162c90 2024-05-27T10:52:38.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.810+0000 7ffb76c00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7015ede0 con 0x7ffb7015ea00 2024-05-27T10:52:38.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.810+0000 7ffb76c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ffb70163200 con 0x7ffb700d2f90 2024-05-27T10:52:38.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.811+0000 7ffb74c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb70162c90 0x7ffb70161670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:38.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.811+0000 7ffb74c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb70162c90 0x7ffb70161670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37356/0 (socket says 172.21.15.47:37356) 2024-05-27T10:52:38.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.811+0000 7ffb74c00640 1 -- 172.21.15.47:0/4186092840 learned_addr learned my addr 172.21.15.47:0/4186092840 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:38.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.811+0000 7ffb6fe00640 1 --2- 172.21.15.47:0/4186092840 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb700d2f90 0x7ffb7015d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:38.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.811+0000 7ffb74c00640 1 -- 172.21.15.47:0/4186092840 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb700d2f90 msgr2=0x7ffb7015d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:38.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.811+0000 7ffb6f400640 1 --2- 172.21.15.47:0/4186092840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb7015ea00 0x7ffb70161130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:38.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.811+0000 7ffb74c00640 1 --2- 172.21.15.47:0/4186092840 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb700d2f90 0x7ffb7015d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:38.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.811+0000 7ffb74c00640 1 -- 172.21.15.47:0/4186092840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb7015ea00 msgr2=0x7ffb70161130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:38.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.811+0000 7ffb74c00640 1 --2- 172.21.15.47:0/4186092840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb7015ea00 0x7ffb70161130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:38.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.811+0000 7ffb74c00640 1 -- 172.21.15.47:0/4186092840 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb700b72a0 con 0x7ffb70162c90 2024-05-27T10:52:38.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.811+0000 7ffb6f400640 1 --2- 172.21.15.47:0/4186092840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb7015ea00 0x7ffb70161130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:38.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.811+0000 7ffb74c00640 1 --2- 172.21.15.47:0/4186092840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb70162c90 0x7ffb70161670 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009f70 tx=0x7ffb68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:38.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.812+0000 7ffb67e00640 1 -- 172.21.15.47:0/4186092840 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6803f020 con 0x7ffb70162c90 2024-05-27T10:52:38.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.812+0000 7ffb67e00640 1 -- 172.21.15.47:0/4186092840 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb68037040 con 0x7ffb70162c90 2024-05-27T10:52:38.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.812+0000 7ffb67e00640 1 -- 172.21.15.47:0/4186092840 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb68036070 con 0x7ffb70162c90 2024-05-27T10:52:38.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.812+0000 7ffb76c00640 1 -- 172.21.15.47:0/4186092840 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb700ba0d0 con 0x7ffb70162c90 2024-05-27T10:52:38.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.812+0000 7ffb76c00640 1 -- 172.21.15.47:0/4186092840 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb700b7820 con 0x7ffb70162c90 2024-05-27T10:52:38.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.813+0000 7ffb76c00640 1 -- 172.21.15.47:0/4186092840 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb7004fdc0 con 0x7ffb70162c90 2024-05-27T10:52:38.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.814+0000 7ffb67e00640 1 -- 172.21.15.47:0/4186092840 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffb68042020 con 0x7ffb70162c90 2024-05-27T10:52:38.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.815+0000 7ffb67e00640 1 --2- 172.21.15.47:0/4186092840 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ffb5006c8f0 0x7ffb5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:38.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.815+0000 7ffb67e00640 1 -- 172.21.15.47:0/4186092840 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffb680ac150 con 0x7ffb70162c90 2024-05-27T10:52:38.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.816+0000 7ffb6fe00640 1 --2- 172.21.15.47:0/4186092840 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ffb5006c8f0 0x7ffb5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:38.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.816+0000 7ffb6fe00640 1 --2- 172.21.15.47:0/4186092840 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ffb5006c8f0 0x7ffb5006edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffb60006fd0 tx=0x7ffb60008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:38.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:38.820+0000 7ffb67e00640 1 -- 172.21.15.47:0/4186092840 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffb68049030 con 0x7ffb70162c90 2024-05-27T10:52:39.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.025+0000 7ffb76c00640 1 -- 172.21.15.47:0/4186092840 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ffb700ba600 con 0x7ffb70162c90 2024-05-27T10:52:39.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.026+0000 7ffb67e00640 1 -- 172.21.15.47:0/4186092840 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7ffb6807a4e0 con 0x7ffb70162c90 2024-05-27T10:52:39.024 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-27T10:52:39.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.029+0000 7ffb76c00640 1 -- 172.21.15.47:0/4186092840 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ffb5006c8f0 msgr2=0x7ffb5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:39.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.029+0000 7ffb76c00640 1 --2- 172.21.15.47:0/4186092840 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ffb5006c8f0 0x7ffb5006edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffb60006fd0 tx=0x7ffb60008040 comp rx=0 tx=0).stop 2024-05-27T10:52:39.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.029+0000 7ffb76c00640 1 -- 172.21.15.47:0/4186092840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb70162c90 msgr2=0x7ffb70161670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:39.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.029+0000 7ffb76c00640 1 --2- 172.21.15.47:0/4186092840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb70162c90 0x7ffb70161670 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009f70 tx=0x7ffb68004a40 comp rx=0 tx=0).stop 2024-05-27T10:52:39.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.029+0000 7ffb76c00640 1 -- 172.21.15.47:0/4186092840 shutdown_connections 2024-05-27T10:52:39.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.029+0000 7ffb76c00640 1 --2- 172.21.15.47:0/4186092840 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ffb5006c8f0 0x7ffb5006edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.029+0000 7ffb76c00640 1 --2- 172.21.15.47:0/4186092840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb70162c90 0x7ffb70161670 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.029+0000 7ffb76c00640 1 --2- 172.21.15.47:0/4186092840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb7015ea00 0x7ffb70161130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.029+0000 7ffb76c00640 1 --2- 172.21.15.47:0/4186092840 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb700d2f90 0x7ffb7015d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.029+0000 7ffb76c00640 1 -- 172.21.15.47:0/4186092840 >> 172.21.15.47:0/4186092840 conn(0x7ffb7008bfd0 msgr2=0x7ffb7006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:39.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.029+0000 7ffb76c00640 1 -- 172.21.15.47:0/4186092840 shutdown_connections 2024-05-27T10:52:39.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.029+0000 7ffb76c00640 1 -- 172.21.15.47:0/4186092840 wait complete. 2024-05-27T10:52:39.046 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T10:52:39.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.254+0000 7fa59b200640 1 Processor -- start 2024-05-27T10:52:39.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.254+0000 7fa59b200640 1 -- start start 2024-05-27T10:52:39.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.256+0000 7fa59b200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa59c0b6670 0x7fa59c169600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:39.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.256+0000 7fa59b200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa59c0ced40 con 0x7fa59c15e630 2024-05-27T10:52:39.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.256+0000 7fa59b200640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa59c0cf020 con 0x7fa59c0cfde0 2024-05-27T10:52:39.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.256+0000 7fa59b200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fa59c0cf950 con 0x7fa59c0b6670 2024-05-27T10:52:39.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.256+0000 7fa599e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa59c15e630 0x7fa59c0d3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51060/0 (socket says 172.21.15.47:51060) 2024-05-27T10:52:39.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.256+0000 7fa599e00640 1 -- 172.21.15.47:0/2276239272 learned_addr learned my addr 172.21.15.47:0/2276239272 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:39.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.257+0000 7fa599400640 1 -- 172.21.15.47:0/2276239272 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2932804524 0 0) 0x7fa59c0ced40 con 0x7fa59c15e630 2024-05-27T10:52:39.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.257+0000 7fa599400640 1 -- 172.21.15.47:0/2276239272 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa580003520 con 0x7fa59c15e630 2024-05-27T10:52:39.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.257+0000 7fa59a800640 1 --2- 172.21.15.47:0/2276239272 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa59c0b6670 0x7fa59c169600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:39.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.257+0000 7fa599400640 1 -- 172.21.15.47:0/2276239272 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3326795154 0 0) 0x7fa580003520 con 0x7fa59c15e630 2024-05-27T10:52:39.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.257+0000 7fa599400640 1 -- 172.21.15.47:0/2276239272 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa59c0b6670 msgr2=0x7fa59c169600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:39.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.257+0000 7fa599400640 1 --2- 172.21.15.47:0/2276239272 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa59c0b6670 0x7fa59c169600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.257+0000 7fa599400640 1 -- 172.21.15.47:0/2276239272 >> v1:172.21.15.53:6789/0 conn(0x7fa59c0cfde0 legacy=0x7fa59c0b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:39.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.257+0000 7fa599400640 1 -- 172.21.15.47:0/2276239272 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59c0cf300 con 0x7fa59c15e630 2024-05-27T10:52:39.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.257+0000 7fa599400640 1 -- 172.21.15.47:0/2276239272 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7fa58c001670 con 0x7fa59c15e630 2024-05-27T10:52:39.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.257+0000 7fa599400640 1 -- 172.21.15.47:0/2276239272 >> v1:172.21.15.47:6789/0 conn(0x7fa59c15e630 legacy=0x7fa59c0d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:39.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.257+0000 7fa599400640 1 --2- 172.21.15.47:0/2276239272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5800039e0 0x7fa580003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:39.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.257+0000 7fa599400640 1 --2- 172.21.15.47:0/2276239272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa580004800 0x7fa580004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:39.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.257+0000 7fa599400640 1 --2- 172.21.15.47:0/2276239272 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5800051c0 0x7fa58000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:39.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.257+0000 7fa599400640 1 -- 172.21.15.47:0/2276239272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c0cf950 con 0x7fa580004800 2024-05-27T10:52:39.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.257+0000 7fa599400640 1 -- 172.21.15.47:0/2276239272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa58000c090 con 0x7fa5800039e0 2024-05-27T10:52:39.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.257+0000 7fa599400640 1 -- 172.21.15.47:0/2276239272 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fa58000c290 con 0x7fa5800051c0 2024-05-27T10:52:39.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.258+0000 7fa593e00640 1 --2- 172.21.15.47:0/2276239272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa580004800 0x7fa580004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:39.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.258+0000 7fa599e00640 1 --2- 172.21.15.47:0/2276239272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5800039e0 0x7fa580003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:39.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.258+0000 7fa593e00640 1 -- 172.21.15.47:0/2276239272 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5800051c0 msgr2=0x7fa58000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:39.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.258+0000 7fa593e00640 1 --2- 172.21.15.47:0/2276239272 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5800051c0 0x7fa58000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.258+0000 7fa593e00640 1 -- 172.21.15.47:0/2276239272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5800039e0 msgr2=0x7fa580003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:39.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.258+0000 7fa593e00640 1 --2- 172.21.15.47:0/2276239272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5800039e0 0x7fa580003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.258+0000 7fa593e00640 1 -- 172.21.15.47:0/2276239272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa580003520 con 0x7fa580004800 2024-05-27T10:52:39.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.258+0000 7fa599e00640 1 --2- 172.21.15.47:0/2276239272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5800039e0 0x7fa580003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:39.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.259+0000 7fa593e00640 1 --2- 172.21.15.47:0/2276239272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa580004800 0x7fa580004c80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa584001750 tx=0x7fa580005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caed762eac215595 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:39.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.259+0000 7fa599400640 1 -- 172.21.15.47:0/2276239272 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584001370 con 0x7fa580004800 2024-05-27T10:52:39.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.259+0000 7fa599400640 1 -- 172.21.15.47:0/2276239272 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5840052d0 con 0x7fa580004800 2024-05-27T10:52:39.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.259+0000 7fa599400640 1 -- 172.21.15.47:0/2276239272 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58402abe0 con 0x7fa580004800 2024-05-27T10:52:39.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.260+0000 7fa59b200640 1 -- 172.21.15.47:0/2276239272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa580004800 msgr2=0x7fa580004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:39.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.260+0000 7fa59b200640 1 --2- 172.21.15.47:0/2276239272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa580004800 0x7fa580004c80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa584001750 tx=0x7fa580005830 comp rx=0 tx=0).stop 2024-05-27T10:52:39.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.260+0000 7fa59a800640 1 -- 172.21.15.47:0/2276239272 reap_dead start 2024-05-27T10:52:39.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.260+0000 7fa59b200640 1 -- 172.21.15.47:0/2276239272 shutdown_connections 2024-05-27T10:52:39.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.260+0000 7fa59b200640 1 -- 172.21.15.47:0/2276239272 >> 172.21.15.47:0/2276239272 conn(0x7fa59c08bfd0 msgr2=0x7fa59c0d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:39.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.260+0000 7fa59b200640 1 -- 172.21.15.47:0/2276239272 shutdown_connections 2024-05-27T10:52:39.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.261+0000 7fa59b200640 1 -- 172.21.15.47:0/2276239272 wait complete. 2024-05-27T10:52:39.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.262+0000 7fa59b200640 1 Processor -- start 2024-05-27T10:52:39.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.262+0000 7fa59b200640 1 -- start start 2024-05-27T10:52:39.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.263+0000 7fa59b200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa580004800 0x7fa59c0c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:39.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.263+0000 7fa59b200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa59c1552a0 0x7fa59c0c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:39.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.263+0000 7fa59b200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa59c1f41c0 0x7fa59c1f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:39.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.263+0000 7fa59b200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c15eb90 con 0x7fa59c1552a0 2024-05-27T10:52:39.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.263+0000 7fa59b200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c15ea10 con 0x7fa59c1f41c0 2024-05-27T10:52:39.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.263+0000 7fa59b200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fa59c0d3940 con 0x7fa580004800 2024-05-27T10:52:39.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.264+0000 7fa593e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa59c1552a0 0x7fa59c0c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:39.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.264+0000 7fa593e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa59c1552a0 0x7fa59c0c9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37378/0 (socket says 172.21.15.47:37378) 2024-05-27T10:52:39.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.264+0000 7fa593e00640 1 -- 172.21.15.47:0/383257208 learned_addr learned my addr 172.21.15.47:0/383257208 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:39.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.264+0000 7fa599e00640 1 --2- 172.21.15.47:0/383257208 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa580004800 0x7fa59c0c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:39.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.264+0000 7fa59a800640 1 --2- 172.21.15.47:0/383257208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa59c1f41c0 0x7fa59c1f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:39.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.264+0000 7fa593e00640 1 -- 172.21.15.47:0/383257208 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa580004800 msgr2=0x7fa59c0c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.264+0000 7fa593e00640 1 --2- 172.21.15.47:0/383257208 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa580004800 0x7fa59c0c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.264+0000 7fa593e00640 1 -- 172.21.15.47:0/383257208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa59c1f41c0 msgr2=0x7fa59c1f4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.264+0000 7fa593e00640 1 --2- 172.21.15.47:0/383257208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa59c1f41c0 0x7fa59c1f4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.264+0000 7fa593e00640 1 -- 172.21.15.47:0/383257208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59c160660 con 0x7fa59c1552a0 2024-05-27T10:52:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.264+0000 7fa59a800640 1 --2- 172.21.15.47:0/383257208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa59c1f41c0 0x7fa59c1f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.264+0000 7fa599e00640 1 --2- 172.21.15.47:0/383257208 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa580004800 0x7fa59c0c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.265+0000 7fa593e00640 1 --2- 172.21.15.47:0/383257208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa59c1552a0 0x7fa59c0c9f60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa584008fd0 tx=0x7fa584001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.265+0000 7fa592000640 1 -- 172.21.15.47:0/383257208 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584042070 con 0x7fa59c1552a0 2024-05-27T10:52:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.265+0000 7fa592000640 1 -- 172.21.15.47:0/383257208 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa58402be50 con 0x7fa59c1552a0 2024-05-27T10:52:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.265+0000 7fa592000640 1 -- 172.21.15.47:0/383257208 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584037040 con 0x7fa59c1552a0 2024-05-27T10:52:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.265+0000 7fa59b200640 1 -- 172.21.15.47:0/383257208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa59c160940 con 0x7fa59c1552a0 2024-05-27T10:52:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.265+0000 7fa59b200640 1 -- 172.21.15.47:0/383257208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa59c1f4bb0 con 0x7fa59c1552a0 2024-05-27T10:52:39.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.266+0000 7fa59b200640 1 -- 172.21.15.47:0/383257208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa59c04fce0 con 0x7fa59c1552a0 2024-05-27T10:52:39.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.267+0000 7fa592000640 1 -- 172.21.15.47:0/383257208 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa584045070 con 0x7fa59c1552a0 2024-05-27T10:52:39.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.268+0000 7fa592000640 1 --2- 172.21.15.47:0/383257208 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa57806c920 0x7fa57806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:39.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.268+0000 7fa592000640 1 -- 172.21.15.47:0/383257208 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa5840ab380 con 0x7fa59c1552a0 2024-05-27T10:52:39.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.268+0000 7fa599e00640 1 --2- 172.21.15.47:0/383257208 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa57806c920 0x7fa57806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:39.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.269+0000 7fa599e00640 1 --2- 172.21.15.47:0/383257208 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa57806c920 0x7fa57806ede0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0079f0 tx=0x7fa58c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:39.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.272+0000 7fa592000640 1 -- 172.21.15.47:0/383257208 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa5840797a0 con 0x7fa59c1552a0 2024-05-27T10:52:39.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.472+0000 7fa59b200640 1 -- 172.21.15.47:0/383257208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa59c152570 con 0x7fa59c1552a0 2024-05-27T10:52:39.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.473+0000 7fa592000640 1 -- 172.21.15.47:0/383257208 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fa5840790a0 con 0x7fa59c1552a0 2024-05-27T10:52:39.471 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-27T10:52:39.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.476+0000 7fa59b200640 1 -- 172.21.15.47:0/383257208 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa57806c920 msgr2=0x7fa57806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:39.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.476+0000 7fa59b200640 1 --2- 172.21.15.47:0/383257208 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa57806c920 0x7fa57806ede0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0079f0 tx=0x7fa58c009040 comp rx=0 tx=0).stop 2024-05-27T10:52:39.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.476+0000 7fa59b200640 1 -- 172.21.15.47:0/383257208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa59c1552a0 msgr2=0x7fa59c0c9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:39.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.476+0000 7fa59b200640 1 --2- 172.21.15.47:0/383257208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa59c1552a0 0x7fa59c0c9f60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa584008fd0 tx=0x7fa584001120 comp rx=0 tx=0).stop 2024-05-27T10:52:39.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.476+0000 7fa59b200640 1 -- 172.21.15.47:0/383257208 shutdown_connections 2024-05-27T10:52:39.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.476+0000 7fa59b200640 1 --2- 172.21.15.47:0/383257208 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa57806c920 0x7fa57806ede0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.476+0000 7fa59b200640 1 --2- 172.21.15.47:0/383257208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa59c1f41c0 0x7fa59c1f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.476+0000 7fa59b200640 1 --2- 172.21.15.47:0/383257208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa59c1552a0 0x7fa59c0c9f60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.476+0000 7fa59b200640 1 --2- 172.21.15.47:0/383257208 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa580004800 0x7fa59c0c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.476+0000 7fa59b200640 1 -- 172.21.15.47:0/383257208 >> 172.21.15.47:0/383257208 conn(0x7fa59c08bfd0 msgr2=0x7fa59c0b4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:39.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.476+0000 7fa59b200640 1 -- 172.21.15.47:0/383257208 shutdown_connections 2024-05-27T10:52:39.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.476+0000 7fa59b200640 1 -- 172.21.15.47:0/383257208 wait complete. 2024-05-27T10:52:39.493 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T10:52:39.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.710+0000 7f251fe00640 1 Processor -- start 2024-05-27T10:52:39.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.710+0000 7f251fe00640 1 -- start start 2024-05-27T10:52:39.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.711+0000 7f251fe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f252006da80 0x7f25200d0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:39.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.712+0000 7f251fe00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25200d0860 0x7f25200ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:39.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.712+0000 7f251fe00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25200d0c70 con 0x7f252015c510 2024-05-27T10:52:39.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.712+0000 7f251fe00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f25200b43e0 con 0x7f252006da80 2024-05-27T10:52:39.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.712+0000 7f251fe00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f25200b4620 con 0x7f25200d0860 2024-05-27T10:52:39.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.712+0000 7f251ea00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f252015c510 0x7f25200b3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51070/0 (socket says 172.21.15.47:51070) 2024-05-27T10:52:39.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.712+0000 7f251ea00640 1 -- 172.21.15.47:0/2689589412 learned_addr learned my addr 172.21.15.47:0/2689589412 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:39.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.712+0000 7f251e000640 1 --2- 172.21.15.47:0/2689589412 >> v2:172.21.15.47:3300/0 conn(0x7f252006da80 0x7f25200d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:39.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.712+0000 7f251d600640 1 -- 172.21.15.47:0/2689589412 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3345434644 0 0) 0x7f2510001110 con 0x7f252015c510 2024-05-27T10:52:39.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.712+0000 7f251f400640 1 --2- 172.21.15.47:0/2689589412 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25200d0860 0x7f25200ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:39.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.712+0000 7f251d600640 1 -- 172.21.15.47:0/2689589412 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2504003520 con 0x7f252015c510 2024-05-27T10:52:39.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.713+0000 7f251e000640 1 -- 172.21.15.47:0/2689589412 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25200d0860 msgr2=0x7f25200ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:39.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.713+0000 7f251d600640 1 -- 172.21.15.47:0/2689589412 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1479128649 0 0) 0x7f2504003520 con 0x7f252015c510 2024-05-27T10:52:39.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.713+0000 7f251e000640 1 --2- 172.21.15.47:0/2689589412 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25200d0860 0x7f25200ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.713+0000 7f251e000640 1 -- 172.21.15.47:0/2689589412 >> v1:172.21.15.47:6789/0 conn(0x7f252015c510 legacy=0x7f25200b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:39.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.713+0000 7f251e000640 1 -- 172.21.15.47:0/2689589412 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25200b4900 con 0x7f252006da80 2024-05-27T10:52:39.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.714+0000 7f251e000640 1 --2- 172.21.15.47:0/2689589412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f252006da80 0x7f25200d0320 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f250c0097a0 tx=0x7f250c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb4088b2a6bf820 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:39.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.715+0000 7f251d600640 1 -- 172.21.15.47:0/2689589412 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250c037070 con 0x7f252006da80 2024-05-27T10:52:39.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.715+0000 7f251d600640 1 -- 172.21.15.47:0/2689589412 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f250c02aba0 con 0x7f252006da80 2024-05-27T10:52:39.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.715+0000 7f251d600640 1 -- 172.21.15.47:0/2689589412 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2510001840 con 0x7f252006da80 2024-05-27T10:52:39.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.715+0000 7f251fe00640 1 -- 172.21.15.47:0/2689589412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f252006da80 msgr2=0x7f25200d0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:39.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.715+0000 7f251fe00640 1 --2- 172.21.15.47:0/2689589412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f252006da80 0x7f25200d0320 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f250c0097a0 tx=0x7f250c02a110 comp rx=0 tx=0).stop 2024-05-27T10:52:39.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.715+0000 7f251fe00640 1 -- 172.21.15.47:0/2689589412 shutdown_connections 2024-05-27T10:52:39.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.715+0000 7f251fe00640 1 --2- 172.21.15.47:0/2689589412 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25200d0860 0x7f25200ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.715+0000 7f251fe00640 1 --2- 172.21.15.47:0/2689589412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f252006da80 0x7f25200d0320 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.715+0000 7f251fe00640 1 -- 172.21.15.47:0/2689589412 >> 172.21.15.47:0/2689589412 conn(0x7f252006bb20 msgr2=0x7f252006bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:39.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.716+0000 7f251fe00640 1 -- 172.21.15.47:0/2689589412 shutdown_connections 2024-05-27T10:52:39.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.716+0000 7f251fe00640 1 -- 172.21.15.47:0/2689589412 wait complete. 2024-05-27T10:52:39.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.717+0000 7f251fe00640 1 Processor -- start 2024-05-27T10:52:39.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.717+0000 7f251fe00640 1 -- start start 2024-05-27T10:52:39.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.718+0000 7f251fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f252006da80 0x7f2520072750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:39.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.718+0000 7f251fe00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25200d0860 0x7f2520156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:39.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.718+0000 7f251fe00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f252015c510 0x7f2520150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:39.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.718+0000 7f251fe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f252015c8f0 con 0x7f252006da80 2024-05-27T10:52:39.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.718+0000 7f251fe00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f25200b4ec0 con 0x7f252015c510 2024-05-27T10:52:39.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.718+0000 7f251fe00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f25200cef30 con 0x7f25200d0860 2024-05-27T10:52:39.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.719+0000 7f251ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f252006da80 0x7f2520072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:39.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.719+0000 7f251ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f252006da80 0x7f2520072750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37388/0 (socket says 172.21.15.47:37388) 2024-05-27T10:52:39.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.719+0000 7f251ea00640 1 -- 172.21.15.47:0/2489676796 learned_addr learned my addr 172.21.15.47:0/2489676796 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:39.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.719+0000 7f251f400640 1 --2- 172.21.15.47:0/2489676796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f252015c510 0x7f2520150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:39.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.719+0000 7f251e000640 1 --2- 172.21.15.47:0/2489676796 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25200d0860 0x7f2520156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:39.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.719+0000 7f251ea00640 1 -- 172.21.15.47:0/2489676796 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25200d0860 msgr2=0x7f2520156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:39.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.719+0000 7f251ea00640 1 --2- 172.21.15.47:0/2489676796 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25200d0860 0x7f2520156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.719+0000 7f251ea00640 1 -- 172.21.15.47:0/2489676796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f252015c510 msgr2=0x7f2520150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:39.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.719+0000 7f251ea00640 1 --2- 172.21.15.47:0/2489676796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f252015c510 0x7f2520150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.719+0000 7f251ea00640 1 -- 172.21.15.47:0/2489676796 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2520073050 con 0x7f252006da80 2024-05-27T10:52:39.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.719+0000 7f251f400640 1 --2- 172.21.15.47:0/2489676796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f252015c510 0x7f2520150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:39.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.720+0000 7f251ea00640 1 --2- 172.21.15.47:0/2489676796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f252006da80 0x7f2520072750 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f251000c730 tx=0x7f251000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:39.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.720+0000 7f2516a00640 1 -- 172.21.15.47:0/2489676796 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2510017070 con 0x7f252006da80 2024-05-27T10:52:39.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.720+0000 7f2516a00640 1 -- 172.21.15.47:0/2489676796 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2510005af0 con 0x7f252006da80 2024-05-27T10:52:39.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.720+0000 7f2516a00640 1 -- 172.21.15.47:0/2489676796 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2510007070 con 0x7f252006da80 2024-05-27T10:52:39.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.720+0000 7f251fe00640 1 -- 172.21.15.47:0/2489676796 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2520073330 con 0x7f252006da80 2024-05-27T10:52:39.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.720+0000 7f251fe00640 1 -- 172.21.15.47:0/2489676796 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f252015d900 con 0x7f252006da80 2024-05-27T10:52:39.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.721+0000 7f251fe00640 1 -- 172.21.15.47:0/2489676796 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f252004fce0 con 0x7f252006da80 2024-05-27T10:52:39.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.722+0000 7f2516a00640 1 -- 172.21.15.47:0/2489676796 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f251001a070 con 0x7f252006da80 2024-05-27T10:52:39.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.723+0000 7f2516a00640 1 --2- 172.21.15.47:0/2489676796 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f250006c8f0 0x7f250006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:39.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.723+0000 7f2516a00640 1 -- 172.21.15.47:0/2489676796 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f251008b0a0 con 0x7f252006da80 2024-05-27T10:52:39.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.724+0000 7f251e000640 1 --2- 172.21.15.47:0/2489676796 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f250006c8f0 0x7f250006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:39.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.724+0000 7f251e000640 1 --2- 172.21.15.47:0/2489676796 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f250006c8f0 0x7f250006edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f250c034000 tx=0x7f250c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:39.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.728+0000 7f2516a00640 1 -- 172.21.15.47:0/2489676796 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f25200d0c70 con 0x7f252006da80 2024-05-27T10:52:39.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.930+0000 7f251fe00640 1 -- 172.21.15.47:0/2489676796 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f25200ce430 con 0x7f252006da80 2024-05-27T10:52:39.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.931+0000 7f2516a00640 1 -- 172.21.15.47:0/2489676796 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f2510059430 con 0x7f252006da80 2024-05-27T10:52:39.929 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-27T10:52:39.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.933+0000 7f251fe00640 1 -- 172.21.15.47:0/2489676796 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f250006c8f0 msgr2=0x7f250006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:39.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.934+0000 7f251fe00640 1 --2- 172.21.15.47:0/2489676796 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f250006c8f0 0x7f250006edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f250c034000 tx=0x7f250c02e000 comp rx=0 tx=0).stop 2024-05-27T10:52:39.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.934+0000 7f251fe00640 1 -- 172.21.15.47:0/2489676796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f252006da80 msgr2=0x7f2520072750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:39.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.934+0000 7f251fe00640 1 --2- 172.21.15.47:0/2489676796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f252006da80 0x7f2520072750 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f251000c730 tx=0x7f251000cbf0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.934+0000 7f251fe00640 1 -- 172.21.15.47:0/2489676796 shutdown_connections 2024-05-27T10:52:39.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.934+0000 7f251fe00640 1 --2- 172.21.15.47:0/2489676796 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f250006c8f0 0x7f250006edb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.934+0000 7f251fe00640 1 --2- 172.21.15.47:0/2489676796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f252015c510 0x7f2520150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.934+0000 7f251fe00640 1 --2- 172.21.15.47:0/2489676796 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25200d0860 0x7f2520156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.934+0000 7f251fe00640 1 --2- 172.21.15.47:0/2489676796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f252006da80 0x7f2520072750 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:39.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.934+0000 7f251fe00640 1 -- 172.21.15.47:0/2489676796 >> 172.21.15.47:0/2489676796 conn(0x7f252006bb20 msgr2=0x7f252006df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:39.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.934+0000 7f251fe00640 1 -- 172.21.15.47:0/2489676796 shutdown_connections 2024-05-27T10:52:39.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:39.934+0000 7f251fe00640 1 -- 172.21.15.47:0/2489676796 wait complete. 2024-05-27T10:52:39.951 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:52:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.157+0000 7f955dc00640 1 Processor -- start 2024-05-27T10:52:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.157+0000 7f955dc00640 1 -- start start 2024-05-27T10:52:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.158+0000 7f955dc00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f95580b5fd0 0x7f95580cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.158+0000 7f955dc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f95580d4c60 0x7f95580d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.158+0000 7f955dc00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95580ceba0 con 0x7f95580b63b0 2024-05-27T10:52:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.159+0000 7f955dc00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f95580cf790 con 0x7f95580d4c60 2024-05-27T10:52:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.159+0000 7f955dc00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f95580cee60 con 0x7f95580b5fd0 2024-05-27T10:52:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.159+0000 7f955d200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f95580d4c60 0x7f95580d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.159+0000 7f955d200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f95580d4c60 0x7f95580d2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37402/0 (socket says 172.21.15.47:37402) 2024-05-27T10:52:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.159+0000 7f955d200640 1 -- 172.21.15.47:0/1930387862 learned_addr learned my addr 172.21.15.47:0/1930387862 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.159+0000 7f9557e00640 1 --2- 172.21.15.47:0/1930387862 >> v2:172.21.15.53:3300/0 conn(0x7f95580b5fd0 0x7f95580cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.159+0000 7f955d200640 1 -- 172.21.15.47:0/1930387862 >> v2:172.21.15.53:3300/0 conn(0x7f95580b5fd0 msgr2=0x7f95580cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:40.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.159+0000 7f955d200640 1 --2- 172.21.15.47:0/1930387862 >> v2:172.21.15.53:3300/0 conn(0x7f95580b5fd0 0x7f95580cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.159+0000 7f955d200640 1 -- 172.21.15.47:0/1930387862 >> v1:172.21.15.53:6789/0 conn(0x7f95580b63b0 legacy=0x7f955815f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:40.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.159+0000 7f955d200640 1 -- 172.21.15.47:0/1930387862 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95580cf140 con 0x7f95580d4c60 2024-05-27T10:52:40.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.160+0000 7f955d200640 1 --2- 172.21.15.47:0/1930387862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95580d4c60 0x7f95580d2650 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f95580d0f30 tx=0x7f955002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c488e532dcff86e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:40.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.161+0000 7f9556a00640 1 -- 172.21.15.47:0/1930387862 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9550036070 con 0x7f95580d4c60 2024-05-27T10:52:40.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.161+0000 7f9556a00640 1 -- 172.21.15.47:0/1930387862 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9550031600 con 0x7f95580d4c60 2024-05-27T10:52:40.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.161+0000 7f9556a00640 1 -- 172.21.15.47:0/1930387862 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95500319d0 con 0x7f95580d4c60 2024-05-27T10:52:40.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.162+0000 7f955dc00640 1 -- 172.21.15.47:0/1930387862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95580d4c60 msgr2=0x7f95580d2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:40.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.162+0000 7f955dc00640 1 --2- 172.21.15.47:0/1930387862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95580d4c60 0x7f95580d2650 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f95580d0f30 tx=0x7f955002a6f0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.162+0000 7f955dc00640 1 -- 172.21.15.47:0/1930387862 shutdown_connections 2024-05-27T10:52:40.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.162+0000 7f955dc00640 1 --2- 172.21.15.47:0/1930387862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95580d4c60 0x7f95580d2650 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.162+0000 7f955dc00640 1 --2- 172.21.15.47:0/1930387862 >> v2:172.21.15.53:3300/0 conn(0x7f95580b5fd0 0x7f95580cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.162+0000 7f955dc00640 1 -- 172.21.15.47:0/1930387862 >> 172.21.15.47:0/1930387862 conn(0x7f955808bfd0 msgr2=0x7f95580d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:40.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.162+0000 7f955dc00640 1 -- 172.21.15.47:0/1930387862 shutdown_connections 2024-05-27T10:52:40.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.162+0000 7f955dc00640 1 -- 172.21.15.47:0/1930387862 wait complete. 2024-05-27T10:52:40.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.163+0000 7f955dc00640 1 Processor -- start 2024-05-27T10:52:40.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.164+0000 7f955dc00640 1 -- start start 2024-05-27T10:52:40.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.164+0000 7f955dc00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95580b5fd0 0x7f95580ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:40.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.164+0000 7f955dc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95580b63b0 0x7f9558162b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:40.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.165+0000 7f955dc00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f95580d4c60 0x7f95581509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:40.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.165+0000 7f955dc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f95580b67f0 con 0x7f95580b63b0 2024-05-27T10:52:40.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.165+0000 7f955dc00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f95580d50f0 con 0x7f95580b5fd0 2024-05-27T10:52:40.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.165+0000 7f955dc00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f95580cbaa0 con 0x7f95580d4c60 2024-05-27T10:52:40.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.165+0000 7f9557400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95580b63b0 0x7f9558162b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:40.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.165+0000 7f9557400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95580b63b0 0x7f9558162b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37408/0 (socket says 172.21.15.47:37408) 2024-05-27T10:52:40.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.165+0000 7f9557400640 1 -- 172.21.15.47:0/3971592406 learned_addr learned my addr 172.21.15.47:0/3971592406 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:40.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.165+0000 7f9557e00640 1 --2- 172.21.15.47:0/3971592406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95580b5fd0 0x7f95580ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:40.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.165+0000 7f955d200640 1 --2- 172.21.15.47:0/3971592406 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f95580d4c60 0x7f95581509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:40.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.166+0000 7f9557400640 1 -- 172.21.15.47:0/3971592406 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f95580d4c60 msgr2=0x7f95581509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:40.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.166+0000 7f9557400640 1 --2- 172.21.15.47:0/3971592406 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f95580d4c60 0x7f95581509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.166+0000 7f9557400640 1 -- 172.21.15.47:0/3971592406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95580b5fd0 msgr2=0x7f95580ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:40.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.166+0000 7f9557400640 1 --2- 172.21.15.47:0/3971592406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95580b5fd0 0x7f95580ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.166+0000 7f9557400640 1 -- 172.21.15.47:0/3971592406 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95580cd160 con 0x7f95580b63b0 2024-05-27T10:52:40.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.166+0000 7f9557e00640 1 --2- 172.21.15.47:0/3971592406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95580b5fd0 0x7f95580ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:52:40.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.166+0000 7f9557400640 1 --2- 172.21.15.47:0/3971592406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95580b63b0 0x7f9558162b40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f954400c430 tx=0x7f954400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:40.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.166+0000 7f954fe00640 1 -- 172.21.15.47:0/3971592406 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9544011790 con 0x7f95580b63b0 2024-05-27T10:52:40.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.166+0000 7f954fe00640 1 -- 172.21.15.47:0/3971592406 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9544017070 con 0x7f95580b63b0 2024-05-27T10:52:40.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.167+0000 7f955dc00640 1 -- 172.21.15.47:0/3971592406 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95580cd440 con 0x7f95580b63b0 2024-05-27T10:52:40.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.166+0000 7f954fe00640 1 -- 172.21.15.47:0/3971592406 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9544011b70 con 0x7f95580b63b0 2024-05-27T10:52:40.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.167+0000 7f955dc00640 1 -- 172.21.15.47:0/3971592406 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95580ca900 con 0x7f95580b63b0 2024-05-27T10:52:40.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.168+0000 7f955dc00640 1 -- 172.21.15.47:0/3971592406 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f955804fce0 con 0x7f95580b63b0 2024-05-27T10:52:40.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.169+0000 7f954fe00640 1 -- 172.21.15.47:0/3971592406 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9544011d10 con 0x7f95580b63b0 2024-05-27T10:52:40.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.170+0000 7f954fe00640 1 --2- 172.21.15.47:0/3971592406 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f953806c8f0 0x7f953806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:40.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.170+0000 7f954fe00640 1 -- 172.21.15.47:0/3971592406 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f954408b9c0 con 0x7f95580b63b0 2024-05-27T10:52:40.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.170+0000 7f9557e00640 1 --2- 172.21.15.47:0/3971592406 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f953806c8f0 0x7f953806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:40.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.171+0000 7f9557e00640 1 --2- 172.21.15.47:0/3971592406 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f953806c8f0 0x7f953806edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9548006fd0 tx=0x7f9548008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:40.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.175+0000 7f954fe00640 1 -- 172.21.15.47:0/3971592406 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9544059de0 con 0x7f95580b63b0 2024-05-27T10:52:40.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.378+0000 7f955dc00640 1 -- 172.21.15.47:0/3971592406 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95580b6db0 con 0x7f95580b63b0 2024-05-27T10:52:40.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.380+0000 7f954fe00640 1 -- 172.21.15.47:0/3971592406 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16521 (secure 0 0 0) 0x7f95440596e0 con 0x7f95580b63b0 2024-05-27T10:52:40.378 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:40.378 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:03.257638+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:52:40.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.382+0000 7f955dc00640 1 -- 172.21.15.47:0/3971592406 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f953806c8f0 msgr2=0x7f953806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:40.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.382+0000 7f955dc00640 1 --2- 172.21.15.47:0/3971592406 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f953806c8f0 0x7f953806edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9548006fd0 tx=0x7f9548008040 comp rx=0 tx=0).stop 2024-05-27T10:52:40.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.382+0000 7f955dc00640 1 -- 172.21.15.47:0/3971592406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95580b63b0 msgr2=0x7f9558162b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:40.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.382+0000 7f955dc00640 1 --2- 172.21.15.47:0/3971592406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95580b63b0 0x7f9558162b40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f954400c430 tx=0x7f954400c8f0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.383+0000 7f955dc00640 1 -- 172.21.15.47:0/3971592406 shutdown_connections 2024-05-27T10:52:40.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.383+0000 7f955dc00640 1 --2- 172.21.15.47:0/3971592406 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f953806c8f0 0x7f953806edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.383+0000 7f955dc00640 1 --2- 172.21.15.47:0/3971592406 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f95580d4c60 0x7f95581509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.383+0000 7f955dc00640 1 --2- 172.21.15.47:0/3971592406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95580b63b0 0x7f9558162b40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.383+0000 7f955dc00640 1 --2- 172.21.15.47:0/3971592406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95580b5fd0 0x7f95580ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.383+0000 7f955dc00640 1 -- 172.21.15.47:0/3971592406 >> 172.21.15.47:0/3971592406 conn(0x7f955808bfd0 msgr2=0x7f95580d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:40.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.383+0000 7f955dc00640 1 -- 172.21.15.47:0/3971592406 shutdown_connections 2024-05-27T10:52:40.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.383+0000 7f955dc00640 1 -- 172.21.15.47:0/3971592406 wait complete. 2024-05-27T10:52:40.400 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T10:51:55.073251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T10:51:59.202702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T10:52:00.664039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T10:52:40.401 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T10:52:40.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.620+0000 7f3e61c00640 1 Processor -- start 2024-05-27T10:52:40.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.620+0000 7f3e61c00640 1 -- start start 2024-05-27T10:52:40.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.622+0000 7f3e61c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3e5c15c8b0 0x7f3e5c0cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:40.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.622+0000 7f3e61c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e5c06c950 0x7f3e5c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:40.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.622+0000 7f3e61c00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3e5c0cfa30 0x7f3e5c0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:40.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.622+0000 7f3e61c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f3e5c15cc90 con 0x7f3e5c15c8b0 2024-05-27T10:52:40.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.622+0000 7f3e61c00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f3e5c06e730 con 0x7f3e5c0cfa30 2024-05-27T10:52:40.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.622+0000 7f3e61c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3e5c06ea10 con 0x7f3e5c06c950 2024-05-27T10:52:40.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.623+0000 7f3e5aa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3e5c15c8b0 0x7f3e5c0cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:40.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.623+0000 7f3e5aa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3e5c15c8b0 0x7f3e5c0cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37412/0 (socket says 172.21.15.47:37412) 2024-05-27T10:52:40.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.623+0000 7f3e5aa00640 1 -- 172.21.15.47:0/3791060206 learned_addr learned my addr 172.21.15.47:0/3791060206 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:40.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.623+0000 7f3e5aa00640 1 -- 172.21.15.47:0/3791060206 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e5c06c950 msgr2=0x7f3e5c06cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:40.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.623+0000 7f3e52000640 1 --2- 172.21.15.47:0/3791060206 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e5c06c950 0x7f3e5c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:40.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.623+0000 7f3e5aa00640 1 --2- 172.21.15.47:0/3791060206 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e5c06c950 0x7f3e5c06cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.623+0000 7f3e5aa00640 1 -- 172.21.15.47:0/3791060206 >> v2:172.21.15.53:3300/0 conn(0x7f3e5c0cfa30 msgr2=0x7f3e5c0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:40.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.623+0000 7f3e5b400640 1 --2- 172.21.15.47:0/3791060206 >> v2:172.21.15.53:3300/0 conn(0x7f3e5c0cfa30 0x7f3e5c0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:40.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.623+0000 7f3e5aa00640 1 --2- 172.21.15.47:0/3791060206 >> v2:172.21.15.53:3300/0 conn(0x7f3e5c0cfa30 0x7f3e5c0cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.623+0000 7f3e5aa00640 1 -- 172.21.15.47:0/3791060206 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5c06ecf0 con 0x7f3e5c15c8b0 2024-05-27T10:52:40.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.623+0000 7f3e5b400640 1 --2- 172.21.15.47:0/3791060206 >> v2:172.21.15.53:3300/0 conn(0x7f3e5c0cfa30 0x7f3e5c0cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:40.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.625+0000 7f3e5aa00640 1 --2- 172.21.15.47:0/3791060206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e5c15c8b0 0x7f3e5c0cdf60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c160270 tx=0x7f3e4c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489826e857e5481f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:40.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.625+0000 7f3e5a000640 1 -- 172.21.15.47:0/3791060206 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c037070 con 0x7f3e5c15c8b0 2024-05-27T10:52:40.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.625+0000 7f3e5a000640 1 -- 172.21.15.47:0/3791060206 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e4c032440 con 0x7f3e5c15c8b0 2024-05-27T10:52:40.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.625+0000 7f3e5a000640 1 -- 172.21.15.47:0/3791060206 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c032810 con 0x7f3e5c15c8b0 2024-05-27T10:52:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.626+0000 7f3e61c00640 1 -- 172.21.15.47:0/3791060206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e5c15c8b0 msgr2=0x7f3e5c0cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.626+0000 7f3e61c00640 1 --2- 172.21.15.47:0/3791060206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e5c15c8b0 0x7f3e5c0cdf60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c160270 tx=0x7f3e4c02a1e0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.626+0000 7f3e61c00640 1 -- 172.21.15.47:0/3791060206 shutdown_connections 2024-05-27T10:52:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.626+0000 7f3e61c00640 1 --2- 172.21.15.47:0/3791060206 >> v2:172.21.15.53:3300/0 conn(0x7f3e5c0cfa30 0x7f3e5c0cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.626+0000 7f3e61c00640 1 --2- 172.21.15.47:0/3791060206 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e5c06c950 0x7f3e5c06cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.626+0000 7f3e61c00640 1 --2- 172.21.15.47:0/3791060206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e5c15c8b0 0x7f3e5c0cdf60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.626+0000 7f3e61c00640 1 -- 172.21.15.47:0/3791060206 >> 172.21.15.47:0/3791060206 conn(0x7f3e5c0724c0 msgr2=0x7f3e5c0728d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.626+0000 7f3e61c00640 1 -- 172.21.15.47:0/3791060206 shutdown_connections 2024-05-27T10:52:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.626+0000 7f3e61c00640 1 -- 172.21.15.47:0/3791060206 wait complete. 2024-05-27T10:52:40.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.628+0000 7f3e61c00640 1 Processor -- start 2024-05-27T10:52:40.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.628+0000 7f3e61c00640 1 -- start start 2024-05-27T10:52:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.629+0000 7f3e61c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e5c06c950 0x7f3e5c0aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.629+0000 7f3e61c00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e5c0cfa30 0x7f3e5c1e7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.629+0000 7f3e61c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e5c1e7760 0x7f3e5c14a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.629+0000 7f3e61c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c0ce4a0 con 0x7f3e5c1e7760 2024-05-27T10:52:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.629+0000 7f3e61c00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c073310 con 0x7f3e5c0cfa30 2024-05-27T10:52:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.629+0000 7f3e61c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3e5c1e6180 con 0x7f3e5c06c950 2024-05-27T10:52:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.629+0000 7f3e5b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e5c1e7760 0x7f3e5c14a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.629+0000 7f3e5b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e5c1e7760 0x7f3e5c14a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37428/0 (socket says 172.21.15.47:37428) 2024-05-27T10:52:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.629+0000 7f3e5b400640 1 -- 172.21.15.47:0/843913297 learned_addr learned my addr 172.21.15.47:0/843913297 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:40.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.630+0000 7f3e52000640 1 --2- 172.21.15.47:0/843913297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e5c0cfa30 0x7f3e5c1e7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:40.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.630+0000 7f3e5aa00640 1 --2- 172.21.15.47:0/843913297 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e5c06c950 0x7f3e5c0aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:40.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.630+0000 7f3e5b400640 1 -- 172.21.15.47:0/843913297 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e5c06c950 msgr2=0x7f3e5c0aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:40.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.630+0000 7f3e5b400640 1 --2- 172.21.15.47:0/843913297 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e5c06c950 0x7f3e5c0aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.630+0000 7f3e5b400640 1 -- 172.21.15.47:0/843913297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e5c0cfa30 msgr2=0x7f3e5c1e7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:40.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.630+0000 7f3e5b400640 1 --2- 172.21.15.47:0/843913297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e5c0cfa30 0x7f3e5c1e7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.630+0000 7f3e5b400640 1 -- 172.21.15.47:0/843913297 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5c1e6460 con 0x7f3e5c1e7760 2024-05-27T10:52:40.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.630+0000 7f3e5b400640 1 --2- 172.21.15.47:0/843913297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e5c1e7760 0x7f3e5c14a350 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3e5400cd50 tx=0x7f3e5400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:40.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.630+0000 7f3e53400640 1 -- 172.21.15.47:0/843913297 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5400f680 con 0x7f3e5c1e7760 2024-05-27T10:52:40.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.631+0000 7f3e53400640 1 -- 172.21.15.47:0/843913297 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e5400f840 con 0x7f3e5c1e7760 2024-05-27T10:52:40.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.631+0000 7f3e61c00640 1 -- 172.21.15.47:0/843913297 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e5c1e6740 con 0x7f3e5c1e7760 2024-05-27T10:52:40.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.631+0000 7f3e53400640 1 -- 172.21.15.47:0/843913297 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5400fc30 con 0x7f3e5c1e7760 2024-05-27T10:52:40.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.631+0000 7f3e61c00640 1 -- 172.21.15.47:0/843913297 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e5c1e6d00 con 0x7f3e5c1e7760 2024-05-27T10:52:40.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.632+0000 7f3e61c00640 1 -- 172.21.15.47:0/843913297 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e5c06f2b0 con 0x7f3e5c1e7760 2024-05-27T10:52:40.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.633+0000 7f3e53400640 1 -- 172.21.15.47:0/843913297 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e540213f0 con 0x7f3e5c1e7760 2024-05-27T10:52:40.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.634+0000 7f3e53400640 1 --2- 172.21.15.47:0/843913297 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3e3806c8f0 0x7f3e3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:40.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.634+0000 7f3e53400640 1 -- 172.21.15.47:0/843913297 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3e5408c930 con 0x7f3e5c1e7760 2024-05-27T10:52:40.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.634+0000 7f3e5aa00640 1 --2- 172.21.15.47:0/843913297 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3e3806c8f0 0x7f3e3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.635+0000 7f3e5aa00640 1 --2- 172.21.15.47:0/843913297 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3e3806c8f0 0x7f3e3806edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c034000 tx=0x7f3e4c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:40.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.638+0000 7f3e53400640 1 -- 172.21.15.47:0/843913297 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3e5c06f2b0 con 0x7f3e5c1e7760 2024-05-27T10:52:40.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.841+0000 7f3e61c00640 1 -- 172.21.15.47:0/843913297 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3e5c073f00 con 0x7f3e5c1e7760 2024-05-27T10:52:40.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.842+0000 7f3e53400640 1 -- 172.21.15.47:0/843913297 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f3e54014030 con 0x7f3e5c1e7760 2024-05-27T10:52:40.840 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-27T10:52:40.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.845+0000 7f3e61c00640 1 -- 172.21.15.47:0/843913297 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3e3806c8f0 msgr2=0x7f3e3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:40.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.845+0000 7f3e61c00640 1 --2- 172.21.15.47:0/843913297 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3e3806c8f0 0x7f3e3806edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c034000 tx=0x7f3e4c02e000 comp rx=0 tx=0).stop 2024-05-27T10:52:40.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.845+0000 7f3e61c00640 1 -- 172.21.15.47:0/843913297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e5c1e7760 msgr2=0x7f3e5c14a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:40.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.845+0000 7f3e61c00640 1 --2- 172.21.15.47:0/843913297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e5c1e7760 0x7f3e5c14a350 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3e5400cd50 tx=0x7f3e5400a650 comp rx=0 tx=0).stop 2024-05-27T10:52:40.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.845+0000 7f3e61c00640 1 -- 172.21.15.47:0/843913297 shutdown_connections 2024-05-27T10:52:40.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.845+0000 7f3e61c00640 1 --2- 172.21.15.47:0/843913297 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3e3806c8f0 0x7f3e3806edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.845+0000 7f3e61c00640 1 --2- 172.21.15.47:0/843913297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e5c1e7760 0x7f3e5c14a350 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.845+0000 7f3e61c00640 1 --2- 172.21.15.47:0/843913297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e5c0cfa30 0x7f3e5c1e7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.845+0000 7f3e61c00640 1 --2- 172.21.15.47:0/843913297 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e5c06c950 0x7f3e5c0aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:40.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.845+0000 7f3e61c00640 1 -- 172.21.15.47:0/843913297 >> 172.21.15.47:0/843913297 conn(0x7f3e5c0724c0 msgr2=0x7f3e5c0a99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:40.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.845+0000 7f3e61c00640 1 -- 172.21.15.47:0/843913297 shutdown_connections 2024-05-27T10:52:40.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:40.845+0000 7f3e61c00640 1 -- 172.21.15.47:0/843913297 wait complete. 2024-05-27T10:52:40.863 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T10:52:41.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.084+0000 7f870ec00640 1 Processor -- start 2024-05-27T10:52:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.085+0000 7f870ec00640 1 -- start start 2024-05-27T10:52:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.086+0000 7f870ec00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f870815e630 0x7f87080d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.086+0000 7f870ec00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f87080cfde0 0x7f87080d3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.086+0000 7f870ec00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f87080b5f60 0x7f87080b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.086+0000 7f870ec00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f87080cf950 con 0x7f87080b5f60 2024-05-27T10:52:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.086+0000 7f870ec00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f87080ced40 con 0x7f87080cfde0 2024-05-27T10:52:41.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.086+0000 7f870ec00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f87080cf020 con 0x7f870815e630 2024-05-27T10:52:41.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.087+0000 7f870e200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f87080b5f60 0x7f87080b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:41.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.087+0000 7f870e200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f87080b5f60 0x7f87080b63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39338/0 (socket says 172.21.15.47:39338) 2024-05-27T10:52:41.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.087+0000 7f870e200640 1 -- 172.21.15.47:0/2123068617 learned_addr learned my addr 172.21.15.47:0/2123068617 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:41.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.087+0000 7f870d800640 1 --2- 172.21.15.47:0/2123068617 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f870815e630 0x7f87080d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.087+0000 7f870ce00640 1 --2- 172.21.15.47:0/2123068617 >> v2:172.21.15.53:3300/0 conn(0x7f87080cfde0 0x7f87080d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.087+0000 7f870e200640 1 -- 172.21.15.47:0/2123068617 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f870815e630 msgr2=0x7f87080d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.087+0000 7f870e200640 1 --2- 172.21.15.47:0/2123068617 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f870815e630 0x7f87080d3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.087+0000 7f870e200640 1 -- 172.21.15.47:0/2123068617 >> v2:172.21.15.53:3300/0 conn(0x7f87080cfde0 msgr2=0x7f87080d3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.087+0000 7f870e200640 1 --2- 172.21.15.47:0/2123068617 >> v2:172.21.15.53:3300/0 conn(0x7f87080cfde0 0x7f87080d3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.087+0000 7f870e200640 1 -- 172.21.15.47:0/2123068617 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87080cf300 con 0x7f87080b5f60 2024-05-27T10:52:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.087+0000 7f870d800640 1 --2- 172.21.15.47:0/2123068617 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f870815e630 0x7f87080d3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:52:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.088+0000 7f870e200640 1 --2- 172.21.15.47:0/2123068617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87080b5f60 0x7f87080b63f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f870808dec0 tx=0x7f870002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1835dbd60f106858 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.089+0000 7f8707e00640 1 -- 172.21.15.47:0/2123068617 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8700036070 con 0x7f87080b5f60 2024-05-27T10:52:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.089+0000 7f8707e00640 1 -- 172.21.15.47:0/2123068617 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8700031600 con 0x7f87080b5f60 2024-05-27T10:52:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.089+0000 7f8707e00640 1 -- 172.21.15.47:0/2123068617 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87000319d0 con 0x7f87080b5f60 2024-05-27T10:52:41.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.089+0000 7f870ec00640 1 -- 172.21.15.47:0/2123068617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87080b5f60 msgr2=0x7f87080b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:41.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.089+0000 7f870ec00640 1 --2- 172.21.15.47:0/2123068617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87080b5f60 0x7f87080b63f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f870808dec0 tx=0x7f870002a6a0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.090+0000 7f870ec00640 1 -- 172.21.15.47:0/2123068617 shutdown_connections 2024-05-27T10:52:41.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.090+0000 7f870ec00640 1 --2- 172.21.15.47:0/2123068617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87080b5f60 0x7f87080b63f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.090+0000 7f870ec00640 1 --2- 172.21.15.47:0/2123068617 >> v2:172.21.15.53:3300/0 conn(0x7f87080cfde0 0x7f87080d3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.090+0000 7f870ec00640 1 --2- 172.21.15.47:0/2123068617 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f870815e630 0x7f87080d3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.090+0000 7f870ec00640 1 -- 172.21.15.47:0/2123068617 >> 172.21.15.47:0/2123068617 conn(0x7f870808bfd0 msgr2=0x7f87080d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:41.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.090+0000 7f870ec00640 1 -- 172.21.15.47:0/2123068617 shutdown_connections 2024-05-27T10:52:41.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.090+0000 7f870ec00640 1 -- 172.21.15.47:0/2123068617 wait complete. 2024-05-27T10:52:41.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.092+0000 7f870ec00640 1 Processor -- start 2024-05-27T10:52:41.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.093+0000 7f870ec00640 1 -- start start 2024-05-27T10:52:41.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.094+0000 7f870ec00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87080b5f60 0x7f870815ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:41.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.094+0000 7f870ec00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f87080cfde0 0x7f870815f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:41.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.094+0000 7f870ec00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f870815e630 0x7f8708160c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:41.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.094+0000 7f870ec00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f870815eb90 con 0x7f870815e630 2024-05-27T10:52:41.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.094+0000 7f870ec00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f870815ea10 con 0x7f87080b5f60 2024-05-27T10:52:41.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.094+0000 7f870ec00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f87081622c0 con 0x7f87080cfde0 2024-05-27T10:52:41.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.094+0000 7f870e200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f870815e630 0x7f8708160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:41.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.094+0000 7f870e200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f870815e630 0x7f8708160c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39350/0 (socket says 172.21.15.47:39350) 2024-05-27T10:52:41.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.094+0000 7f870e200640 1 -- 172.21.15.47:0/3972909801 learned_addr learned my addr 172.21.15.47:0/3972909801 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:41.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.095+0000 7f870d800640 1 --2- 172.21.15.47:0/3972909801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87080b5f60 0x7f870815ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:41.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.095+0000 7f870ce00640 1 --2- 172.21.15.47:0/3972909801 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f87080cfde0 0x7f870815f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:41.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.095+0000 7f870e200640 1 -- 172.21.15.47:0/3972909801 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f87080cfde0 msgr2=0x7f870815f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:41.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.095+0000 7f870e200640 1 --2- 172.21.15.47:0/3972909801 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f87080cfde0 0x7f870815f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.095+0000 7f870e200640 1 -- 172.21.15.47:0/3972909801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87080b5f60 msgr2=0x7f870815ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:41.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.095+0000 7f870e200640 1 --2- 172.21.15.47:0/3972909801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87080b5f60 0x7f870815ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.095+0000 7f870e200640 1 -- 172.21.15.47:0/3972909801 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f870815c460 con 0x7f870815e630 2024-05-27T10:52:41.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.095+0000 7f870e200640 1 --2- 172.21.15.47:0/3972909801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f870815e630 0x7f8708160c90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8700009f40 tx=0x7f8700004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:41.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.096+0000 7f8705600640 1 -- 172.21.15.47:0/3972909801 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8700041020 con 0x7f870815e630 2024-05-27T10:52:41.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.096+0000 7f8705600640 1 -- 172.21.15.47:0/3972909801 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8700007780 con 0x7f870815e630 2024-05-27T10:52:41.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.096+0000 7f8705600640 1 -- 172.21.15.47:0/3972909801 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8700036040 con 0x7f870815e630 2024-05-27T10:52:41.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.096+0000 7f870ec00640 1 -- 172.21.15.47:0/3972909801 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f870815c740 con 0x7f870815e630 2024-05-27T10:52:41.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.096+0000 7f870ec00640 1 -- 172.21.15.47:0/3972909801 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87080b7480 con 0x7f870815e630 2024-05-27T10:52:41.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.097+0000 7f870ec00640 1 -- 172.21.15.47:0/3972909801 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f870804fce0 con 0x7f870815e630 2024-05-27T10:52:41.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.098+0000 7f8705600640 1 -- 172.21.15.47:0/3972909801 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8700044020 con 0x7f870815e630 2024-05-27T10:52:41.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.101+0000 7f8705600640 1 --2- 172.21.15.47:0/3972909801 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f86ec06c940 0x7f86ec06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:41.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.101+0000 7f8705600640 1 -- 172.21.15.47:0/3972909801 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f87000ac7e0 con 0x7f870815e630 2024-05-27T10:52:41.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.101+0000 7f870d800640 1 --2- 172.21.15.47:0/3972909801 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f86ec06c940 0x7f86ec06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:41.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.101+0000 7f870d800640 1 --2- 172.21.15.47:0/3972909801 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f86ec06c940 0x7f86ec06ee00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f86f8006e80 tx=0x7f86f8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:41.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.105+0000 7f8705600640 1 -- 172.21.15.47:0/3972909801 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f870004b030 con 0x7f870815e630 2024-05-27T10:52:41.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.312+0000 7f870ec00640 1 -- 172.21.15.47:0/3972909801 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f87080d0620 con 0x7f870815e630 2024-05-27T10:52:41.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.313+0000 7f8705600640 1 -- 172.21.15.47:0/3972909801 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f870007acb0 con 0x7f870815e630 2024-05-27T10:52:41.311 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-27T10:52:41.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.315+0000 7f870ec00640 1 -- 172.21.15.47:0/3972909801 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f86ec06c940 msgr2=0x7f86ec06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:41.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.315+0000 7f870ec00640 1 --2- 172.21.15.47:0/3972909801 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f86ec06c940 0x7f86ec06ee00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f86f8006e80 tx=0x7f86f8008040 comp rx=0 tx=0).stop 2024-05-27T10:52:41.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.315+0000 7f870ec00640 1 -- 172.21.15.47:0/3972909801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f870815e630 msgr2=0x7f8708160c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:41.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.315+0000 7f870ec00640 1 --2- 172.21.15.47:0/3972909801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f870815e630 0x7f8708160c90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8700009f40 tx=0x7f8700004a40 comp rx=0 tx=0).stop 2024-05-27T10:52:41.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.315+0000 7f870ec00640 1 -- 172.21.15.47:0/3972909801 shutdown_connections 2024-05-27T10:52:41.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.315+0000 7f870ec00640 1 --2- 172.21.15.47:0/3972909801 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f86ec06c940 0x7f86ec06ee00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.315+0000 7f870ec00640 1 --2- 172.21.15.47:0/3972909801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f870815e630 0x7f8708160c90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.315+0000 7f870ec00640 1 --2- 172.21.15.47:0/3972909801 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f87080cfde0 0x7f870815f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.315+0000 7f870ec00640 1 --2- 172.21.15.47:0/3972909801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87080b5f60 0x7f870815ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.315+0000 7f870ec00640 1 -- 172.21.15.47:0/3972909801 >> 172.21.15.47:0/3972909801 conn(0x7f870808bfd0 msgr2=0x7f87080b4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:41.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.316+0000 7f870ec00640 1 -- 172.21.15.47:0/3972909801 shutdown_connections 2024-05-27T10:52:41.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.316+0000 7f870ec00640 1 -- 172.21.15.47:0/3972909801 wait complete. 2024-05-27T10:52:41.333 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T10:52:41.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.554+0000 7fdab1c00640 1 Processor -- start 2024-05-27T10:52:41.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.554+0000 7fdab1c00640 1 -- start start 2024-05-27T10:52:41.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.557+0000 7fdab1c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaac0b1a80 0x7fdaac06cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:41.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.557+0000 7fdab1c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdaac09b150 0x7fdaac0d0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:41.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.557+0000 7fdab1c00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaac06d1a0 con 0x7fdaac09b6c0 2024-05-27T10:52:41.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.557+0000 7fdab1c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fdaac15fbf0 con 0x7fdaac09b150 2024-05-27T10:52:41.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.557+0000 7fdab1c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fdaac09bc80 con 0x7fdaac0b1a80 2024-05-27T10:52:41.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.557+0000 7fdaab400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdaac09b150 0x7fdaac0d0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:41.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.557+0000 7fdaab400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdaac09b150 0x7fdaac0d0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39352/0 (socket says 172.21.15.47:39352) 2024-05-27T10:52:41.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.557+0000 7fdaab400640 1 -- 172.21.15.47:0/1380510617 learned_addr learned my addr 172.21.15.47:0/1380510617 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:41.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.557+0000 7fdaaaa00640 1 --2- 172.21.15.47:0/1380510617 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaac0b1a80 0x7fdaac06cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:41.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.557+0000 7fdaab400640 1 -- 172.21.15.47:0/1380510617 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaac0b1a80 msgr2=0x7fdaac06cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:41.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.557+0000 7fdaab400640 1 --2- 172.21.15.47:0/1380510617 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaac0b1a80 0x7fdaac06cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.557+0000 7fdaab400640 1 -- 172.21.15.47:0/1380510617 >> v1:172.21.15.53:6789/0 conn(0x7fdaac09b6c0 legacy=0x7fdaac09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:41.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.557+0000 7fdaab400640 1 -- 172.21.15.47:0/1380510617 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaac15f5a0 con 0x7fdaac09b150 2024-05-27T10:52:41.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.557+0000 7fdaab400640 1 --2- 172.21.15.47:0/1380510617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaac09b150 0x7fdaac0d0740 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdaac162700 tx=0x7fdaa402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33902291a98f397 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:41.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.558+0000 7fdaa9600640 1 -- 172.21.15.47:0/1380510617 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4037070 con 0x7fdaac09b150 2024-05-27T10:52:41.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.558+0000 7fdaa9600640 1 -- 172.21.15.47:0/1380510617 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaa402ae50 con 0x7fdaac09b150 2024-05-27T10:52:41.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.558+0000 7fdaa9600640 1 -- 172.21.15.47:0/1380510617 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4032660 con 0x7fdaac09b150 2024-05-27T10:52:41.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.558+0000 7fdab1c00640 1 -- 172.21.15.47:0/1380510617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaac09b150 msgr2=0x7fdaac0d0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:41.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.558+0000 7fdab1c00640 1 --2- 172.21.15.47:0/1380510617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaac09b150 0x7fdaac0d0740 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdaac162700 tx=0x7fdaa402a140 comp rx=0 tx=0).stop 2024-05-27T10:52:41.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.559+0000 7fdab1c00640 1 -- 172.21.15.47:0/1380510617 shutdown_connections 2024-05-27T10:52:41.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.559+0000 7fdab1c00640 1 --2- 172.21.15.47:0/1380510617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaac09b150 0x7fdaac0d0740 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.559+0000 7fdab1c00640 1 --2- 172.21.15.47:0/1380510617 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaac0b1a80 0x7fdaac06cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.559+0000 7fdab1c00640 1 -- 172.21.15.47:0/1380510617 >> 172.21.15.47:0/1380510617 conn(0x7fdaac0b40c0 msgr2=0x7fdaac0b44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:41.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.559+0000 7fdab1c00640 1 -- 172.21.15.47:0/1380510617 shutdown_connections 2024-05-27T10:52:41.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.559+0000 7fdab1c00640 1 -- 172.21.15.47:0/1380510617 wait complete. 2024-05-27T10:52:41.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.562+0000 7fdab1c00640 1 Processor -- start 2024-05-27T10:52:41.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.562+0000 7fdab1c00640 1 -- start start 2024-05-27T10:52:41.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdab1c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaac09b150 0x7fdaac0b7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:41.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdab1c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaac09b6c0 0x7fdaac0c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:41.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdab1c00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaac0b1a80 0x7fdaac1478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:41.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdab1c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdaac160080 con 0x7fdaac09b150 2024-05-27T10:52:41.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdab1c00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdaac15f250 con 0x7fdaac0b1a80 2024-05-27T10:52:41.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdab1c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fdaac160200 con 0x7fdaac09b6c0 2024-05-27T10:52:41.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdaaaa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaac09b150 0x7fdaac0b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:41.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdaaaa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaac09b150 0x7fdaac0b7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39360/0 (socket says 172.21.15.47:39360) 2024-05-27T10:52:41.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdaaaa00640 1 -- 172.21.15.47:0/2615354377 learned_addr learned my addr 172.21.15.47:0/2615354377 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:41.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdaab400640 1 --2- 172.21.15.47:0/2615354377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaac0b1a80 0x7fdaac1478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:41.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdaaaa00640 1 -- 172.21.15.47:0/2615354377 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaac09b6c0 msgr2=0x7fdaac0c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:41.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdaaa000640 1 --2- 172.21.15.47:0/2615354377 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaac09b6c0 0x7fdaac0c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:41.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdaaaa00640 1 --2- 172.21.15.47:0/2615354377 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaac09b6c0 0x7fdaac0c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdaaaa00640 1 -- 172.21.15.47:0/2615354377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaac0b1a80 msgr2=0x7fdaac1478e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:41.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdaaaa00640 1 --2- 172.21.15.47:0/2615354377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaac0b1a80 0x7fdaac1478e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdaaaa00640 1 -- 172.21.15.47:0/2615354377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaac157f70 con 0x7fdaac09b150 2024-05-27T10:52:41.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdaaa000640 1 --2- 172.21.15.47:0/2615354377 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaac09b6c0 0x7fdaac0c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:41.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdaab400640 1 --2- 172.21.15.47:0/2615354377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaac0b1a80 0x7fdaac1478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:41.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdaaaa00640 1 --2- 172.21.15.47:0/2615354377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaac09b150 0x7fdaac0b7720 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fda9400c7f0 tx=0x7fda9400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:41.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdaa2a00640 1 -- 172.21.15.47:0/2615354377 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94015070 con 0x7fdaac09b150 2024-05-27T10:52:41.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdaa2a00640 1 -- 172.21.15.47:0/2615354377 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda94004220 con 0x7fdaac09b150 2024-05-27T10:52:41.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdaa2a00640 1 -- 172.21.15.47:0/2615354377 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94007620 con 0x7fdaac09b150 2024-05-27T10:52:41.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdab1c00640 1 -- 172.21.15.47:0/2615354377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaac157c90 con 0x7fdaac09b150 2024-05-27T10:52:41.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.563+0000 7fdab1c00640 1 -- 172.21.15.47:0/2615354377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaac0b6f20 con 0x7fdaac09b150 2024-05-27T10:52:41.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.564+0000 7fdab1c00640 1 -- 172.21.15.47:0/2615354377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaac0b2f40 con 0x7fdaac09b150 2024-05-27T10:52:41.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.566+0000 7fdaa2a00640 1 -- 172.21.15.47:0/2615354377 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fda940079d0 con 0x7fdaac09b150 2024-05-27T10:52:41.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.567+0000 7fdaa2a00640 1 --2- 172.21.15.47:0/2615354377 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fda8806c8f0 0x7fda8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:41.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.567+0000 7fdaa2a00640 1 -- 172.21.15.47:0/2615354377 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fda9408bf10 con 0x7fdaac09b150 2024-05-27T10:52:41.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.567+0000 7fdaaa000640 1 --2- 172.21.15.47:0/2615354377 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fda8806c8f0 0x7fda8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:41.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.569+0000 7fdaaa000640 1 --2- 172.21.15.47:0/2615354377 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fda8806c8f0 0x7fda8806edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdaac1489e0 tx=0x7fda9c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:41.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.571+0000 7fdaa2a00640 1 -- 172.21.15.47:0/2615354377 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdaac0b2f40 con 0x7fdaac09b150 2024-05-27T10:52:41.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.779+0000 7fdab1c00640 1 -- 172.21.15.47:0/2615354377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdaac0a06b0 con 0x7fdaac09b150 2024-05-27T10:52:41.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.780+0000 7fdaa2a00640 1 -- 172.21.15.47:0/2615354377 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fda9405a2a0 con 0x7fdaac09b150 2024-05-27T10:52:41.777 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-27T10:52:41.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.783+0000 7fdab1c00640 1 -- 172.21.15.47:0/2615354377 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fda8806c8f0 msgr2=0x7fda8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:41.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.783+0000 7fdab1c00640 1 --2- 172.21.15.47:0/2615354377 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fda8806c8f0 0x7fda8806edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdaac1489e0 tx=0x7fda9c009040 comp rx=0 tx=0).stop 2024-05-27T10:52:41.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.783+0000 7fdab1c00640 1 -- 172.21.15.47:0/2615354377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaac09b150 msgr2=0x7fdaac0b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:41.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.783+0000 7fdab1c00640 1 --2- 172.21.15.47:0/2615354377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaac09b150 0x7fdaac0b7720 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fda9400c7f0 tx=0x7fda9400ccb0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.783+0000 7fdab1c00640 1 -- 172.21.15.47:0/2615354377 shutdown_connections 2024-05-27T10:52:41.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.783+0000 7fdab1c00640 1 --2- 172.21.15.47:0/2615354377 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fda8806c8f0 0x7fda8806edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.783+0000 7fdab1c00640 1 --2- 172.21.15.47:0/2615354377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaac0b1a80 0x7fdaac1478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.783+0000 7fdab1c00640 1 --2- 172.21.15.47:0/2615354377 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdaac09b6c0 0x7fdaac0c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.783+0000 7fdab1c00640 1 --2- 172.21.15.47:0/2615354377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaac09b150 0x7fdaac0b7720 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:41.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.783+0000 7fdab1c00640 1 -- 172.21.15.47:0/2615354377 >> 172.21.15.47:0/2615354377 conn(0x7fdaac0b40c0 msgr2=0x7fdaac15e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:41.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.783+0000 7fdab1c00640 1 -- 172.21.15.47:0/2615354377 shutdown_connections 2024-05-27T10:52:41.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:41.784+0000 7fdab1c00640 1 -- 172.21.15.47:0/2615354377 wait complete. 2024-05-27T10:52:41.972 INFO:tasks.cephfs_test_runner:Starting test: test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that when one clone is in progress, one progress bar is printed 2024-05-27T10:52:41.972 INFO:tasks.cephfs_test_runner:test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-27T10:52:41.973 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:52:42.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.195+0000 7f748a800640 1 Processor -- start 2024-05-27T10:52:42.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.196+0000 7f748a800640 1 -- start start 2024-05-27T10:52:42.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.197+0000 7f748a800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f748415eaa0 0x7f74840d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:42.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.197+0000 7f748a800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74840d0950 con 0x7f748406ca40 2024-05-27T10:52:42.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.197+0000 7f748a800640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74840cebc0 con 0x7f748406d240 2024-05-27T10:52:42.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.197+0000 7f748a800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f74840cf4b0 con 0x7f748415eaa0 2024-05-27T10:52:42.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.198+0000 7f7489e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f748406ca40 0x7f74840d2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35150/0 (socket says 172.21.15.47:35150) 2024-05-27T10:52:42.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.198+0000 7f7489e00640 1 -- 172.21.15.47:0/2047673231 learned_addr learned my addr 172.21.15.47:0/2047673231 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:42.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.198+0000 7f7488a00640 1 --2- 172.21.15.47:0/2047673231 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f748415eaa0 0x7f74840d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:42.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.198+0000 7f7483e00640 1 -- 172.21.15.47:0/2047673231 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3159809857 0 0) 0x7f74840d0950 con 0x7f748406ca40 2024-05-27T10:52:42.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.198+0000 7f7483e00640 1 -- 172.21.15.47:0/2047673231 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7468003520 con 0x7f748406ca40 2024-05-27T10:52:42.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.199+0000 7f7483e00640 1 -- 172.21.15.47:0/2047673231 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3198585858 0 0) 0x7f7468003520 con 0x7f748406ca40 2024-05-27T10:52:42.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.199+0000 7f7483e00640 1 -- 172.21.15.47:0/2047673231 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f748415eaa0 msgr2=0x7f74840d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:42.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.199+0000 7f7483e00640 1 --2- 172.21.15.47:0/2047673231 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f748415eaa0 0x7f74840d2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:42.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.199+0000 7f7483e00640 1 -- 172.21.15.47:0/2047673231 >> v1:172.21.15.53:6789/0 conn(0x7f748406d240 legacy=0x7f748406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:42.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.199+0000 7f7483e00640 1 -- 172.21.15.47:0/2047673231 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74840cee60 con 0x7f748406ca40 2024-05-27T10:52:42.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.199+0000 7f7483e00640 1 -- 172.21.15.47:0/2047673231 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f747c0019f0 con 0x7f748406ca40 2024-05-27T10:52:42.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.199+0000 7f7483e00640 1 -- 172.21.15.47:0/2047673231 >> v1:172.21.15.47:6789/0 conn(0x7f748406ca40 legacy=0x7f74840d2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:42.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.199+0000 7f7483e00640 1 --2- 172.21.15.47:0/2047673231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74680039e0 0x7f7468003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:42.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.199+0000 7f7483e00640 1 --2- 172.21.15.47:0/2047673231 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f748415eaa0 0x7f7468004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:42.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.199+0000 7f7483e00640 1 --2- 172.21.15.47:0/2047673231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7468004d40 0x7f74680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:42.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.199+0000 7f7483e00640 1 -- 172.21.15.47:0/2047673231 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f74840cf4b0 con 0x7f74680039e0 2024-05-27T10:52:42.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.199+0000 7f7483e00640 1 -- 172.21.15.47:0/2047673231 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f746800baa0 con 0x7f7468004d40 2024-05-27T10:52:42.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.199+0000 7f7483e00640 1 -- 172.21.15.47:0/2047673231 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f746800bca0 con 0x7f748415eaa0 2024-05-27T10:52:42.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.199+0000 7f7489400640 1 --2- 172.21.15.47:0/2047673231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74680039e0 0x7f7468003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:42.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.200+0000 7f7489e00640 1 --2- 172.21.15.47:0/2047673231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7468004d40 0x7f74680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:42.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.200+0000 7f7489400640 1 -- 172.21.15.47:0/2047673231 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f748415eaa0 msgr2=0x7f7468004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:42.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.200+0000 7f7489400640 1 --2- 172.21.15.47:0/2047673231 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f748415eaa0 0x7f7468004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:42.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.200+0000 7f7489400640 1 -- 172.21.15.47:0/2047673231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7468004d40 msgr2=0x7f74680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:42.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.200+0000 7f7489400640 1 --2- 172.21.15.47:0/2047673231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7468004d40 0x7f74680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:42.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.200+0000 7f7489400640 1 -- 172.21.15.47:0/2047673231 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7468003520 con 0x7f74680039e0 2024-05-27T10:52:42.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.200+0000 7f7489e00640 1 --2- 172.21.15.47:0/2047673231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7468004d40 0x7f74680051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:42.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.201+0000 7f7489400640 1 --2- 172.21.15.47:0/2047673231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74680039e0 0x7f7468003e00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7474001720 tx=0x7f7468005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17e701e01ee85ed server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:42.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.201+0000 7f7483e00640 1 -- 172.21.15.47:0/2047673231 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7474001370 con 0x7f74680039e0 2024-05-27T10:52:42.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.201+0000 7f7483e00640 1 -- 172.21.15.47:0/2047673231 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74740052d0 con 0x7f74680039e0 2024-05-27T10:52:42.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.201+0000 7f7483e00640 1 -- 172.21.15.47:0/2047673231 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747402abc0 con 0x7f74680039e0 2024-05-27T10:52:42.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.202+0000 7f748a800640 1 -- 172.21.15.47:0/2047673231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74680039e0 msgr2=0x7f7468003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:42.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.202+0000 7f748a800640 1 --2- 172.21.15.47:0/2047673231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74680039e0 0x7f7468003e00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7474001720 tx=0x7f7468005830 comp rx=0 tx=0).stop 2024-05-27T10:52:42.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.202+0000 7f7489e00640 1 -- 172.21.15.47:0/2047673231 reap_dead start 2024-05-27T10:52:42.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.202+0000 7f748a800640 1 -- 172.21.15.47:0/2047673231 shutdown_connections 2024-05-27T10:52:42.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.202+0000 7f748a800640 1 -- 172.21.15.47:0/2047673231 >> 172.21.15.47:0/2047673231 conn(0x7f748408bfd0 msgr2=0x7f74840d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:42.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.202+0000 7f748a800640 1 -- 172.21.15.47:0/2047673231 shutdown_connections 2024-05-27T10:52:42.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.202+0000 7f748a800640 1 -- 172.21.15.47:0/2047673231 wait complete. 2024-05-27T10:52:42.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.204+0000 7f748a800640 1 Processor -- start 2024-05-27T10:52:42.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.204+0000 7f748a800640 1 -- start start 2024-05-27T10:52:42.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.205+0000 7f748a800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f74680039e0 0x7f74840c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:42.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.205+0000 7f748a800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74840b70f0 0x7f74840b7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:42.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.205+0000 7f748a800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74840b9790 0x7f74840b9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:42.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.205+0000 7f748a800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f74840b10a0 con 0x7f74840b70f0 2024-05-27T10:52:42.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.205+0000 7f748a800640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f748406cf40 con 0x7f74840b9790 2024-05-27T10:52:42.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.205+0000 7f748a800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f74840b1220 con 0x7f74680039e0 2024-05-27T10:52:42.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.205+0000 7f7488a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74840b70f0 0x7f74840b7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:42.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.205+0000 7f7488a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74840b70f0 0x7f74840b7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39376/0 (socket says 172.21.15.47:39376) 2024-05-27T10:52:42.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.205+0000 7f7488a00640 1 -- 172.21.15.47:0/2465829121 learned_addr learned my addr 172.21.15.47:0/2465829121 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:42.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.206+0000 7f7489400640 1 --2- 172.21.15.47:0/2465829121 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f74680039e0 0x7f74840c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:42.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.206+0000 7f7489e00640 1 --2- 172.21.15.47:0/2465829121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74840b9790 0x7f74840b9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:42.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.206+0000 7f7488a00640 1 -- 172.21.15.47:0/2465829121 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f74680039e0 msgr2=0x7f74840c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:42.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.206+0000 7f7488a00640 1 --2- 172.21.15.47:0/2465829121 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f74680039e0 0x7f74840c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:42.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.206+0000 7f7488a00640 1 -- 172.21.15.47:0/2465829121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74840b9790 msgr2=0x7f74840b9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:42.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.206+0000 7f7488a00640 1 --2- 172.21.15.47:0/2465829121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74840b9790 0x7f74840b9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:42.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.206+0000 7f7488a00640 1 -- 172.21.15.47:0/2465829121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74840c9560 con 0x7f74840b70f0 2024-05-27T10:52:42.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.206+0000 7f7489e00640 1 --2- 172.21.15.47:0/2465829121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74840b9790 0x7f74840b9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:42.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.206+0000 7f7488a00640 1 --2- 172.21.15.47:0/2465829121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74840b70f0 0x7f74840b7570 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f747000e850 tx=0x7f747000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:42.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.206+0000 7f7481600640 1 -- 172.21.15.47:0/2465829121 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7470017070 con 0x7f74840b70f0 2024-05-27T10:52:42.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.206+0000 7f7481600640 1 -- 172.21.15.47:0/2465829121 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f747000c940 con 0x7f74840b70f0 2024-05-27T10:52:42.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.206+0000 7f7481600640 1 -- 172.21.15.47:0/2465829121 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747000cd30 con 0x7f74840b70f0 2024-05-27T10:52:42.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.206+0000 7f748a800640 1 -- 172.21.15.47:0/2465829121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74840c9840 con 0x7f74840b70f0 2024-05-27T10:52:42.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.207+0000 7f748a800640 1 -- 172.21.15.47:0/2465829121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74840c9e00 con 0x7f74840b70f0 2024-05-27T10:52:42.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.208+0000 7f748a800640 1 -- 172.21.15.47:0/2465829121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f748404fce0 con 0x7f74840b70f0 2024-05-27T10:52:42.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.209+0000 7f7481600640 1 -- 172.21.15.47:0/2465829121 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f747001a070 con 0x7f74840b70f0 2024-05-27T10:52:42.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.210+0000 7f7481600640 1 --2- 172.21.15.47:0/2465829121 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f746406c8f0 0x7f746406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:42.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.210+0000 7f7481600640 1 -- 172.21.15.47:0/2465829121 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f747008bd10 con 0x7f74840b70f0 2024-05-27T10:52:42.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.210+0000 7f7489400640 1 --2- 172.21.15.47:0/2465829121 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f746406c8f0 0x7f746406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:42.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.211+0000 7f7489400640 1 --2- 172.21.15.47:0/2465829121 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f746406c8f0 0x7f746406edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7474032000 tx=0x7f747402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:42.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.217+0000 7f7481600640 1 -- 172.21.15.47:0/2465829121 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7470091020 con 0x7f74840b70f0 2024-05-27T10:52:42.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.427+0000 7f748a800640 1 -- 172.21.15.47:0/2465829121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f748415b850 con 0x7f74840b70f0 2024-05-27T10:52:42.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.430+0000 7f7481600640 1 -- 172.21.15.47:0/2465829121 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16521 (secure 0 0 0) 0x7f747005a0a0 con 0x7f74840b70f0 2024-05-27T10:52:42.427 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:42.427 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:03.257638+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:52:42.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.432+0000 7f748a800640 1 -- 172.21.15.47:0/2465829121 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f746406c8f0 msgr2=0x7f746406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:42.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.432+0000 7f748a800640 1 --2- 172.21.15.47:0/2465829121 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f746406c8f0 0x7f746406edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7474032000 tx=0x7f747402e000 comp rx=0 tx=0).stop 2024-05-27T10:52:42.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.432+0000 7f748a800640 1 -- 172.21.15.47:0/2465829121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74840b70f0 msgr2=0x7f74840b7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.432+0000 7f748a800640 1 --2- 172.21.15.47:0/2465829121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74840b70f0 0x7f74840b7570 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f747000e850 tx=0x7f747000ed10 comp rx=0 tx=0).stop 2024-05-27T10:52:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.432+0000 7f748a800640 1 -- 172.21.15.47:0/2465829121 shutdown_connections 2024-05-27T10:52:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.432+0000 7f748a800640 1 --2- 172.21.15.47:0/2465829121 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f746406c8f0 0x7f746406edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.432+0000 7f748a800640 1 --2- 172.21.15.47:0/2465829121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74840b9790 0x7f74840b9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.432+0000 7f748a800640 1 --2- 172.21.15.47:0/2465829121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74840b70f0 0x7f74840b7570 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.432+0000 7f748a800640 1 --2- 172.21.15.47:0/2465829121 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f74680039e0 0x7f74840c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.432+0000 7f748a800640 1 -- 172.21.15.47:0/2465829121 >> 172.21.15.47:0/2465829121 conn(0x7f748408bfd0 msgr2=0x7f748406d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.433+0000 7f748a800640 1 -- 172.21.15.47:0/2465829121 shutdown_connections 2024-05-27T10:52:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.433+0000 7f748a800640 1 -- 172.21.15.47:0/2465829121 wait complete. 2024-05-27T10:52:42.450 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T10:51:55.073251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T10:51:59.202702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T10:52:00.664039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T10:52:42.450 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T10:52:42.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.670+0000 7fb18ae00640 1 Processor -- start 2024-05-27T10:52:42.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.671+0000 7fb18ae00640 1 -- start start 2024-05-27T10:52:42.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.672+0000 7fb18ae00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb18415e630 0x7fb1840d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:42.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.672+0000 7fb18ae00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb1840b6670 0x7fb1840d3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:42.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.672+0000 7fb18ae00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1840ced40 con 0x7fb1840cfde0 2024-05-27T10:52:42.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.672+0000 7fb18ae00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb1840cf950 con 0x7fb1840b6670 2024-05-27T10:52:42.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.672+0000 7fb18ae00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fb1840cf020 con 0x7fb18415e630 2024-05-27T10:52:42.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.672+0000 7fb18a400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb1840b6670 0x7fb1840d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:42.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.672+0000 7fb189000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb1840cfde0 0x7fb1840b5f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35160/0 (socket says 172.21.15.47:35160) 2024-05-27T10:52:42.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.673+0000 7fb189000640 1 -- 172.21.15.47:0/3071272540 learned_addr learned my addr 172.21.15.47:0/3071272540 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:42.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.673+0000 7fb189a00640 1 --2- 172.21.15.47:0/3071272540 >> v2:172.21.15.53:3300/0 conn(0x7fb18415e630 0x7fb1840d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:42.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.673+0000 7fb183e00640 1 -- 172.21.15.47:0/3071272540 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 698416211 0 0) 0x7fb1840ced40 con 0x7fb1840cfde0 2024-05-27T10:52:42.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.673+0000 7fb18a400640 1 -- 172.21.15.47:0/3071272540 >> v2:172.21.15.53:3300/0 conn(0x7fb18415e630 msgr2=0x7fb1840d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:42.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.673+0000 7fb18a400640 1 --2- 172.21.15.47:0/3071272540 >> v2:172.21.15.53:3300/0 conn(0x7fb18415e630 0x7fb1840d3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:42.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.673+0000 7fb18a400640 1 -- 172.21.15.47:0/3071272540 >> v1:172.21.15.47:6789/0 conn(0x7fb1840cfde0 legacy=0x7fb1840b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:42.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.673+0000 7fb18a400640 1 -- 172.21.15.47:0/3071272540 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1840cf300 con 0x7fb1840b6670 2024-05-27T10:52:42.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.674+0000 7fb18a400640 1 --2- 172.21.15.47:0/3071272540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1840b6670 0x7fb1840d3770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb18408cd00 tx=0x7fb17c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a65229c01ff565 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:42.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.675+0000 7fb183e00640 1 -- 172.21.15.47:0/3071272540 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c007740 con 0x7fb1840b6670 2024-05-27T10:52:42.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.675+0000 7fb183e00640 1 -- 172.21.15.47:0/3071272540 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb17c0078e0 con 0x7fb1840b6670 2024-05-27T10:52:42.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.675+0000 7fb183e00640 1 -- 172.21.15.47:0/3071272540 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c007cb0 con 0x7fb1840b6670 2024-05-27T10:52:42.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.675+0000 7fb18ae00640 1 -- 172.21.15.47:0/3071272540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1840b6670 msgr2=0x7fb1840d3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:42.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.675+0000 7fb18ae00640 1 --2- 172.21.15.47:0/3071272540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1840b6670 0x7fb1840d3770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb18408cd00 tx=0x7fb17c02a680 comp rx=0 tx=0).stop 2024-05-27T10:52:42.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.675+0000 7fb18ae00640 1 -- 172.21.15.47:0/3071272540 shutdown_connections 2024-05-27T10:52:42.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.675+0000 7fb18ae00640 1 --2- 172.21.15.47:0/3071272540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1840b6670 0x7fb1840d3770 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:42.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.675+0000 7fb18ae00640 1 --2- 172.21.15.47:0/3071272540 >> v2:172.21.15.53:3300/0 conn(0x7fb18415e630 0x7fb1840d3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:42.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.676+0000 7fb18ae00640 1 -- 172.21.15.47:0/3071272540 >> 172.21.15.47:0/3071272540 conn(0x7fb18408bfd0 msgr2=0x7fb1840d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:42.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.676+0000 7fb18ae00640 1 -- 172.21.15.47:0/3071272540 shutdown_connections 2024-05-27T10:52:42.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.676+0000 7fb18ae00640 1 -- 172.21.15.47:0/3071272540 wait complete. 2024-05-27T10:52:42.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.677+0000 7fb18ae00640 1 Processor -- start 2024-05-27T10:52:42.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.678+0000 7fb18ae00640 1 -- start start 2024-05-27T10:52:42.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.678+0000 7fb18ae00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1840b6670 0x7fb1841f8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:42.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.678+0000 7fb18ae00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1840cfde0 0x7fb184161210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:42.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.678+0000 7fb18ae00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb18415e630 0x7fb18414f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:42.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.679+0000 7fb18ae00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb18415eb90 con 0x7fb18415e630 2024-05-27T10:52:42.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.679+0000 7fb18ae00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb18415ea10 con 0x7fb1840b6670 2024-05-27T10:52:42.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.679+0000 7fb18ae00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb1841685f0 con 0x7fb1840cfde0 2024-05-27T10:52:42.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.679+0000 7fb18a400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb18415e630 0x7fb18414f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:42.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.679+0000 7fb18a400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb18415e630 0x7fb18414f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39398/0 (socket says 172.21.15.47:39398) 2024-05-27T10:52:42.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.679+0000 7fb18a400640 1 -- 172.21.15.47:0/3750119191 learned_addr learned my addr 172.21.15.47:0/3750119191 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:42.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.679+0000 7fb189a00640 1 --2- 172.21.15.47:0/3750119191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1840b6670 0x7fb1841f8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:42.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.679+0000 7fb189000640 1 --2- 172.21.15.47:0/3750119191 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1840cfde0 0x7fb184161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:42.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.679+0000 7fb18a400640 1 -- 172.21.15.47:0/3750119191 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1840cfde0 msgr2=0x7fb184161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:42.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.679+0000 7fb18a400640 1 --2- 172.21.15.47:0/3750119191 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1840cfde0 0x7fb184161210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:42.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.679+0000 7fb18a400640 1 -- 172.21.15.47:0/3750119191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1840b6670 msgr2=0x7fb1841f8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:42.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.679+0000 7fb18a400640 1 --2- 172.21.15.47:0/3750119191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1840b6670 0x7fb1841f8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:42.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.679+0000 7fb18a400640 1 -- 172.21.15.47:0/3750119191 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb184160450 con 0x7fb18415e630 2024-05-27T10:52:42.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.680+0000 7fb18a400640 1 --2- 172.21.15.47:0/3750119191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb18415e630 0x7fb18414f2b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb17c02ac70 tx=0x7fb17c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:42.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.680+0000 7fb181600640 1 -- 172.21.15.47:0/3750119191 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c040070 con 0x7fb18415e630 2024-05-27T10:52:42.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.680+0000 7fb181600640 1 -- 172.21.15.47:0/3750119191 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb17c031bc0 con 0x7fb18415e630 2024-05-27T10:52:42.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.680+0000 7fb181600640 1 -- 172.21.15.47:0/3750119191 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c045460 con 0x7fb18415e630 2024-05-27T10:52:42.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.680+0000 7fb18ae00640 1 -- 172.21.15.47:0/3750119191 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb184160730 con 0x7fb18415e630 2024-05-27T10:52:42.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.680+0000 7fb18ae00640 1 -- 172.21.15.47:0/3750119191 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb184160cf0 con 0x7fb18415e630 2024-05-27T10:52:42.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.681+0000 7fb18ae00640 1 -- 172.21.15.47:0/3750119191 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb18404fce0 con 0x7fb18415e630 2024-05-27T10:52:42.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.682+0000 7fb181600640 1 -- 172.21.15.47:0/3750119191 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb17c039040 con 0x7fb18415e630 2024-05-27T10:52:42.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.684+0000 7fb181600640 1 --2- 172.21.15.47:0/3750119191 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb16806c8f0 0x7fb16806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:42.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.684+0000 7fb181600640 1 -- 172.21.15.47:0/3750119191 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb17c0ad550 con 0x7fb18415e630 2024-05-27T10:52:42.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.684+0000 7fb189a00640 1 --2- 172.21.15.47:0/3750119191 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb16806c8f0 0x7fb16806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:42.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.685+0000 7fb189a00640 1 --2- 172.21.15.47:0/3750119191 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb16806c8f0 0x7fb16806edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb178006fd0 tx=0x7fb178008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:42.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.688+0000 7fb181600640 1 -- 172.21.15.47:0/3750119191 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb17c07ba00 con 0x7fb18415e630 2024-05-27T10:52:42.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.889+0000 7fb18ae00640 1 -- 172.21.15.47:0/3750119191 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb18406e580 con 0x7fb18415e630 2024-05-27T10:52:42.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.890+0000 7fb181600640 1 -- 172.21.15.47:0/3750119191 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fb17c043e40 con 0x7fb18415e630 2024-05-27T10:52:42.887 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-27T10:52:42.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.892+0000 7fb18ae00640 1 -- 172.21.15.47:0/3750119191 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb16806c8f0 msgr2=0x7fb16806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:42.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.892+0000 7fb18ae00640 1 --2- 172.21.15.47:0/3750119191 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb16806c8f0 0x7fb16806edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb178006fd0 tx=0x7fb178008040 comp rx=0 tx=0).stop 2024-05-27T10:52:42.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.892+0000 7fb18ae00640 1 -- 172.21.15.47:0/3750119191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb18415e630 msgr2=0x7fb18414f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:42.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.892+0000 7fb18ae00640 1 --2- 172.21.15.47:0/3750119191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb18415e630 0x7fb18414f2b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb17c02ac70 tx=0x7fb17c004a40 comp rx=0 tx=0).stop 2024-05-27T10:52:42.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.892+0000 7fb18ae00640 1 -- 172.21.15.47:0/3750119191 shutdown_connections 2024-05-27T10:52:42.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.892+0000 7fb18ae00640 1 --2- 172.21.15.47:0/3750119191 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb16806c8f0 0x7fb16806edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:42.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.892+0000 7fb18ae00640 1 --2- 172.21.15.47:0/3750119191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb18415e630 0x7fb18414f2b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:42.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.892+0000 7fb18ae00640 1 --2- 172.21.15.47:0/3750119191 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1840cfde0 0x7fb184161210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:42.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.892+0000 7fb18ae00640 1 --2- 172.21.15.47:0/3750119191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1840b6670 0x7fb1841f8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:42.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.892+0000 7fb18ae00640 1 -- 172.21.15.47:0/3750119191 >> 172.21.15.47:0/3750119191 conn(0x7fb18408bfd0 msgr2=0x7fb1840b4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:42.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.893+0000 7fb18ae00640 1 -- 172.21.15.47:0/3750119191 shutdown_connections 2024-05-27T10:52:42.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:42.893+0000 7fb18ae00640 1 -- 172.21.15.47:0/3750119191 wait complete. 2024-05-27T10:52:42.908 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T10:52:43.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.133+0000 7fc646800640 1 Processor -- start 2024-05-27T10:52:43.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.134+0000 7fc646800640 1 -- start start 2024-05-27T10:52:43.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.135+0000 7fc646800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc64015e630 0x7fc6400d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:43.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.135+0000 7fc646800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc6400cfde0 0x7fc6400d3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:43.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.135+0000 7fc646800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6400ced40 con 0x7fc6400b5f60 2024-05-27T10:52:43.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.135+0000 7fc646800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc6400cf950 con 0x7fc6400cfde0 2024-05-27T10:52:43.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.135+0000 7fc646800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc6400cf020 con 0x7fc64015e630 2024-05-27T10:52:43.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.136+0000 7fc644a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc6400cfde0 0x7fc6400d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:43.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.136+0000 7fc645e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc6400b5f60 0x7fc6401622c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35166/0 (socket says 172.21.15.47:35166) 2024-05-27T10:52:43.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.136+0000 7fc645e00640 1 -- 172.21.15.47:0/4147377248 learned_addr learned my addr 172.21.15.47:0/4147377248 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:43.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.136+0000 7fc645400640 1 --2- 172.21.15.47:0/4147377248 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc64015e630 0x7fc6400d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:43.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.136+0000 7fc644a00640 1 -- 172.21.15.47:0/4147377248 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc64015e630 msgr2=0x7fc6400d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:43.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.136+0000 7fc644a00640 1 --2- 172.21.15.47:0/4147377248 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc64015e630 0x7fc6400d3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:43.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.136+0000 7fc644a00640 1 -- 172.21.15.47:0/4147377248 >> v1:172.21.15.47:6789/0 conn(0x7fc6400b5f60 legacy=0x7fc6401622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:43.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.136+0000 7fc644a00640 1 -- 172.21.15.47:0/4147377248 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6400cf300 con 0x7fc6400cfde0 2024-05-27T10:52:43.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.137+0000 7fc644a00640 1 --2- 172.21.15.47:0/4147377248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6400cfde0 0x7fc6400d3770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc62c0097a0 tx=0x7fc62c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4edd0fe66b0ae39f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:43.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.138+0000 7fc63fe00640 1 -- 172.21.15.47:0/4147377248 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c037070 con 0x7fc6400cfde0 2024-05-27T10:52:43.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.138+0000 7fc63fe00640 1 -- 172.21.15.47:0/4147377248 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc62c032440 con 0x7fc6400cfde0 2024-05-27T10:52:43.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.138+0000 7fc63fe00640 1 -- 172.21.15.47:0/4147377248 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c032810 con 0x7fc6400cfde0 2024-05-27T10:52:43.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.138+0000 7fc646800640 1 -- 172.21.15.47:0/4147377248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6400cfde0 msgr2=0x7fc6400d3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.138+0000 7fc646800640 1 --2- 172.21.15.47:0/4147377248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6400cfde0 0x7fc6400d3770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc62c0097a0 tx=0x7fc62c02a180 comp rx=0 tx=0).stop 2024-05-27T10:52:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.139+0000 7fc646800640 1 -- 172.21.15.47:0/4147377248 shutdown_connections 2024-05-27T10:52:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.139+0000 7fc646800640 1 --2- 172.21.15.47:0/4147377248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6400cfde0 0x7fc6400d3770 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.139+0000 7fc646800640 1 --2- 172.21.15.47:0/4147377248 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc64015e630 0x7fc6400d3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.139+0000 7fc646800640 1 -- 172.21.15.47:0/4147377248 >> 172.21.15.47:0/4147377248 conn(0x7fc64008bfd0 msgr2=0x7fc6400d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.139+0000 7fc646800640 1 -- 172.21.15.47:0/4147377248 shutdown_connections 2024-05-27T10:52:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.139+0000 7fc646800640 1 -- 172.21.15.47:0/4147377248 wait complete. 2024-05-27T10:52:43.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.141+0000 7fc646800640 1 Processor -- start 2024-05-27T10:52:43.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.141+0000 7fc646800640 1 -- start start 2024-05-27T10:52:43.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.142+0000 7fc646800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6400b5f60 0x7fc6400cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:43.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.142+0000 7fc646800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc6400cfde0 0x7fc6400cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:43.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.142+0000 7fc646800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc64015e630 0x7fc6400b97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:43.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.142+0000 7fc646800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc64015eb90 con 0x7fc64015e630 2024-05-27T10:52:43.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.142+0000 7fc646800640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc64015ea10 con 0x7fc6400b5f60 2024-05-27T10:52:43.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.142+0000 7fc646800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc6400b63f0 con 0x7fc6400cfde0 2024-05-27T10:52:43.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.142+0000 7fc645e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc64015e630 0x7fc6400b97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:43.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.142+0000 7fc645e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc64015e630 0x7fc6400b97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39416/0 (socket says 172.21.15.47:39416) 2024-05-27T10:52:43.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.142+0000 7fc645e00640 1 -- 172.21.15.47:0/1395231019 learned_addr learned my addr 172.21.15.47:0/1395231019 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.143+0000 7fc645400640 1 --2- 172.21.15.47:0/1395231019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6400b5f60 0x7fc6400cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.143+0000 7fc644a00640 1 --2- 172.21.15.47:0/1395231019 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc6400cfde0 0x7fc6400cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.143+0000 7fc645e00640 1 -- 172.21.15.47:0/1395231019 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc6400cfde0 msgr2=0x7fc6400cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.143+0000 7fc645e00640 1 --2- 172.21.15.47:0/1395231019 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc6400cfde0 0x7fc6400cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.143+0000 7fc645e00640 1 -- 172.21.15.47:0/1395231019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6400b5f60 msgr2=0x7fc6400cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.143+0000 7fc645e00640 1 --2- 172.21.15.47:0/1395231019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6400b5f60 0x7fc6400cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.143+0000 7fc645e00640 1 -- 172.21.15.47:0/1395231019 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6400cd6f0 con 0x7fc64015e630 2024-05-27T10:52:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.143+0000 7fc645e00640 1 --2- 172.21.15.47:0/1395231019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc64015e630 0x7fc6400b97c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc63800cbc0 tx=0x7fc63800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.143+0000 7fc63d600640 1 -- 172.21.15.47:0/1395231019 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638017070 con 0x7fc64015e630 2024-05-27T10:52:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.144+0000 7fc63d600640 1 -- 172.21.15.47:0/1395231019 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63800ad40 con 0x7fc64015e630 2024-05-27T10:52:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.144+0000 7fc646800640 1 -- 172.21.15.47:0/1395231019 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6400cd9b0 con 0x7fc64015e630 2024-05-27T10:52:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.144+0000 7fc63d600640 1 -- 172.21.15.47:0/1395231019 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638012600 con 0x7fc64015e630 2024-05-27T10:52:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.144+0000 7fc646800640 1 -- 172.21.15.47:0/1395231019 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6400cdf70 con 0x7fc64015e630 2024-05-27T10:52:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.145+0000 7fc646800640 1 -- 172.21.15.47:0/1395231019 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6400b67c0 con 0x7fc64015e630 2024-05-27T10:52:43.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.146+0000 7fc63d600640 1 -- 172.21.15.47:0/1395231019 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc63801a070 con 0x7fc64015e630 2024-05-27T10:52:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.147+0000 7fc63d600640 1 --2- 172.21.15.47:0/1395231019 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc62006c920 0x7fc62006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.147+0000 7fc63d600640 1 -- 172.21.15.47:0/1395231019 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc63808b8a0 con 0x7fc64015e630 2024-05-27T10:52:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.147+0000 7fc645400640 1 --2- 172.21.15.47:0/1395231019 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc62006c920 0x7fc62006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:43.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.148+0000 7fc645400640 1 --2- 172.21.15.47:0/1395231019 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc62006c920 0x7fc62006ede0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc634006fd0 tx=0x7fc634008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:43.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.152+0000 7fc63d600640 1 -- 172.21.15.47:0/1395231019 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc6400b67c0 con 0x7fc64015e630 2024-05-27T10:52:43.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.353+0000 7fc646800640 1 -- 172.21.15.47:0/1395231019 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc64008e600 con 0x7fc64015e630 2024-05-27T10:52:43.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.354+0000 7fc63d600640 1 -- 172.21.15.47:0/1395231019 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fc638059550 con 0x7fc64015e630 2024-05-27T10:52:43.351 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-27T10:52:43.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.356+0000 7fc646800640 1 -- 172.21.15.47:0/1395231019 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc62006c920 msgr2=0x7fc62006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:43.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.357+0000 7fc646800640 1 --2- 172.21.15.47:0/1395231019 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc62006c920 0x7fc62006ede0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc634006fd0 tx=0x7fc634008040 comp rx=0 tx=0).stop 2024-05-27T10:52:43.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.357+0000 7fc646800640 1 -- 172.21.15.47:0/1395231019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc64015e630 msgr2=0x7fc6400b97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:43.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.357+0000 7fc646800640 1 --2- 172.21.15.47:0/1395231019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc64015e630 0x7fc6400b97c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc63800cbc0 tx=0x7fc63800a430 comp rx=0 tx=0).stop 2024-05-27T10:52:43.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.357+0000 7fc646800640 1 -- 172.21.15.47:0/1395231019 shutdown_connections 2024-05-27T10:52:43.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.357+0000 7fc646800640 1 --2- 172.21.15.47:0/1395231019 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc62006c920 0x7fc62006ede0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:43.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.357+0000 7fc646800640 1 --2- 172.21.15.47:0/1395231019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc64015e630 0x7fc6400b97c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:43.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.357+0000 7fc646800640 1 --2- 172.21.15.47:0/1395231019 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc6400cfde0 0x7fc6400cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:43.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.357+0000 7fc646800640 1 --2- 172.21.15.47:0/1395231019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6400b5f60 0x7fc6400cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:43.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.357+0000 7fc646800640 1 -- 172.21.15.47:0/1395231019 >> 172.21.15.47:0/1395231019 conn(0x7fc64008bfd0 msgr2=0x7fc6400b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:43.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.357+0000 7fc646800640 1 -- 172.21.15.47:0/1395231019 shutdown_connections 2024-05-27T10:52:43.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.357+0000 7fc646800640 1 -- 172.21.15.47:0/1395231019 wait complete. 2024-05-27T10:52:43.374 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T10:52:43.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.592+0000 7ff3ed600640 1 Processor -- start 2024-05-27T10:52:43.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.592+0000 7ff3ed600640 1 -- start start 2024-05-27T10:52:43.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.593+0000 7ff3ed600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff3e80d0a30 0x7ff3e8167470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:43.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.593+0000 7ff3ed600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3e80b4620 con 0x7ff3e815c510 2024-05-27T10:52:43.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.593+0000 7ff3ed600640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3e80b4900 con 0x7ff3e806da80 2024-05-27T10:52:43.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.593+0000 7ff3ed600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff3e80b43e0 con 0x7ff3e80d0a30 2024-05-27T10:52:43.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.594+0000 7ff3e7e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff3e815c510 0x7ff3e80b3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35172/0 (socket says 172.21.15.47:35172) 2024-05-27T10:52:43.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.594+0000 7ff3e7e00640 1 -- 172.21.15.47:0/2699140710 learned_addr learned my addr 172.21.15.47:0/2699140710 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:43.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.594+0000 7ff3ecc00640 1 --2- 172.21.15.47:0/2699140710 >> v2:172.21.15.47:3300/0 conn(0x7ff3e80d0a30 0x7ff3e8167470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:43.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.594+0000 7ff3e6a00640 1 -- 172.21.15.47:0/2699140710 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1446456218 0 0) 0x7ff3e80b4620 con 0x7ff3e815c510 2024-05-27T10:52:43.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.594+0000 7ff3e6a00640 1 -- 172.21.15.47:0/2699140710 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3cc003520 con 0x7ff3e815c510 2024-05-27T10:52:43.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.594+0000 7ff3ecc00640 1 -- 172.21.15.47:0/2699140710 >> v1:172.21.15.53:6789/0 conn(0x7ff3e806da80 legacy=0x7ff3e80d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:43.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.594+0000 7ff3ecc00640 1 -- 172.21.15.47:0/2699140710 >> v1:172.21.15.47:6789/0 conn(0x7ff3e815c510 legacy=0x7ff3e80b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:43.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.594+0000 7ff3ecc00640 1 -- 172.21.15.47:0/2699140710 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e80b4be0 con 0x7ff3e80d0a30 2024-05-27T10:52:43.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.596+0000 7ff3ecc00640 1 --2- 172.21.15.47:0/2699140710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3e80d0a30 0x7ff3e8167470 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0009d90 tx=0x7ff3e002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8055f61f16088df server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:43.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.596+0000 7ff3e6a00640 1 -- 172.21.15.47:0/2699140710 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0007740 con 0x7ff3e80d0a30 2024-05-27T10:52:43.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.596+0000 7ff3e6a00640 1 -- 172.21.15.47:0/2699140710 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e00078e0 con 0x7ff3e80d0a30 2024-05-27T10:52:43.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.596+0000 7ff3e6a00640 1 -- 172.21.15.47:0/2699140710 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0007cb0 con 0x7ff3e80d0a30 2024-05-27T10:52:43.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.596+0000 7ff3ed600640 1 -- 172.21.15.47:0/2699140710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3e80d0a30 msgr2=0x7ff3e8167470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:43.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.596+0000 7ff3ed600640 1 --2- 172.21.15.47:0/2699140710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3e80d0a30 0x7ff3e8167470 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0009d90 tx=0x7ff3e002a6f0 comp rx=0 tx=0).stop 2024-05-27T10:52:43.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.597+0000 7ff3ed600640 1 -- 172.21.15.47:0/2699140710 shutdown_connections 2024-05-27T10:52:43.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.597+0000 7ff3ed600640 1 --2- 172.21.15.47:0/2699140710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3e80d0a30 0x7ff3e8167470 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:43.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.597+0000 7ff3ed600640 1 -- 172.21.15.47:0/2699140710 >> 172.21.15.47:0/2699140710 conn(0x7ff3e806bb20 msgr2=0x7ff3e806bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:43.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.597+0000 7ff3ed600640 1 -- 172.21.15.47:0/2699140710 shutdown_connections 2024-05-27T10:52:43.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.597+0000 7ff3ed600640 1 -- 172.21.15.47:0/2699140710 wait complete. 2024-05-27T10:52:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.598+0000 7ff3ed600640 1 Processor -- start 2024-05-27T10:52:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.599+0000 7ff3ed600640 1 -- start start 2024-05-27T10:52:43.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.599+0000 7ff3ed600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff3e806da80 0x7ff3e815cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:43.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.600+0000 7ff3ed600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3e80d0a30 0x7ff3e8155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:43.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.600+0000 7ff3ed600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3e815c510 0x7ff3e815d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:43.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.600+0000 7ff3ed600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e80cfa00 con 0x7ff3e80d0a30 2024-05-27T10:52:43.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.600+0000 7ff3ed600640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e815c8f0 con 0x7ff3e815c510 2024-05-27T10:52:43.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.600+0000 7ff3ed600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e80cfb80 con 0x7ff3e806da80 2024-05-27T10:52:43.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.600+0000 7ff3e7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3e80d0a30 0x7ff3e8155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:43.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.600+0000 7ff3e7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3e80d0a30 0x7ff3e8155920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39434/0 (socket says 172.21.15.47:39434) 2024-05-27T10:52:43.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.600+0000 7ff3e7400640 1 -- 172.21.15.47:0/3259068866 learned_addr learned my addr 172.21.15.47:0/3259068866 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:43.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.600+0000 7ff3ecc00640 1 --2- 172.21.15.47:0/3259068866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3e815c510 0x7ff3e815d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:43.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.600+0000 7ff3e7e00640 1 --2- 172.21.15.47:0/3259068866 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff3e806da80 0x7ff3e815cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:43.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.600+0000 7ff3e7400640 1 -- 172.21.15.47:0/3259068866 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff3e806da80 msgr2=0x7ff3e815cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:43.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.600+0000 7ff3e7400640 1 --2- 172.21.15.47:0/3259068866 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff3e806da80 0x7ff3e815cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:43.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.600+0000 7ff3e7400640 1 -- 172.21.15.47:0/3259068866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3e815c510 msgr2=0x7ff3e815d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:43.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.600+0000 7ff3e7400640 1 --2- 172.21.15.47:0/3259068866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3e815c510 0x7ff3e815d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:43.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.600+0000 7ff3e7400640 1 -- 172.21.15.47:0/3259068866 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e8155e60 con 0x7ff3e80d0a30 2024-05-27T10:52:43.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.601+0000 7ff3e7400640 1 --2- 172.21.15.47:0/3259068866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3e80d0a30 0x7ff3e8155920 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400c400 tx=0x7ff3d400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:43.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.601+0000 7ff3dfe00640 1 -- 172.21.15.47:0/3259068866 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d40052d0 con 0x7ff3e80d0a30 2024-05-27T10:52:43.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.601+0000 7ff3dfe00640 1 -- 172.21.15.47:0/3259068866 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d4005490 con 0x7ff3e80d0a30 2024-05-27T10:52:43.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.601+0000 7ff3dfe00640 1 -- 172.21.15.47:0/3259068866 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4007260 con 0x7ff3e80d0a30 2024-05-27T10:52:43.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.601+0000 7ff3ed600640 1 -- 172.21.15.47:0/3259068866 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e8156df0 con 0x7ff3e80d0a30 2024-05-27T10:52:43.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.601+0000 7ff3ed600640 1 -- 172.21.15.47:0/3259068866 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e81573b0 con 0x7ff3e80d0a30 2024-05-27T10:52:43.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.603+0000 7ff3ed600640 1 -- 172.21.15.47:0/3259068866 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e804fce0 con 0x7ff3e80d0a30 2024-05-27T10:52:43.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.603+0000 7ff3dfe00640 1 -- 172.21.15.47:0/3259068866 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff3d4007400 con 0x7ff3e80d0a30 2024-05-27T10:52:43.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.605+0000 7ff3dfe00640 1 --2- 172.21.15.47:0/3259068866 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff3c806c8f0 0x7ff3c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:43.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.605+0000 7ff3dfe00640 1 -- 172.21.15.47:0/3259068866 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff3d408b050 con 0x7ff3e80d0a30 2024-05-27T10:52:43.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.605+0000 7ff3e7e00640 1 --2- 172.21.15.47:0/3259068866 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff3c806c8f0 0x7ff3c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:43.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.606+0000 7ff3e7e00640 1 --2- 172.21.15.47:0/3259068866 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff3c806c8f0 0x7ff3c806edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff3d80011e0 tx=0x7ff3d8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:43.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.609+0000 7ff3dfe00640 1 -- 172.21.15.47:0/3259068866 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff3e8155e60 con 0x7ff3e80d0a30 2024-05-27T10:52:43.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.816+0000 7ff3ed600640 1 -- 172.21.15.47:0/3259068866 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff3e8156090 con 0x7ff3e80d0a30 2024-05-27T10:52:43.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.817+0000 7ff3dfe00640 1 -- 172.21.15.47:0/3259068866 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7ff3d4059510 con 0x7ff3e80d0a30 2024-05-27T10:52:43.814 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-27T10:52:43.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.820+0000 7ff3ed600640 1 -- 172.21.15.47:0/3259068866 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff3c806c8f0 msgr2=0x7ff3c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:43.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.820+0000 7ff3ed600640 1 --2- 172.21.15.47:0/3259068866 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff3c806c8f0 0x7ff3c806edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff3d80011e0 tx=0x7ff3d8009040 comp rx=0 tx=0).stop 2024-05-27T10:52:43.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.820+0000 7ff3ed600640 1 -- 172.21.15.47:0/3259068866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3e80d0a30 msgr2=0x7ff3e8155920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:43.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.820+0000 7ff3ed600640 1 --2- 172.21.15.47:0/3259068866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3e80d0a30 0x7ff3e8155920 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400c400 tx=0x7ff3d400c8c0 comp rx=0 tx=0).stop 2024-05-27T10:52:43.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.820+0000 7ff3ed600640 1 -- 172.21.15.47:0/3259068866 shutdown_connections 2024-05-27T10:52:43.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.820+0000 7ff3ed600640 1 --2- 172.21.15.47:0/3259068866 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff3c806c8f0 0x7ff3c806edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:43.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.820+0000 7ff3ed600640 1 --2- 172.21.15.47:0/3259068866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3e815c510 0x7ff3e815d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:43.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.820+0000 7ff3ed600640 1 --2- 172.21.15.47:0/3259068866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3e80d0a30 0x7ff3e8155920 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:43.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.820+0000 7ff3ed600640 1 --2- 172.21.15.47:0/3259068866 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff3e806da80 0x7ff3e815cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:43.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.820+0000 7ff3ed600640 1 -- 172.21.15.47:0/3259068866 >> 172.21.15.47:0/3259068866 conn(0x7ff3e806bb20 msgr2=0x7ff3e806e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:43.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.820+0000 7ff3ed600640 1 -- 172.21.15.47:0/3259068866 shutdown_connections 2024-05-27T10:52:43.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:43.820+0000 7ff3ed600640 1 -- 172.21.15.47:0/3259068866 wait complete. 2024-05-27T10:52:43.837 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone' 2024-05-27T10:52:44.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.037+0000 7f8793200640 1 Processor -- start 2024-05-27T10:52:44.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.038+0000 7f8793200640 1 -- start start 2024-05-27T10:52:44.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.039+0000 7f8793200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f879415eaa0 0x7f87940d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:44.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.039+0000 7f8793200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f879406ca40 0x7f87940d2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:44.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.039+0000 7f8793200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87940d0950 con 0x7f879406d240 2024-05-27T10:52:44.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.039+0000 7f8793200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f87940cf4b0 con 0x7f879406ca40 2024-05-27T10:52:44.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.039+0000 7f8793200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f87940cebc0 con 0x7f879415eaa0 2024-05-27T10:52:44.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.040+0000 7f8792800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f879406ca40 0x7f87940d2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:44.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.040+0000 7f8791e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f879406d240 0x7f879406d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35182/0 (socket says 172.21.15.47:35182) 2024-05-27T10:52:44.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.040+0000 7f8791e00640 1 -- 172.21.15.47:0/1162803601 learned_addr learned my addr 172.21.15.47:0/1162803601 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:44.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.040+0000 7f8789400640 1 --2- 172.21.15.47:0/1162803601 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f879415eaa0 0x7f87940d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:44.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.040+0000 7f8792800640 1 -- 172.21.15.47:0/1162803601 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f879415eaa0 msgr2=0x7f87940d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:44.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.040+0000 7f8792800640 1 --2- 172.21.15.47:0/1162803601 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f879415eaa0 0x7f87940d2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:44.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.040+0000 7f8792800640 1 -- 172.21.15.47:0/1162803601 >> v1:172.21.15.47:6789/0 conn(0x7f879406d240 legacy=0x7f879406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:44.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.040+0000 7f8792800640 1 -- 172.21.15.47:0/1162803601 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87940cee60 con 0x7f879406ca40 2024-05-27T10:52:44.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.040+0000 7f8789400640 1 --2- 172.21.15.47:0/1162803601 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f879415eaa0 0x7f87940d2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:52:44.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.041+0000 7f8792800640 1 --2- 172.21.15.47:0/1162803601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f879406ca40 0x7f87940d2bc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f878c009d90 tx=0x7f878c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa93e6d8fdfda37 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:44.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.042+0000 7f8791400640 1 -- 172.21.15.47:0/1162803601 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c007740 con 0x7f879406ca40 2024-05-27T10:52:44.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.042+0000 7f8791400640 1 -- 172.21.15.47:0/1162803601 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f878c0078e0 con 0x7f879406ca40 2024-05-27T10:52:44.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.042+0000 7f8791400640 1 -- 172.21.15.47:0/1162803601 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c007cb0 con 0x7f879406ca40 2024-05-27T10:52:44.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.042+0000 7f8793200640 1 -- 172.21.15.47:0/1162803601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f879406ca40 msgr2=0x7f87940d2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:44.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.042+0000 7f8793200640 1 --2- 172.21.15.47:0/1162803601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f879406ca40 0x7f87940d2bc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f878c009d90 tx=0x7f878c02a660 comp rx=0 tx=0).stop 2024-05-27T10:52:44.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.042+0000 7f8793200640 1 -- 172.21.15.47:0/1162803601 shutdown_connections 2024-05-27T10:52:44.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.042+0000 7f8793200640 1 --2- 172.21.15.47:0/1162803601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f879406ca40 0x7f87940d2bc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:44.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.042+0000 7f8793200640 1 --2- 172.21.15.47:0/1162803601 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f879415eaa0 0x7f87940d2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:44.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.042+0000 7f8793200640 1 -- 172.21.15.47:0/1162803601 >> 172.21.15.47:0/1162803601 conn(0x7f879408bfd0 msgr2=0x7f87940d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:44.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.042+0000 7f8793200640 1 -- 172.21.15.47:0/1162803601 shutdown_connections 2024-05-27T10:52:44.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.042+0000 7f8793200640 1 -- 172.21.15.47:0/1162803601 wait complete. 2024-05-27T10:52:44.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.044+0000 7f8793200640 1 Processor -- start 2024-05-27T10:52:44.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.044+0000 7f8793200640 1 -- start start 2024-05-27T10:52:44.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.045+0000 7f8793200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f879406ca40 0x7f87940b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:44.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.045+0000 7f8793200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f879406d240 0x7f87940ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:44.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.045+0000 7f8793200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f879415eaa0 0x7f879414d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:44.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.045+0000 7f8793200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f87940b10a0 con 0x7f879406d240 2024-05-27T10:52:44.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.045+0000 7f8793200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f879406cf40 con 0x7f879415eaa0 2024-05-27T10:52:44.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.045+0000 7f8793200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f87940b1220 con 0x7f879406ca40 2024-05-27T10:52:44.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.045+0000 7f8789400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f879406d240 0x7f87940ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:44.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.045+0000 7f8789400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f879406d240 0x7f87940ca6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39460/0 (socket says 172.21.15.47:39460) 2024-05-27T10:52:44.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.046+0000 7f8789400640 1 -- 172.21.15.47:0/2778656168 learned_addr learned my addr 172.21.15.47:0/2778656168 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:44.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.046+0000 7f8791e00640 1 --2- 172.21.15.47:0/2778656168 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f879406ca40 0x7f87940b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:44.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.046+0000 7f8792800640 1 --2- 172.21.15.47:0/2778656168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f879415eaa0 0x7f879414d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:44.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.046+0000 7f8789400640 1 -- 172.21.15.47:0/2778656168 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f879406ca40 msgr2=0x7f87940b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:44.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.046+0000 7f8789400640 1 --2- 172.21.15.47:0/2778656168 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f879406ca40 0x7f87940b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:44.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.046+0000 7f8789400640 1 -- 172.21.15.47:0/2778656168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f879415eaa0 msgr2=0x7f879414d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:44.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.046+0000 7f8789400640 1 --2- 172.21.15.47:0/2778656168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f879415eaa0 0x7f879414d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:44.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.046+0000 7f8789400640 1 -- 172.21.15.47:0/2778656168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87941609b0 con 0x7f879406d240 2024-05-27T10:52:44.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.046+0000 7f8789400640 1 --2- 172.21.15.47:0/2778656168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f879406d240 0x7f87940ca6f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f877c00d7d0 tx=0x7f877c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:44.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.046+0000 7f878aa00640 1 -- 172.21.15.47:0/2778656168 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877c018020 con 0x7f879406d240 2024-05-27T10:52:44.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.047+0000 7f878aa00640 1 -- 172.21.15.47:0/2778656168 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f877c004030 con 0x7f879406d240 2024-05-27T10:52:44.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.047+0000 7f8793200640 1 -- 172.21.15.47:0/2778656168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8794160c90 con 0x7f879406d240 2024-05-27T10:52:44.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.047+0000 7f878aa00640 1 -- 172.21.15.47:0/2778656168 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877c004400 con 0x7f879406d240 2024-05-27T10:52:44.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.047+0000 7f8793200640 1 -- 172.21.15.47:0/2778656168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8794161250 con 0x7f879406d240 2024-05-27T10:52:44.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.048+0000 7f8793200640 1 -- 172.21.15.47:0/2778656168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8794161830 con 0x7f879406d240 2024-05-27T10:52:44.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.049+0000 7f878aa00640 1 -- 172.21.15.47:0/2778656168 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f877c005990 con 0x7f879406d240 2024-05-27T10:52:44.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.050+0000 7f878aa00640 1 --2- 172.21.15.47:0/2778656168 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f877006c8f0 0x7f877006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:44.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.050+0000 7f878aa00640 1 -- 172.21.15.47:0/2778656168 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f877c08bc00 con 0x7f879406d240 2024-05-27T10:52:44.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.050+0000 7f8791e00640 1 --2- 172.21.15.47:0/2778656168 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f877006c8f0 0x7f877006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:44.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.051+0000 7f8791e00640 1 --2- 172.21.15.47:0/2778656168 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f877006c8f0 0x7f877006edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8784000f60 tx=0x7f8784009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:44.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.054+0000 7f878aa00640 1 -- 172.21.15.47:0/2778656168 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f877c022020 con 0x7f879406d240 2024-05-27T10:52:44.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.322+0000 7f8793200640 1 -- 172.21.15.47:0/2778656168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone"]} v 0) -- 0x7f879404fce0 con 0x7f879406d240 2024-05-27T10:52:44.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.524+0000 7f878aa00640 1 -- 172.21.15.47:0/2778656168 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone"]}]=0 v59) ==== 163+0+0 (secure 0 0 0) 0x7f877c05a020 con 0x7f879406d240 2024-05-27T10:52:44.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.527+0000 7f8793200640 1 -- 172.21.15.47:0/2778656168 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f877006c8f0 msgr2=0x7f877006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:44.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.527+0000 7f8793200640 1 --2- 172.21.15.47:0/2778656168 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f877006c8f0 0x7f877006edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8784000f60 tx=0x7f8784009040 comp rx=0 tx=0).stop 2024-05-27T10:52:44.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.527+0000 7f8793200640 1 -- 172.21.15.47:0/2778656168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f879406d240 msgr2=0x7f87940ca6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:44.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.527+0000 7f8793200640 1 --2- 172.21.15.47:0/2778656168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f879406d240 0x7f87940ca6f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f877c00d7d0 tx=0x7f877c00dc90 comp rx=0 tx=0).stop 2024-05-27T10:52:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.527+0000 7f8793200640 1 -- 172.21.15.47:0/2778656168 shutdown_connections 2024-05-27T10:52:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.527+0000 7f8793200640 1 --2- 172.21.15.47:0/2778656168 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f877006c8f0 0x7f877006edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.527+0000 7f8793200640 1 --2- 172.21.15.47:0/2778656168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f879415eaa0 0x7f879414d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.527+0000 7f8793200640 1 --2- 172.21.15.47:0/2778656168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f879406d240 0x7f87940ca6f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.527+0000 7f8793200640 1 --2- 172.21.15.47:0/2778656168 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f879406ca40 0x7f87940b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.527+0000 7f8793200640 1 -- 172.21.15.47:0/2778656168 >> 172.21.15.47:0/2778656168 conn(0x7f879408bfd0 msgr2=0x7f87940b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.528+0000 7f8793200640 1 -- 172.21.15.47:0/2778656168 shutdown_connections 2024-05-27T10:52:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.528+0000 7f8793200640 1 -- 172.21.15.47:0/2778656168 wait complete. 2024-05-27T10:52:44.542 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-27T10:52:44.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.760+0000 7fa210a00640 1 Processor -- start 2024-05-27T10:52:44.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.760+0000 7fa210a00640 1 -- start start 2024-05-27T10:52:44.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.762+0000 7fa210a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa20c0d07b0 0x7fa20c0cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:44.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.762+0000 7fa210a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa20c0d0c40 con 0x7fa20c0d0320 2024-05-27T10:52:44.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.762+0000 7fa210a00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa20c06f460 con 0x7fa20c15e660 2024-05-27T10:52:44.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.762+0000 7fa210a00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fa20c0b4440 con 0x7fa20c0d07b0 2024-05-27T10:52:44.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.762+0000 7fa20aa00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa20c0d0320 0x7fa20c0cec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35190/0 (socket says 172.21.15.47:35190) 2024-05-27T10:52:44.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.762+0000 7fa20aa00640 1 -- 172.21.15.47:0/2110467541 learned_addr learned my addr 172.21.15.47:0/2110467541 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:44.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.763+0000 7fa20a000640 1 -- 172.21.15.47:0/2110467541 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4255511920 0 0) 0x7fa20c0d0c40 con 0x7fa20c0d0320 2024-05-27T10:52:44.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.763+0000 7fa20a000640 1 -- 172.21.15.47:0/2110467541 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1f0003520 con 0x7fa20c0d0320 2024-05-27T10:52:44.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.763+0000 7fa20be00640 1 --2- 172.21.15.47:0/2110467541 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa20c0d07b0 0x7fa20c0cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:44.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.763+0000 7fa20a000640 1 -- 172.21.15.47:0/2110467541 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4166760261 0 0) 0x7fa1f0003520 con 0x7fa20c0d0320 2024-05-27T10:52:44.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.763+0000 7fa20a000640 1 -- 172.21.15.47:0/2110467541 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa20c0d07b0 msgr2=0x7fa20c0cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:44.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.763+0000 7fa20a000640 1 --2- 172.21.15.47:0/2110467541 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa20c0d07b0 0x7fa20c0cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:44.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.763+0000 7fa20a000640 1 -- 172.21.15.47:0/2110467541 >> v1:172.21.15.53:6789/0 conn(0x7fa20c15e660 legacy=0x7fa20c06e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:44.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.763+0000 7fa20a000640 1 -- 172.21.15.47:0/2110467541 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20c0b4720 con 0x7fa20c0d0320 2024-05-27T10:52:44.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.763+0000 7fa20a000640 1 -- 172.21.15.47:0/2110467541 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7fa1f8001690 con 0x7fa20c0d0320 2024-05-27T10:52:44.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.763+0000 7fa20a000640 1 -- 172.21.15.47:0/2110467541 >> v1:172.21.15.47:6789/0 conn(0x7fa20c0d0320 legacy=0x7fa20c0cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:44.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.763+0000 7fa20a000640 1 --2- 172.21.15.47:0/2110467541 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa20c0d07b0 0x7fa1f00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:44.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.763+0000 7fa20a000640 1 --2- 172.21.15.47:0/2110467541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1f0004060 0x7fa1f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:44.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.763+0000 7fa20a000640 1 --2- 172.21.15.47:0/2110467541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1f0004d40 0x7fa1f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:44.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.763+0000 7fa20a000640 1 -- 172.21.15.47:0/2110467541 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa20c0b4440 con 0x7fa1f0004060 2024-05-27T10:52:44.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.763+0000 7fa20a000640 1 -- 172.21.15.47:0/2110467541 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f000bc00 con 0x7fa1f0004d40 2024-05-27T10:52:44.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.763+0000 7fa20a000640 1 -- 172.21.15.47:0/2110467541 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f000be00 con 0x7fa20c0d07b0 2024-05-27T10:52:44.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.763+0000 7fa20aa00640 1 --2- 172.21.15.47:0/2110467541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1f0004060 0x7fa1f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:44.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.764+0000 7fa20b400640 1 --2- 172.21.15.47:0/2110467541 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa20c0d07b0 0x7fa1f00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:44.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.764+0000 7fa20be00640 1 --2- 172.21.15.47:0/2110467541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1f0004d40 0x7fa1f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:44.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.764+0000 7fa20aa00640 1 -- 172.21.15.47:0/2110467541 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa20c0d07b0 msgr2=0x7fa1f00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:44.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.764+0000 7fa20aa00640 1 --2- 172.21.15.47:0/2110467541 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa20c0d07b0 0x7fa1f00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:44.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.764+0000 7fa20aa00640 1 -- 172.21.15.47:0/2110467541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1f0004d40 msgr2=0x7fa1f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:44.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.764+0000 7fa20aa00640 1 --2- 172.21.15.47:0/2110467541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1f0004d40 0x7fa1f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:44.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.764+0000 7fa20aa00640 1 -- 172.21.15.47:0/2110467541 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f0003520 con 0x7fa1f0004060 2024-05-27T10:52:44.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.765+0000 7fa20aa00640 1 --2- 172.21.15.47:0/2110467541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1f0004060 0x7fa1f0004800 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800c0e0 tx=0x7fa1f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac353c5b0548c123 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:44.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.765+0000 7fa20a000640 1 -- 172.21.15.47:0/2110467541 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8007c40 con 0x7fa1f0004060 2024-05-27T10:52:44.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.765+0000 7fa20a000640 1 -- 172.21.15.47:0/2110467541 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f8005ad0 con 0x7fa1f0004060 2024-05-27T10:52:44.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.765+0000 7fa20a000640 1 -- 172.21.15.47:0/2110467541 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8007070 con 0x7fa1f0004060 2024-05-27T10:52:44.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.766+0000 7fa210a00640 1 -- 172.21.15.47:0/2110467541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1f0004060 msgr2=0x7fa1f0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:44.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.766+0000 7fa210a00640 1 --2- 172.21.15.47:0/2110467541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1f0004060 0x7fa1f0004800 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800c0e0 tx=0x7fa1f0005830 comp rx=0 tx=0).stop 2024-05-27T10:52:44.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.766+0000 7fa20be00640 1 -- 172.21.15.47:0/2110467541 reap_dead start 2024-05-27T10:52:44.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.766+0000 7fa210a00640 1 -- 172.21.15.47:0/2110467541 shutdown_connections 2024-05-27T10:52:44.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.766+0000 7fa210a00640 1 -- 172.21.15.47:0/2110467541 >> 172.21.15.47:0/2110467541 conn(0x7fa20c06bb20 msgr2=0x7fa20c06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:44.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.766+0000 7fa210a00640 1 -- 172.21.15.47:0/2110467541 shutdown_connections 2024-05-27T10:52:44.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.766+0000 7fa210a00640 1 -- 172.21.15.47:0/2110467541 wait complete. 2024-05-27T10:52:44.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.768+0000 7fa210a00640 1 Processor -- start 2024-05-27T10:52:44.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.768+0000 7fa210a00640 1 -- start start 2024-05-27T10:52:44.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.769+0000 7fa210a00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1f0004060 0x7fa20c14c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:44.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.769+0000 7fa210a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa20c0b1ca0 0x7fa20c0b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:44.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.769+0000 7fa210a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa20c0b07f0 0x7fa20c0b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:44.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.769+0000 7fa210a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa20c0b4f20 con 0x7fa20c0b1ca0 2024-05-27T10:52:44.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.769+0000 7fa210a00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa20c163220 con 0x7fa1f0004060 2024-05-27T10:52:44.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.769+0000 7fa210a00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fa20c15eae0 con 0x7fa20c0b07f0 2024-05-27T10:52:44.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.769+0000 7fa20aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa20c0b1ca0 0x7fa20c0b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:44.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.769+0000 7fa20aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa20c0b1ca0 0x7fa20c0b2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39466/0 (socket says 172.21.15.47:39466) 2024-05-27T10:52:44.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.769+0000 7fa20aa00640 1 -- 172.21.15.47:0/1692762270 learned_addr learned my addr 172.21.15.47:0/1692762270 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:44.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.769+0000 7fa20b400640 1 --2- 172.21.15.47:0/1692762270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1f0004060 0x7fa20c14c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:44.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.769+0000 7fa20be00640 1 --2- 172.21.15.47:0/1692762270 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa20c0b07f0 0x7fa20c0b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:44.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.770+0000 7fa20aa00640 1 -- 172.21.15.47:0/1692762270 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa20c0b07f0 msgr2=0x7fa20c0b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:44.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.770+0000 7fa20aa00640 1 --2- 172.21.15.47:0/1692762270 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa20c0b07f0 0x7fa20c0b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:44.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.770+0000 7fa20aa00640 1 -- 172.21.15.47:0/1692762270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1f0004060 msgr2=0x7fa20c14c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:44.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.770+0000 7fa20aa00640 1 --2- 172.21.15.47:0/1692762270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1f0004060 0x7fa20c14c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:44.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.770+0000 7fa20aa00640 1 -- 172.21.15.47:0/1692762270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20c15ed50 con 0x7fa20c0b1ca0 2024-05-27T10:52:44.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.770+0000 7fa20aa00640 1 --2- 172.21.15.47:0/1692762270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa20c0b1ca0 0x7fa20c0b2120 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800c200 tx=0x7fa20c0b48f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:44.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.770+0000 7fa203400640 1 -- 172.21.15.47:0/1692762270 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8001650 con 0x7fa20c0b1ca0 2024-05-27T10:52:44.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.770+0000 7fa203400640 1 -- 172.21.15.47:0/1692762270 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f8042070 con 0x7fa20c0b1ca0 2024-05-27T10:52:44.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.770+0000 7fa203400640 1 -- 172.21.15.47:0/1692762270 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8007270 con 0x7fa20c0b1ca0 2024-05-27T10:52:44.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.770+0000 7fa210a00640 1 -- 172.21.15.47:0/1692762270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa20c15f030 con 0x7fa20c0b1ca0 2024-05-27T10:52:44.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.770+0000 7fa210a00640 1 -- 172.21.15.47:0/1692762270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa20c14ca80 con 0x7fa20c0b1ca0 2024-05-27T10:52:44.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.771+0000 7fa210a00640 1 -- 172.21.15.47:0/1692762270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa20c04fce0 con 0x7fa20c0b1ca0 2024-05-27T10:52:44.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.772+0000 7fa203400640 1 -- 172.21.15.47:0/1692762270 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa1f8007410 con 0x7fa20c0b1ca0 2024-05-27T10:52:44.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.773+0000 7fa203400640 1 --2- 172.21.15.47:0/1692762270 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa1ec06c940 0x7fa1ec06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:44.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.773+0000 7fa203400640 1 -- 172.21.15.47:0/1692762270 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa1f80abc90 con 0x7fa20c0b1ca0 2024-05-27T10:52:44.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.774+0000 7fa20b400640 1 --2- 172.21.15.47:0/1692762270 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa1ec06c940 0x7fa1ec06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:44.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.774+0000 7fa20b400640 1 --2- 172.21.15.47:0/1692762270 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa1ec06c940 0x7fa1ec06ee00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc007fd0 tx=0x7fa1fc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:44.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.778+0000 7fa203400640 1 -- 172.21.15.47:0/1692762270 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa1f8005aa0 con 0x7fa20c0b1ca0 2024-05-27T10:52:44.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.993+0000 7fa210a00640 1 -- 172.21.15.47:0/1692762270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa20c0ce7a0 con 0x7fa20c0b1ca0 2024-05-27T10:52:44.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:44.998+0000 7fa203400640 1 -- 172.21.15.47:0/1692762270 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fa1f807a130 con 0x7fa20c0b1ca0 2024-05-27T10:52:44.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.001+0000 7fa210a00640 1 -- 172.21.15.47:0/1692762270 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa1ec06c940 msgr2=0x7fa1ec06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:44.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.001+0000 7fa210a00640 1 --2- 172.21.15.47:0/1692762270 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa1ec06c940 0x7fa1ec06ee00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc007fd0 tx=0x7fa1fc009040 comp rx=0 tx=0).stop 2024-05-27T10:52:44.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.001+0000 7fa210a00640 1 -- 172.21.15.47:0/1692762270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa20c0b1ca0 msgr2=0x7fa20c0b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:44.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.001+0000 7fa210a00640 1 --2- 172.21.15.47:0/1692762270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa20c0b1ca0 0x7fa20c0b2120 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800c200 tx=0x7fa20c0b48f0 comp rx=0 tx=0).stop 2024-05-27T10:52:44.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.001+0000 7fa210a00640 1 -- 172.21.15.47:0/1692762270 shutdown_connections 2024-05-27T10:52:44.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.001+0000 7fa210a00640 1 --2- 172.21.15.47:0/1692762270 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa1ec06c940 0x7fa1ec06ee00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:44.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.001+0000 7fa210a00640 1 --2- 172.21.15.47:0/1692762270 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa20c0b07f0 0x7fa20c0b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:44.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.001+0000 7fa210a00640 1 --2- 172.21.15.47:0/1692762270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa20c0b1ca0 0x7fa20c0b2120 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:44.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.001+0000 7fa210a00640 1 --2- 172.21.15.47:0/1692762270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1f0004060 0x7fa20c14c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:44.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.001+0000 7fa210a00640 1 -- 172.21.15.47:0/1692762270 >> 172.21.15.47:0/1692762270 conn(0x7fa20c06bb20 msgr2=0x7fa20c073800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:44.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.001+0000 7fa210a00640 1 -- 172.21.15.47:0/1692762270 shutdown_connections 2024-05-27T10:52:44.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.001+0000 7fa210a00640 1 -- 172.21.15.47:0/1692762270 wait complete. 2024-05-27T10:52:45.018 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-27T10:52:45.018 DEBUG:teuthology.orchestra.run.smithi047:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-27T10:52:45.119 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-27T10:52:45.229 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-27T10:52:45.229 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:52:45.229 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:52:45.290 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:52:45.291 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:52:45.349 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:52:45.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.557+0000 7f2115800640 1 Processor -- start 2024-05-27T10:52:45.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.557+0000 7f2115800640 1 -- start start 2024-05-27T10:52:45.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.558+0000 7f2115800640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f211009b5e0 0x7f2110160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:45.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.559+0000 7f2115800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2110160150 con 0x7f21100b3880 2024-05-27T10:52:45.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.559+0000 7f2115800640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21100d1a60 con 0x7f211015c6c0 2024-05-27T10:52:45.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.559+0000 7f2115800640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f21100d1d00 con 0x7f211009b5e0 2024-05-27T10:52:45.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.559+0000 7f210f400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f21100b3880 0x7f21100b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35192/0 (socket says 172.21.15.47:35192) 2024-05-27T10:52:45.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.559+0000 7f210f400640 1 -- 172.21.15.47:0/2567709972 learned_addr learned my addr 172.21.15.47:0/2567709972 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:45.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.559+0000 7f210ea00640 1 -- 172.21.15.47:0/2567709972 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 992996716 0 0) 0x7f2110160150 con 0x7f21100b3880 2024-05-27T10:52:45.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.559+0000 7f210ea00640 1 -- 172.21.15.47:0/2567709972 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20f4003520 con 0x7f21100b3880 2024-05-27T10:52:45.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.559+0000 7f2114e00640 1 --2- 172.21.15.47:0/2567709972 >> v2:172.21.15.53:3300/0 conn(0x7f211009b5e0 0x7f2110160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:45.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.560+0000 7f210ea00640 1 -- 172.21.15.47:0/2567709972 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2653194679 0 0) 0x7f20f4003520 con 0x7f21100b3880 2024-05-27T10:52:45.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.560+0000 7f210ea00640 1 -- 172.21.15.47:0/2567709972 >> v2:172.21.15.53:3300/0 conn(0x7f211009b5e0 msgr2=0x7f2110160bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:45.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.560+0000 7f210ea00640 1 --2- 172.21.15.47:0/2567709972 >> v2:172.21.15.53:3300/0 conn(0x7f211009b5e0 0x7f2110160bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:45.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.560+0000 7f210ea00640 1 -- 172.21.15.47:0/2567709972 >> v1:172.21.15.53:6789/0 conn(0x7f211015c6c0 legacy=0x7f21100b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:45.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.560+0000 7f210ea00640 1 -- 172.21.15.47:0/2567709972 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21101603c0 con 0x7f21100b3880 2024-05-27T10:52:45.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.560+0000 7f210ea00640 1 -- 172.21.15.47:0/2567709972 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f20fc001670 con 0x7f21100b3880 2024-05-27T10:52:45.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.560+0000 7f210ea00640 1 -- 172.21.15.47:0/2567709972 >> v1:172.21.15.47:6789/0 conn(0x7f21100b3880 legacy=0x7f21100b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.560+0000 7f210ea00640 1 --2- 172.21.15.47:0/2567709972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f40039b0 0x7f20f4003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.560+0000 7f210ea00640 1 --2- 172.21.15.47:0/2567709972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f4004800 0x7f20f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.560+0000 7f210ea00640 1 --2- 172.21.15.47:0/2567709972 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20f40051c0 0x7f20f400fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.560+0000 7f210ea00640 1 -- 172.21.15.47:0/2567709972 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f21100d1d00 con 0x7f20f40039b0 2024-05-27T10:52:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.560+0000 7f210ea00640 1 -- 172.21.15.47:0/2567709972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f20f4010500 con 0x7f20f4004800 2024-05-27T10:52:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.560+0000 7f210ea00640 1 -- 172.21.15.47:0/2567709972 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f20f4010700 con 0x7f20f40051c0 2024-05-27T10:52:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.560+0000 7f210fe00640 1 --2- 172.21.15.47:0/2567709972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f40039b0 0x7f20f4003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.560+0000 7f210f400640 1 --2- 172.21.15.47:0/2567709972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f4004800 0x7f20f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.561+0000 7f2114e00640 1 --2- 172.21.15.47:0/2567709972 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20f40051c0 0x7f20f400fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.561+0000 7f210fe00640 1 -- 172.21.15.47:0/2567709972 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20f40051c0 msgr2=0x7f20f400fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.561+0000 7f210fe00640 1 --2- 172.21.15.47:0/2567709972 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20f40051c0 0x7f20f400fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.561+0000 7f210fe00640 1 -- 172.21.15.47:0/2567709972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f4004800 msgr2=0x7f20f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.561+0000 7f210fe00640 1 --2- 172.21.15.47:0/2567709972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f4004800 0x7f20f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.561+0000 7f210fe00640 1 -- 172.21.15.47:0/2567709972 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f4003520 con 0x7f20f40039b0 2024-05-27T10:52:45.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.561+0000 7f2114e00640 1 --2- 172.21.15.47:0/2567709972 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20f40051c0 0x7f20f400fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:45.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.561+0000 7f2114e00640 1 -- 172.21.15.47:0/2567709972 reap_dead start 2024-05-27T10:52:45.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.562+0000 7f210fe00640 1 --2- 172.21.15.47:0/2567709972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f40039b0 0x7f20f4003db0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2100004480 tx=0x7f20f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124d385cce2a364f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:45.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.562+0000 7f210ea00640 1 -- 172.21.15.47:0/2567709972 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2100037070 con 0x7f20f40039b0 2024-05-27T10:52:45.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.562+0000 7f210ea00640 1 -- 172.21.15.47:0/2567709972 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f210002ad10 con 0x7f20f40039b0 2024-05-27T10:52:45.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.562+0000 7f210ea00640 1 -- 172.21.15.47:0/2567709972 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2100004080 con 0x7f20f40039b0 2024-05-27T10:52:45.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.563+0000 7f2115800640 1 -- 172.21.15.47:0/2567709972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f40039b0 msgr2=0x7f20f4003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:45.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.563+0000 7f2115800640 1 --2- 172.21.15.47:0/2567709972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f40039b0 0x7f20f4003db0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2100004480 tx=0x7f20f4005830 comp rx=0 tx=0).stop 2024-05-27T10:52:45.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.563+0000 7f2115800640 1 -- 172.21.15.47:0/2567709972 shutdown_connections 2024-05-27T10:52:45.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.563+0000 7f2115800640 1 --2- 172.21.15.47:0/2567709972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f40039b0 0x7f20f4003db0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:45.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.563+0000 7f2115800640 1 -- 172.21.15.47:0/2567709972 >> 172.21.15.47:0/2567709972 conn(0x7f21100b7a20 msgr2=0x7f21100b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:45.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.563+0000 7f2115800640 1 -- 172.21.15.47:0/2567709972 shutdown_connections 2024-05-27T10:52:45.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.563+0000 7f2115800640 1 -- 172.21.15.47:0/2567709972 wait complete. 2024-05-27T10:52:45.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.565+0000 7f2115800640 1 Processor -- start 2024-05-27T10:52:45.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.565+0000 7f2115800640 1 -- start start 2024-05-27T10:52:45.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.566+0000 7f2115800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f40039b0 0x7f2110155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:45.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.566+0000 7f2115800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21100b5730 0x7f21100b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:45.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.566+0000 7f2115800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21101f01e0 0x7f21101f0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:45.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.566+0000 7f2115800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2110160bc0 con 0x7f21101f01e0 2024-05-27T10:52:45.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.566+0000 7f2115800640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f21100d1fe0 con 0x7f20f40039b0 2024-05-27T10:52:45.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.566+0000 7f2115800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f2110160d40 con 0x7f21100b5730 2024-05-27T10:52:45.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.566+0000 7f2114e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21101f01e0 0x7f21101f0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.566+0000 7f2114e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21101f01e0 0x7f21101f0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39482/0 (socket says 172.21.15.47:39482) 2024-05-27T10:52:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.566+0000 7f2114e00640 1 -- 172.21.15.47:0/2449004372 learned_addr learned my addr 172.21.15.47:0/2449004372 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.566+0000 7f2114e00640 1 -- 172.21.15.47:0/2449004372 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21100b5730 msgr2=0x7f21100b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.566+0000 7f210fe00640 1 --2- 172.21.15.47:0/2449004372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f40039b0 0x7f2110155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.566+0000 7f2114e00640 1 --2- 172.21.15.47:0/2449004372 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21100b5730 0x7f21100b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.566+0000 7f2114e00640 1 -- 172.21.15.47:0/2449004372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f40039b0 msgr2=0x7f2110155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.567+0000 7f2114e00640 1 --2- 172.21.15.47:0/2449004372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f40039b0 0x7f2110155df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.567+0000 7f2114e00640 1 -- 172.21.15.47:0/2449004372 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21100b5c30 con 0x7f21101f01e0 2024-05-27T10:52:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.567+0000 7f2114e00640 1 --2- 172.21.15.47:0/2449004372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21101f01e0 0x7f21101f0660 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f21100d0100 tx=0x7f210800e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.567+0000 7f2107e00640 1 -- 172.21.15.47:0/2449004372 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210800f040 con 0x7f21101f01e0 2024-05-27T10:52:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.567+0000 7f2107e00640 1 -- 172.21.15.47:0/2449004372 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2108019070 con 0x7f21101f01e0 2024-05-27T10:52:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.567+0000 7f2115800640 1 -- 172.21.15.47:0/2449004372 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21100b5f10 con 0x7f21101f01e0 2024-05-27T10:52:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.567+0000 7f2107e00640 1 -- 172.21.15.47:0/2449004372 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108013850 con 0x7f21101f01e0 2024-05-27T10:52:45.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.567+0000 7f2115800640 1 -- 172.21.15.47:0/2449004372 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21100b64d0 con 0x7f21101f01e0 2024-05-27T10:52:45.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.568+0000 7f2115800640 1 -- 172.21.15.47:0/2449004372 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f211004fce0 con 0x7f21101f01e0 2024-05-27T10:52:45.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.569+0000 7f2107e00640 1 -- 172.21.15.47:0/2449004372 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f21080139f0 con 0x7f21101f01e0 2024-05-27T10:52:45.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.570+0000 7f2107e00640 1 --2- 172.21.15.47:0/2449004372 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f20f006c8f0 0x7f20f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:45.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.570+0000 7f2107e00640 1 -- 172.21.15.47:0/2449004372 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f210808b390 con 0x7f21101f01e0 2024-05-27T10:52:45.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.571+0000 7f210fe00640 1 --2- 172.21.15.47:0/2449004372 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f20f006c8f0 0x7f20f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:45.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.572+0000 7f210fe00640 1 --2- 172.21.15.47:0/2449004372 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f20f006c8f0 0x7f20f006edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2100034000 tx=0x7f210002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:45.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.575+0000 7f2107e00640 1 -- 172.21.15.47:0/2449004372 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f21080597b0 con 0x7f21101f01e0 2024-05-27T10:52:45.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.783+0000 7f2115800640 1 -- 172.21.15.47:0/2449004372 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f211015fe20 con 0x7f21101f01e0 2024-05-27T10:52:45.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.785+0000 7f2107e00640 1 -- 172.21.15.47:0/2449004372 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16521 (secure 0 0 0) 0x7f21080590b0 con 0x7f21101f01e0 2024-05-27T10:52:45.783 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:45.783 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:03.257638+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:52:45.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.788+0000 7f2115800640 1 -- 172.21.15.47:0/2449004372 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f20f006c8f0 msgr2=0x7f20f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:45.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.788+0000 7f2115800640 1 --2- 172.21.15.47:0/2449004372 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f20f006c8f0 0x7f20f006edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2100034000 tx=0x7f210002e000 comp rx=0 tx=0).stop 2024-05-27T10:52:45.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.788+0000 7f2115800640 1 -- 172.21.15.47:0/2449004372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21101f01e0 msgr2=0x7f21101f0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:45.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.788+0000 7f2115800640 1 --2- 172.21.15.47:0/2449004372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21101f01e0 0x7f21101f0660 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f21100d0100 tx=0x7f210800e830 comp rx=0 tx=0).stop 2024-05-27T10:52:45.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.788+0000 7f2115800640 1 -- 172.21.15.47:0/2449004372 shutdown_connections 2024-05-27T10:52:45.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.788+0000 7f2115800640 1 --2- 172.21.15.47:0/2449004372 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f20f006c8f0 0x7f20f006edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:45.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.788+0000 7f2115800640 1 --2- 172.21.15.47:0/2449004372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21101f01e0 0x7f21101f0660 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:45.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.788+0000 7f2115800640 1 --2- 172.21.15.47:0/2449004372 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21100b5730 0x7f21100b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:45.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.788+0000 7f2115800640 1 --2- 172.21.15.47:0/2449004372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f40039b0 0x7f2110155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:45.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.788+0000 7f2115800640 1 -- 172.21.15.47:0/2449004372 >> 172.21.15.47:0/2449004372 conn(0x7f21100b7a20 msgr2=0x7f2110071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:45.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.788+0000 7f2115800640 1 -- 172.21.15.47:0/2449004372 shutdown_connections 2024-05-27T10:52:45.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:45.789+0000 7f2115800640 1 -- 172.21.15.47:0/2449004372 wait complete. 2024-05-27T10:52:45.805 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T10:51:55.073251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T10:51:59.202702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T10:52:00.664039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T10:52:45.806 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T10:52:46.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.023+0000 7f766e600640 1 Processor -- start 2024-05-27T10:52:46.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.023+0000 7f766e600640 1 -- start start 2024-05-27T10:52:46.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.024+0000 7f766e600640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f76680d0a30 0x7f7668167470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.024+0000 7f766e600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76680b4620 con 0x7f766815c510 2024-05-27T10:52:46.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.025+0000 7f766e600640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76680b4900 con 0x7f766806da80 2024-05-27T10:52:46.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.025+0000 7f766e600640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f76680b43e0 con 0x7f76680d0a30 2024-05-27T10:52:46.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.025+0000 7f766d200640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f766815c510 0x7f76680b3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35204/0 (socket says 172.21.15.47:35204) 2024-05-27T10:52:46.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.025+0000 7f766d200640 1 -- 172.21.15.47:0/363830611 learned_addr learned my addr 172.21.15.47:0/363830611 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:46.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.025+0000 7f766dc00640 1 --2- 172.21.15.47:0/363830611 >> v2:172.21.15.53:3300/0 conn(0x7f76680d0a30 0x7f7668167470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.025+0000 7f7667400640 1 -- 172.21.15.47:0/363830611 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 9347123 0 0) 0x7f76680b4620 con 0x7f766815c510 2024-05-27T10:52:46.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.026+0000 7f7667400640 1 -- 172.21.15.47:0/363830611 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7650003520 con 0x7f766815c510 2024-05-27T10:52:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.026+0000 7f7667400640 1 -- 172.21.15.47:0/363830611 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1953119274 0 0) 0x7f7650003520 con 0x7f766815c510 2024-05-27T10:52:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.026+0000 7f7667400640 1 -- 172.21.15.47:0/363830611 >> v2:172.21.15.53:3300/0 conn(0x7f76680d0a30 msgr2=0x7f7668167470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.026+0000 7f7667400640 1 --2- 172.21.15.47:0/363830611 >> v2:172.21.15.53:3300/0 conn(0x7f76680d0a30 0x7f7668167470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.026+0000 7f7667400640 1 -- 172.21.15.47:0/363830611 >> v1:172.21.15.53:6789/0 conn(0x7f766806da80 legacy=0x7f76680d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.026+0000 7f7667400640 1 -- 172.21.15.47:0/363830611 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76680b4be0 con 0x7f766815c510 2024-05-27T10:52:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.026+0000 7f7667400640 1 -- 172.21.15.47:0/363830611 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f765c001670 con 0x7f766815c510 2024-05-27T10:52:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.026+0000 7f7667400640 1 -- 172.21.15.47:0/363830611 >> v1:172.21.15.47:6789/0 conn(0x7f766815c510 legacy=0x7f76680b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.026+0000 7f7667400640 1 --2- 172.21.15.47:0/363830611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7650003a00 0x7f7650003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.026+0000 7f7667400640 1 --2- 172.21.15.47:0/363830611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7650004800 0x7f7650004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.026+0000 7f7667400640 1 --2- 172.21.15.47:0/363830611 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7650005210 0x7f765000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.026+0000 7f7667400640 1 -- 172.21.15.47:0/363830611 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f76680b43e0 con 0x7f7650003a00 2024-05-27T10:52:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.026+0000 7f7667400640 1 -- 172.21.15.47:0/363830611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f765000c160 con 0x7f7650004800 2024-05-27T10:52:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.026+0000 7f7667400640 1 -- 172.21.15.47:0/363830611 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f765000c360 con 0x7f7650005210 2024-05-27T10:52:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.026+0000 7f766d200640 1 --2- 172.21.15.47:0/363830611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7650003a00 0x7f7650003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.027+0000 7f766dc00640 1 --2- 172.21.15.47:0/363830611 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7650005210 0x7f765000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.027+0000 7f766d200640 1 -- 172.21.15.47:0/363830611 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7650005210 msgr2=0x7f765000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.027+0000 7f766d200640 1 --2- 172.21.15.47:0/363830611 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7650005210 0x7f765000b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.027+0000 7f766d200640 1 -- 172.21.15.47:0/363830611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7650004800 msgr2=0x7f7650004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.027+0000 7f7667e00640 1 --2- 172.21.15.47:0/363830611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7650004800 0x7f7650004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.027+0000 7f766d200640 1 --2- 172.21.15.47:0/363830611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7650004800 0x7f7650004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.027+0000 7f766dc00640 1 -- 172.21.15.47:0/363830611 reap_dead start 2024-05-27T10:52:46.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.027+0000 7f766d200640 1 -- 172.21.15.47:0/363830611 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7650003520 con 0x7f7650003a00 2024-05-27T10:52:46.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.027+0000 7f7667e00640 1 --2- 172.21.15.47:0/363830611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7650004800 0x7f7650004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:46.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.028+0000 7f766d200640 1 --2- 172.21.15.47:0/363830611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7650003a00 0x7f7650003e20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f765c00c0e0 tx=0x7f7650005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb3bf6d9aed709a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:46.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.028+0000 7f7667400640 1 -- 172.21.15.47:0/363830611 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c007c20 con 0x7f7650003a00 2024-05-27T10:52:46.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.029+0000 7f7667400640 1 -- 172.21.15.47:0/363830611 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f765c005af0 con 0x7f7650003a00 2024-05-27T10:52:46.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.029+0000 7f7667400640 1 -- 172.21.15.47:0/363830611 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c007070 con 0x7f7650003a00 2024-05-27T10:52:46.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.029+0000 7f766e600640 1 -- 172.21.15.47:0/363830611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7650003a00 msgr2=0x7f7650003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:46.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.029+0000 7f766e600640 1 --2- 172.21.15.47:0/363830611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7650003a00 0x7f7650003e20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f765c00c0e0 tx=0x7f7650005830 comp rx=0 tx=0).stop 2024-05-27T10:52:46.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.029+0000 7f766e600640 1 -- 172.21.15.47:0/363830611 shutdown_connections 2024-05-27T10:52:46.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.029+0000 7f766e600640 1 --2- 172.21.15.47:0/363830611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7650003a00 0x7f7650003e20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.029+0000 7f766e600640 1 -- 172.21.15.47:0/363830611 >> 172.21.15.47:0/363830611 conn(0x7f766806bb20 msgr2=0x7f766806bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:46.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.030+0000 7f766e600640 1 -- 172.21.15.47:0/363830611 shutdown_connections 2024-05-27T10:52:46.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.030+0000 7f766e600640 1 -- 172.21.15.47:0/363830611 wait complete. 2024-05-27T10:52:46.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.031+0000 7f766e600640 1 Processor -- start 2024-05-27T10:52:46.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.032+0000 7f766e600640 1 -- start start 2024-05-27T10:52:46.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.033+0000 7f766e600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7650003a00 0x7f766815e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.033+0000 7f766e600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f766815ccd0 0x7f766809cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.033+0000 7f766e600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f766814ac40 0x7f766814b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.033+0000 7f766e600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f76680d0320 con 0x7f7650003a00 2024-05-27T10:52:46.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.033+0000 7f766e600640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f766815c8f0 con 0x7f766814ac40 2024-05-27T10:52:46.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.033+0000 7f766e600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f76680d04a0 con 0x7f766815ccd0 2024-05-27T10:52:46.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.033+0000 7f766d200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7650003a00 0x7f766815e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.033+0000 7f766d200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7650003a00 0x7f766815e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39504/0 (socket says 172.21.15.47:39504) 2024-05-27T10:52:46.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.033+0000 7f766d200640 1 -- 172.21.15.47:0/2633247917 learned_addr learned my addr 172.21.15.47:0/2633247917 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:46.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.033+0000 7f766dc00640 1 --2- 172.21.15.47:0/2633247917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f766814ac40 0x7f766814b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.033+0000 7f766d200640 1 -- 172.21.15.47:0/2633247917 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f766815ccd0 msgr2=0x7f766809cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:46.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.033+0000 7f7667e00640 1 --2- 172.21.15.47:0/2633247917 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f766815ccd0 0x7f766809cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.033+0000 7f766d200640 1 --2- 172.21.15.47:0/2633247917 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f766815ccd0 0x7f766809cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.033+0000 7f766d200640 1 -- 172.21.15.47:0/2633247917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f766814ac40 msgr2=0x7f766814b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:46.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.033+0000 7f766d200640 1 --2- 172.21.15.47:0/2633247917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f766814ac40 0x7f766814b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.033+0000 7f766d200640 1 -- 172.21.15.47:0/2633247917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f766815e750 con 0x7f7650003a00 2024-05-27T10:52:46.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.034+0000 7f766d200640 1 --2- 172.21.15.47:0/2633247917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7650003a00 0x7f766815e210 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f765c00c0e0 tx=0x7f76680b47f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:46.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.034+0000 7f7664c00640 1 -- 172.21.15.47:0/2633247917 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c037040 con 0x7f7650003a00 2024-05-27T10:52:46.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.034+0000 7f7664c00640 1 -- 172.21.15.47:0/2633247917 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f765c041070 con 0x7f7650003a00 2024-05-27T10:52:46.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.034+0000 7f7664c00640 1 -- 172.21.15.47:0/2633247917 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c001670 con 0x7f7650003a00 2024-05-27T10:52:46.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.034+0000 7f766e600640 1 -- 172.21.15.47:0/2633247917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f766815d170 con 0x7f7650003a00 2024-05-27T10:52:46.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.034+0000 7f766e600640 1 -- 172.21.15.47:0/2633247917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f766815d730 con 0x7f7650003a00 2024-05-27T10:52:46.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.035+0000 7f766e600640 1 -- 172.21.15.47:0/2633247917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f766804fce0 con 0x7f7650003a00 2024-05-27T10:52:46.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.036+0000 7f7664c00640 1 -- 172.21.15.47:0/2633247917 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f765c0049e0 con 0x7f7650003a00 2024-05-27T10:52:46.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.037+0000 7f7664c00640 1 --2- 172.21.15.47:0/2633247917 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f764806c940 0x7f764806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.037+0000 7f7664c00640 1 -- 172.21.15.47:0/2633247917 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f765c0ab840 con 0x7f7650003a00 2024-05-27T10:52:46.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.038+0000 7f7667e00640 1 --2- 172.21.15.47:0/2633247917 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f764806c940 0x7f764806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.038+0000 7f7667e00640 1 --2- 172.21.15.47:0/2633247917 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f764806c940 0x7f764806ee00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7654000c00 tx=0x7f7654009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:46.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.042+0000 7f7664c00640 1 -- 172.21.15.47:0/2633247917 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f765c079de0 con 0x7f7650003a00 2024-05-27T10:52:46.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.243+0000 7f766e600640 1 -- 172.21.15.47:0/2633247917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f76680ce430 con 0x7f7650003a00 2024-05-27T10:52:46.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.244+0000 7f7664c00640 1 -- 172.21.15.47:0/2633247917 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f765c0796e0 con 0x7f7650003a00 2024-05-27T10:52:46.241 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-27T10:52:46.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.246+0000 7f766e600640 1 -- 172.21.15.47:0/2633247917 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f764806c940 msgr2=0x7f764806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:46.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.246+0000 7f766e600640 1 --2- 172.21.15.47:0/2633247917 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f764806c940 0x7f764806ee00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7654000c00 tx=0x7f7654009040 comp rx=0 tx=0).stop 2024-05-27T10:52:46.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.246+0000 7f766e600640 1 -- 172.21.15.47:0/2633247917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7650003a00 msgr2=0x7f766815e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:46.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.246+0000 7f766e600640 1 --2- 172.21.15.47:0/2633247917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7650003a00 0x7f766815e210 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f765c00c0e0 tx=0x7f76680b47f0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.247+0000 7f766e600640 1 -- 172.21.15.47:0/2633247917 shutdown_connections 2024-05-27T10:52:46.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.247+0000 7f766e600640 1 --2- 172.21.15.47:0/2633247917 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f764806c940 0x7f764806ee00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.247+0000 7f766e600640 1 --2- 172.21.15.47:0/2633247917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f766814ac40 0x7f766814b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.247+0000 7f766e600640 1 --2- 172.21.15.47:0/2633247917 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f766815ccd0 0x7f766809cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.247+0000 7f766e600640 1 --2- 172.21.15.47:0/2633247917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7650003a00 0x7f766815e210 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.247+0000 7f766e600640 1 -- 172.21.15.47:0/2633247917 >> 172.21.15.47:0/2633247917 conn(0x7f766806bb20 msgr2=0x7f76680ae1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:46.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.247+0000 7f766e600640 1 -- 172.21.15.47:0/2633247917 shutdown_connections 2024-05-27T10:52:46.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.247+0000 7f766e600640 1 -- 172.21.15.47:0/2633247917 wait complete. 2024-05-27T10:52:46.264 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T10:52:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.485+0000 7f9753e00640 1 Processor -- start 2024-05-27T10:52:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.485+0000 7f9753e00640 1 -- start start 2024-05-27T10:52:46.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.486+0000 7f9753e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f97540cfde0 0x7f97540b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.486+0000 7f9753e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f97540b64a0 0x7f97541685f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.486+0000 7f9753e00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97540ced40 con 0x7f975415e630 2024-05-27T10:52:46.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.486+0000 7f9753e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f97540cf950 con 0x7f97540b64a0 2024-05-27T10:52:46.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.486+0000 7f9753e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f97540cf020 con 0x7f97540cfde0 2024-05-27T10:52:46.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.486+0000 7f9753400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f97540b64a0 0x7f97541685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.486+0000 7f9753400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f97540b64a0 0x7f97541685f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39514/0 (socket says 172.21.15.47:39514) 2024-05-27T10:52:46.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.486+0000 7f9753400640 1 -- 172.21.15.47:0/2156108446 learned_addr learned my addr 172.21.15.47:0/2156108446 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:46.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.487+0000 7f9752000640 1 --2- 172.21.15.47:0/2156108446 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f97540cfde0 0x7f97540b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.487+0000 7f9753400640 1 -- 172.21.15.47:0/2156108446 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f97540cfde0 msgr2=0x7f97540b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:46.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.487+0000 7f9753400640 1 --2- 172.21.15.47:0/2156108446 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f97540cfde0 0x7f97540b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.487+0000 7f9753400640 1 -- 172.21.15.47:0/2156108446 >> v1:172.21.15.53:6789/0 conn(0x7f975415e630 legacy=0x7f97540d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:46.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.487+0000 7f9753400640 1 -- 172.21.15.47:0/2156108446 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97540cf300 con 0x7f97540b64a0 2024-05-27T10:52:46.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.488+0000 7f9753400640 1 --2- 172.21.15.47:0/2156108446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97540b64a0 0x7f97541685f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f974c009e50 tx=0x7f974c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312073bace9adabf server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:46.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.488+0000 7f9751600640 1 -- 172.21.15.47:0/2156108446 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c036070 con 0x7f97540b64a0 2024-05-27T10:52:46.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.488+0000 7f9751600640 1 -- 172.21.15.47:0/2156108446 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f974c031600 con 0x7f97540b64a0 2024-05-27T10:52:46.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.488+0000 7f9751600640 1 -- 172.21.15.47:0/2156108446 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c0319d0 con 0x7f97540b64a0 2024-05-27T10:52:46.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.489+0000 7f9753e00640 1 -- 172.21.15.47:0/2156108446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97540b64a0 msgr2=0x7f97541685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:46.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.489+0000 7f9753e00640 1 --2- 172.21.15.47:0/2156108446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97540b64a0 0x7f97541685f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f974c009e50 tx=0x7f974c02a6c0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.489+0000 7f9753e00640 1 -- 172.21.15.47:0/2156108446 shutdown_connections 2024-05-27T10:52:46.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.489+0000 7f9753e00640 1 --2- 172.21.15.47:0/2156108446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97540b64a0 0x7f97541685f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.489+0000 7f9753e00640 1 --2- 172.21.15.47:0/2156108446 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f97540cfde0 0x7f97540b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.489+0000 7f9753e00640 1 -- 172.21.15.47:0/2156108446 >> 172.21.15.47:0/2156108446 conn(0x7f975408bfd0 msgr2=0x7f97540d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:46.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.489+0000 7f9753e00640 1 -- 172.21.15.47:0/2156108446 shutdown_connections 2024-05-27T10:52:46.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.490+0000 7f9753e00640 1 -- 172.21.15.47:0/2156108446 wait complete. 2024-05-27T10:52:46.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.491+0000 7f9753e00640 1 Processor -- start 2024-05-27T10:52:46.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.491+0000 7f9753e00640 1 -- start start 2024-05-27T10:52:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.492+0000 7f9753e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97540b64a0 0x7f97541604e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.492+0000 7f9753e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f97540cfde0 0x7f97541508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.492+0000 7f9753e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f975415e630 0x7f97540c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.492+0000 7f9753e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f975415eb90 con 0x7f975415e630 2024-05-27T10:52:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.492+0000 7f9753e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f975415ea10 con 0x7f97540b64a0 2024-05-27T10:52:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.492+0000 7f9753e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f97540d3940 con 0x7f97540cfde0 2024-05-27T10:52:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.493+0000 7f9753400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f975415e630 0x7f97540c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.493+0000 7f9753400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f975415e630 0x7f97540c9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39530/0 (socket says 172.21.15.47:39530) 2024-05-27T10:52:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.493+0000 7f9753400640 1 -- 172.21.15.47:0/1536747592 learned_addr learned my addr 172.21.15.47:0/1536747592 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.493+0000 7f9752000640 1 --2- 172.21.15.47:0/1536747592 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f97540cfde0 0x7f97541508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.493+0000 7f9752a00640 1 --2- 172.21.15.47:0/1536747592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97540b64a0 0x7f97541604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.493+0000 7f9753400640 1 -- 172.21.15.47:0/1536747592 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f97540cfde0 msgr2=0x7f97541508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.493+0000 7f9753400640 1 --2- 172.21.15.47:0/1536747592 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f97540cfde0 0x7f97541508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.493+0000 7f9753400640 1 -- 172.21.15.47:0/1536747592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97540b64a0 msgr2=0x7f97541604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.493+0000 7f9753400640 1 --2- 172.21.15.47:0/1536747592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97540b64a0 0x7f97541604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.493+0000 7f9753400640 1 -- 172.21.15.47:0/1536747592 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9754161410 con 0x7f975415e630 2024-05-27T10:52:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.493+0000 7f9752a00640 1 --2- 172.21.15.47:0/1536747592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97540b64a0 0x7f97541604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.494+0000 7f9753400640 1 --2- 172.21.15.47:0/1536747592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f975415e630 0x7f97540c9a70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f974c02acb0 tx=0x7f974c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.494+0000 7f974aa00640 1 -- 172.21.15.47:0/1536747592 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c041020 con 0x7f975415e630 2024-05-27T10:52:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.494+0000 7f974aa00640 1 -- 172.21.15.47:0/1536747592 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f974c008710 con 0x7f975415e630 2024-05-27T10:52:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.494+0000 7f974aa00640 1 -- 172.21.15.47:0/1536747592 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c036040 con 0x7f975415e630 2024-05-27T10:52:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.494+0000 7f9753e00640 1 -- 172.21.15.47:0/1536747592 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f975415fa00 con 0x7f975415e630 2024-05-27T10:52:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.494+0000 7f9753e00640 1 -- 172.21.15.47:0/1536747592 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f975415ffc0 con 0x7f975415e630 2024-05-27T10:52:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.495+0000 7f9753e00640 1 -- 172.21.15.47:0/1536747592 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f975404fce0 con 0x7f975415e630 2024-05-27T10:52:46.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.496+0000 7f974aa00640 1 -- 172.21.15.47:0/1536747592 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f974c044020 con 0x7f975415e630 2024-05-27T10:52:46.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.497+0000 7f974aa00640 1 --2- 172.21.15.47:0/1536747592 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f973006c8f0 0x7f973006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.497+0000 7f974aa00640 1 -- 172.21.15.47:0/1536747592 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f974c0ac870 con 0x7f975415e630 2024-05-27T10:52:46.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.498+0000 7f9752a00640 1 --2- 172.21.15.47:0/1536747592 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f973006c8f0 0x7f973006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.498+0000 7f9752a00640 1 --2- 172.21.15.47:0/1536747592 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f973006c8f0 0x7f973006edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f974400a830 tx=0x7f9744008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:46.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.502+0000 7f974aa00640 1 -- 172.21.15.47:0/1536747592 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f974c04b070 con 0x7f975415e630 2024-05-27T10:52:46.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.711+0000 7f9753e00640 1 -- 172.21.15.47:0/1536747592 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f975408e600 con 0x7f975415e630 2024-05-27T10:52:46.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.711+0000 7f974aa00640 1 -- 172.21.15.47:0/1536747592 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f974c07ac90 con 0x7f975415e630 2024-05-27T10:52:46.708 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-27T10:52:46.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.714+0000 7f9753e00640 1 -- 172.21.15.47:0/1536747592 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f973006c8f0 msgr2=0x7f973006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:46.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.714+0000 7f9753e00640 1 --2- 172.21.15.47:0/1536747592 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f973006c8f0 0x7f973006edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f974400a830 tx=0x7f9744008040 comp rx=0 tx=0).stop 2024-05-27T10:52:46.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.714+0000 7f9753e00640 1 -- 172.21.15.47:0/1536747592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f975415e630 msgr2=0x7f97540c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:46.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.714+0000 7f9753e00640 1 --2- 172.21.15.47:0/1536747592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f975415e630 0x7f97540c9a70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f974c02acb0 tx=0x7f974c004a40 comp rx=0 tx=0).stop 2024-05-27T10:52:46.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.714+0000 7f9753e00640 1 -- 172.21.15.47:0/1536747592 shutdown_connections 2024-05-27T10:52:46.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.714+0000 7f9753e00640 1 --2- 172.21.15.47:0/1536747592 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f973006c8f0 0x7f973006edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.714+0000 7f9753e00640 1 --2- 172.21.15.47:0/1536747592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f975415e630 0x7f97540c9a70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.714+0000 7f9753e00640 1 --2- 172.21.15.47:0/1536747592 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f97540cfde0 0x7f97541508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.714+0000 7f9753e00640 1 --2- 172.21.15.47:0/1536747592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97540b64a0 0x7f97541604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.714+0000 7f9753e00640 1 -- 172.21.15.47:0/1536747592 >> 172.21.15.47:0/1536747592 conn(0x7f975408bfd0 msgr2=0x7f97540b4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:46.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.714+0000 7f9753e00640 1 -- 172.21.15.47:0/1536747592 shutdown_connections 2024-05-27T10:52:46.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.714+0000 7f9753e00640 1 -- 172.21.15.47:0/1536747592 wait complete. 2024-05-27T10:52:46.731 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T10:52:46.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.938+0000 7f5647e00640 1 Processor -- start 2024-05-27T10:52:46.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.938+0000 7f5647e00640 1 -- start start 2024-05-27T10:52:46.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.940+0000 7f5647e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f564806c460 0x7f56480cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.940+0000 7f5647e00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f56480ce110 0x7f56480b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.940+0000 7f5647e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56480b1940 con 0x7f564815e750 2024-05-27T10:52:46.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.940+0000 7f5647e00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f564806c8c0 con 0x7f56480ce110 2024-05-27T10:52:46.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.940+0000 7f5647e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f56480b4290 con 0x7f564806c460 2024-05-27T10:52:46.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.940+0000 7f5646a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f564815e750 0x7f56480ce770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35214/0 (socket says 172.21.15.47:35214) 2024-05-27T10:52:46.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.940+0000 7f5646a00640 1 -- 172.21.15.47:0/4261818660 learned_addr learned my addr 172.21.15.47:0/4261818660 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:46.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.940+0000 7f5647400640 1 --2- 172.21.15.47:0/4261818660 >> v2:172.21.15.53:3300/0 conn(0x7f56480ce110 0x7f56480b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.940+0000 7f5646000640 1 --2- 172.21.15.47:0/4261818660 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f564806c460 0x7f56480cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.941+0000 7f5645600640 1 -- 172.21.15.47:0/4261818660 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352193652 0 0) 0x7f56480b1940 con 0x7f564815e750 2024-05-27T10:52:46.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.941+0000 7f5645600640 1 -- 172.21.15.47:0/4261818660 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f562c003520 con 0x7f564815e750 2024-05-27T10:52:46.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.941+0000 7f5645600640 1 -- 172.21.15.47:0/4261818660 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4154397511 0 0) 0x7f562c003520 con 0x7f564815e750 2024-05-27T10:52:46.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.941+0000 7f5645600640 1 -- 172.21.15.47:0/4261818660 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f564806c460 msgr2=0x7f56480cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:46.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.941+0000 7f5645600640 1 --2- 172.21.15.47:0/4261818660 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f564806c460 0x7f56480cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.941+0000 7f5645600640 1 -- 172.21.15.47:0/4261818660 >> v2:172.21.15.53:3300/0 conn(0x7f56480ce110 msgr2=0x7f56480b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:46.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.941+0000 7f5645600640 1 --2- 172.21.15.47:0/4261818660 >> v2:172.21.15.53:3300/0 conn(0x7f56480ce110 0x7f56480b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.941+0000 7f5645600640 1 -- 172.21.15.47:0/4261818660 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56480b1c20 con 0x7f564815e750 2024-05-27T10:52:46.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.941+0000 7f5645600640 1 -- 172.21.15.47:0/4261818660 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f5638001670 con 0x7f564815e750 2024-05-27T10:52:46.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.941+0000 7f5645600640 1 -- 172.21.15.47:0/4261818660 >> v1:172.21.15.47:6789/0 conn(0x7f564815e750 legacy=0x7f56480ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:46.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.941+0000 7f5645600640 1 --2- 172.21.15.47:0/4261818660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f562c0039b0 0x7f562c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.941+0000 7f5645600640 1 --2- 172.21.15.47:0/4261818660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f562c004800 0x7f562c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.941+0000 7f5645600640 1 --2- 172.21.15.47:0/4261818660 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f564806c460 0x7f562c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.941+0000 7f5645600640 1 -- 172.21.15.47:0/4261818660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f56480b4290 con 0x7f562c004800 2024-05-27T10:52:46.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.941+0000 7f5645600640 1 -- 172.21.15.47:0/4261818660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f562c00b9c0 con 0x7f562c0039b0 2024-05-27T10:52:46.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.941+0000 7f5645600640 1 -- 172.21.15.47:0/4261818660 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f562c00bb40 con 0x7f564806c460 2024-05-27T10:52:46.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.941+0000 7f5646000640 1 --2- 172.21.15.47:0/4261818660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f562c004800 0x7f562c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.942+0000 7f5646a00640 1 --2- 172.21.15.47:0/4261818660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f562c0039b0 0x7f562c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.942+0000 7f5646000640 1 -- 172.21.15.47:0/4261818660 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f564806c460 msgr2=0x7f562c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:46.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.942+0000 7f5646000640 1 --2- 172.21.15.47:0/4261818660 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f564806c460 0x7f562c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.942+0000 7f5646000640 1 -- 172.21.15.47:0/4261818660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f562c0039b0 msgr2=0x7f562c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:46.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.942+0000 7f5646000640 1 --2- 172.21.15.47:0/4261818660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f562c0039b0 0x7f562c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.942+0000 7f5646000640 1 -- 172.21.15.47:0/4261818660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562c003520 con 0x7f562c004800 2024-05-27T10:52:46.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.943+0000 7f5646000640 1 --2- 172.21.15.47:0/4261818660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f562c004800 0x7f562c004c80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5630009af0 tx=0x7f562c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710507763e4b1f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:46.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.943+0000 7f5645600640 1 -- 172.21.15.47:0/4261818660 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630036070 con 0x7f562c004800 2024-05-27T10:52:46.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.943+0000 7f5645600640 1 -- 172.21.15.47:0/4261818660 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5630031400 con 0x7f562c004800 2024-05-27T10:52:46.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.943+0000 7f5645600640 1 -- 172.21.15.47:0/4261818660 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630009690 con 0x7f562c004800 2024-05-27T10:52:46.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.944+0000 7f5647e00640 1 -- 172.21.15.47:0/4261818660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f562c004800 msgr2=0x7f562c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:46.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.944+0000 7f5647e00640 1 --2- 172.21.15.47:0/4261818660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f562c004800 0x7f562c004c80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5630009af0 tx=0x7f562c005830 comp rx=0 tx=0).stop 2024-05-27T10:52:46.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.944+0000 7f5647400640 1 -- 172.21.15.47:0/4261818660 reap_dead start 2024-05-27T10:52:46.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.944+0000 7f5647e00640 1 -- 172.21.15.47:0/4261818660 shutdown_connections 2024-05-27T10:52:46.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.944+0000 7f5647e00640 1 -- 172.21.15.47:0/4261818660 >> 172.21.15.47:0/4261818660 conn(0x7f564809aa40 msgr2=0x7f56480b65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:46.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.944+0000 7f5647e00640 1 -- 172.21.15.47:0/4261818660 shutdown_connections 2024-05-27T10:52:46.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.944+0000 7f5647e00640 1 -- 172.21.15.47:0/4261818660 wait complete. 2024-05-27T10:52:46.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.946+0000 7f5647e00640 1 Processor -- start 2024-05-27T10:52:46.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.946+0000 7f5647e00640 1 -- start start 2024-05-27T10:52:46.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.947+0000 7f5647e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f562c004800 0x7f564814ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.947+0000 7f5647e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5648152150 0x7f56481f7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.947+0000 7f5647e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56481f7ea0 0x7f56480af100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.947+0000 7f5647e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f564815ecb0 con 0x7f562c004800 2024-05-27T10:52:46.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.947+0000 7f5647e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f564815eb30 con 0x7f56481f7ea0 2024-05-27T10:52:46.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.947+0000 7f5647e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f56480cdbd0 con 0x7f5648152150 2024-05-27T10:52:46.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.947+0000 7f5646a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f562c004800 0x7f564814ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.947+0000 7f5646a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f562c004800 0x7f564814ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39548/0 (socket says 172.21.15.47:39548) 2024-05-27T10:52:46.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.947+0000 7f5646a00640 1 -- 172.21.15.47:0/3514184368 learned_addr learned my addr 172.21.15.47:0/3514184368 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:46.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.948+0000 7f5647400640 1 --2- 172.21.15.47:0/3514184368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56481f7ea0 0x7f56480af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.948+0000 7f5646000640 1 --2- 172.21.15.47:0/3514184368 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5648152150 0x7f56481f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.948+0000 7f5646a00640 1 -- 172.21.15.47:0/3514184368 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5648152150 msgr2=0x7f56481f7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:46.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.948+0000 7f5646a00640 1 --2- 172.21.15.47:0/3514184368 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5648152150 0x7f56481f7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.948+0000 7f5646a00640 1 -- 172.21.15.47:0/3514184368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56481f7ea0 msgr2=0x7f56480af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:46.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.948+0000 7f5646a00640 1 --2- 172.21.15.47:0/3514184368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56481f7ea0 0x7f56480af100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:46.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.948+0000 7f5646a00640 1 -- 172.21.15.47:0/3514184368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56481f83e0 con 0x7f562c004800 2024-05-27T10:52:46.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.948+0000 7f5646000640 1 --2- 172.21.15.47:0/3514184368 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5648152150 0x7f56481f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:46.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.948+0000 7f5646a00640 1 --2- 172.21.15.47:0/3514184368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f562c004800 0x7f564814ab40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f563800e8a0 tx=0x7f563800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:46.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.949+0000 7f563f400640 1 -- 172.21.15.47:0/3514184368 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638019070 con 0x7f562c004800 2024-05-27T10:52:46.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.949+0000 7f563f400640 1 -- 172.21.15.47:0/3514184368 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f563800c870 con 0x7f562c004800 2024-05-27T10:52:46.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.949+0000 7f563f400640 1 -- 172.21.15.47:0/3514184368 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563800cc60 con 0x7f562c004800 2024-05-27T10:52:46.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.949+0000 7f5647e00640 1 -- 172.21.15.47:0/3514184368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56481f86c0 con 0x7f562c004800 2024-05-27T10:52:46.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.949+0000 7f5647e00640 1 -- 172.21.15.47:0/3514184368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56480cbf10 con 0x7f562c004800 2024-05-27T10:52:46.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.950+0000 7f5647e00640 1 -- 172.21.15.47:0/3514184368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56480cc110 con 0x7f562c004800 2024-05-27T10:52:46.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.951+0000 7f563f400640 1 -- 172.21.15.47:0/3514184368 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5638012380 con 0x7f562c004800 2024-05-27T10:52:46.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.952+0000 7f563f400640 1 --2- 172.21.15.47:0/3514184368 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f562406c920 0x7f562406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:46.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.952+0000 7f563f400640 1 -- 172.21.15.47:0/3514184368 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f563808b3a0 con 0x7f562c004800 2024-05-27T10:52:46.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.952+0000 7f5646000640 1 --2- 172.21.15.47:0/3514184368 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f562406c920 0x7f562406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:46.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.953+0000 7f5646000640 1 --2- 172.21.15.47:0/3514184368 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f562406c920 0x7f562406ede0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5630033000 tx=0x7f5630008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:46.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:46.957+0000 7f563f400640 1 -- 172.21.15.47:0/3514184368 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f56480cc110 con 0x7f562c004800 2024-05-27T10:52:47.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.168+0000 7f5647e00640 1 -- 172.21.15.47:0/3514184368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f56480b1300 con 0x7f562c004800 2024-05-27T10:52:47.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.168+0000 7f563f400640 1 -- 172.21.15.47:0/3514184368 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f56380597c0 con 0x7f562c004800 2024-05-27T10:52:47.165 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-27T10:52:47.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.171+0000 7f5647e00640 1 -- 172.21.15.47:0/3514184368 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f562406c920 msgr2=0x7f562406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:47.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.171+0000 7f5647e00640 1 --2- 172.21.15.47:0/3514184368 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f562406c920 0x7f562406ede0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5630033000 tx=0x7f5630008030 comp rx=0 tx=0).stop 2024-05-27T10:52:47.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.171+0000 7f5647e00640 1 -- 172.21.15.47:0/3514184368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f562c004800 msgr2=0x7f564814ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:47.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.171+0000 7f5647e00640 1 --2- 172.21.15.47:0/3514184368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f562c004800 0x7f564814ab40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f563800e8a0 tx=0x7f563800ed60 comp rx=0 tx=0).stop 2024-05-27T10:52:47.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.172+0000 7f5647e00640 1 -- 172.21.15.47:0/3514184368 shutdown_connections 2024-05-27T10:52:47.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.172+0000 7f5647e00640 1 --2- 172.21.15.47:0/3514184368 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f562406c920 0x7f562406ede0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:47.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.172+0000 7f5647e00640 1 --2- 172.21.15.47:0/3514184368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56481f7ea0 0x7f56480af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:47.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.172+0000 7f5647e00640 1 --2- 172.21.15.47:0/3514184368 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5648152150 0x7f56481f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:47.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.172+0000 7f5647e00640 1 --2- 172.21.15.47:0/3514184368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f562c004800 0x7f564814ab40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:47.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.172+0000 7f5647e00640 1 -- 172.21.15.47:0/3514184368 >> 172.21.15.47:0/3514184368 conn(0x7f564809aa40 msgr2=0x7f564806ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:47.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.172+0000 7f5647e00640 1 -- 172.21.15.47:0/3514184368 shutdown_connections 2024-05-27T10:52:47.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.172+0000 7f5647e00640 1 -- 172.21.15.47:0/3514184368 wait complete. 2024-05-27T10:52:47.188 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T10:52:47.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.409+0000 7f60d1800640 1 Processor -- start 2024-05-27T10:52:47.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.409+0000 7f60d1800640 1 -- start start 2024-05-27T10:52:47.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.410+0000 7f60d1800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f60cc15c420 0x7f60cc071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:47.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.411+0000 7f60d1800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f60cc0b4ab0 0x7f60cc0d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:47.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.411+0000 7f60d1800640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60cc15c800 con 0x7f60cc073c50 2024-05-27T10:52:47.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.411+0000 7f60d1800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f60cc0afc90 con 0x7f60cc0b4ab0 2024-05-27T10:52:47.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.411+0000 7f60d1800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f60cc0ad2e0 con 0x7f60cc15c420 2024-05-27T10:52:47.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.411+0000 7f60c3e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f60cc0b4ab0 0x7f60cc0d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:47.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.411+0000 7f60c3e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f60cc0b4ab0 0x7f60cc0d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39552/0 (socket says 172.21.15.47:39552) 2024-05-27T10:52:47.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.411+0000 7f60c3e00640 1 -- 172.21.15.47:0/3838758070 learned_addr learned my addr 172.21.15.47:0/3838758070 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:47.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.411+0000 7f60cbe00640 1 --2- 172.21.15.47:0/3838758070 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f60cc15c420 0x7f60cc071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:47.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.411+0000 7f60c3e00640 1 -- 172.21.15.47:0/3838758070 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f60cc15c420 msgr2=0x7f60cc071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:47.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.411+0000 7f60c3e00640 1 --2- 172.21.15.47:0/3838758070 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f60cc15c420 0x7f60cc071fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:47.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.411+0000 7f60c3e00640 1 -- 172.21.15.47:0/3838758070 >> v1:172.21.15.53:6789/0 conn(0x7f60cc073c50 legacy=0x7f60cc0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:47.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.411+0000 7f60c3e00640 1 -- 172.21.15.47:0/3838758070 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60cc0ad5c0 con 0x7f60cc0b4ab0 2024-05-27T10:52:47.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.413+0000 7f60c3e00640 1 --2- 172.21.15.47:0/3838758070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc0b4ab0 0x7f60cc0d0360 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009870 tx=0x7f60b402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d20fba24c50db2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:47.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.413+0000 7f60cb400640 1 -- 172.21.15.47:0/3838758070 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b4037070 con 0x7f60cc0b4ab0 2024-05-27T10:52:47.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.413+0000 7f60cb400640 1 -- 172.21.15.47:0/3838758070 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60b4032440 con 0x7f60cc0b4ab0 2024-05-27T10:52:47.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.413+0000 7f60cb400640 1 -- 172.21.15.47:0/3838758070 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b4032810 con 0x7f60cc0b4ab0 2024-05-27T10:52:47.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.414+0000 7f60d1800640 1 -- 172.21.15.47:0/3838758070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc0b4ab0 msgr2=0x7f60cc0d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:47.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.414+0000 7f60d1800640 1 --2- 172.21.15.47:0/3838758070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc0b4ab0 0x7f60cc0d0360 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009870 tx=0x7f60b402a180 comp rx=0 tx=0).stop 2024-05-27T10:52:47.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.414+0000 7f60d1800640 1 -- 172.21.15.47:0/3838758070 shutdown_connections 2024-05-27T10:52:47.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.414+0000 7f60d1800640 1 --2- 172.21.15.47:0/3838758070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc0b4ab0 0x7f60cc0d0360 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:47.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.414+0000 7f60d1800640 1 --2- 172.21.15.47:0/3838758070 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f60cc15c420 0x7f60cc071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:47.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.414+0000 7f60d1800640 1 -- 172.21.15.47:0/3838758070 >> 172.21.15.47:0/3838758070 conn(0x7f60cc06bb20 msgr2=0x7f60cc06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:47.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.414+0000 7f60d1800640 1 -- 172.21.15.47:0/3838758070 shutdown_connections 2024-05-27T10:52:47.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.414+0000 7f60d1800640 1 -- 172.21.15.47:0/3838758070 wait complete. 2024-05-27T10:52:47.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.416+0000 7f60d1800640 1 Processor -- start 2024-05-27T10:52:47.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.416+0000 7f60d1800640 1 -- start start 2024-05-27T10:52:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.417+0000 7f60d1800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f60cc073c50 0x7f60cc14d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.417+0000 7f60d1800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60cc0b4ab0 0x7f60cc15d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.417+0000 7f60d1800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc15c420 0x7f60cc0727a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.417+0000 7f60d1800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f60cc0af8f0 con 0x7f60cc15c420 2024-05-27T10:52:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.417+0000 7f60d1800640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f60cc0ad8a0 con 0x7f60cc0b4ab0 2024-05-27T10:52:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.417+0000 7f60d1800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f60cc0afa70 con 0x7f60cc073c50 2024-05-27T10:52:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.417+0000 7f60d0e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc15c420 0x7f60cc0727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.417+0000 7f60d0e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc15c420 0x7f60cc0727a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39566/0 (socket says 172.21.15.47:39566) 2024-05-27T10:52:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.417+0000 7f60d0e00640 1 -- 172.21.15.47:0/1647237085 learned_addr learned my addr 172.21.15.47:0/1647237085 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.417+0000 7f60c3e00640 1 --2- 172.21.15.47:0/1647237085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60cc0b4ab0 0x7f60cc15d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.418+0000 7f60d0e00640 1 -- 172.21.15.47:0/1647237085 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f60cc073c50 msgr2=0x7f60cc14d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.418+0000 7f60cbe00640 1 --2- 172.21.15.47:0/1647237085 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f60cc073c50 0x7f60cc14d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.418+0000 7f60d0e00640 1 --2- 172.21.15.47:0/1647237085 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f60cc073c50 0x7f60cc14d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.418+0000 7f60d0e00640 1 -- 172.21.15.47:0/1647237085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60cc0b4ab0 msgr2=0x7f60cc15d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.418+0000 7f60d0e00640 1 --2- 172.21.15.47:0/1647237085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60cc0b4ab0 0x7f60cc15d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.418+0000 7f60d0e00640 1 -- 172.21.15.47:0/1647237085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60cc15d940 con 0x7f60cc15c420 2024-05-27T10:52:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.418+0000 7f60c3e00640 1 --2- 172.21.15.47:0/1647237085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60cc0b4ab0 0x7f60cc15d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.418+0000 7f60d0e00640 1 --2- 172.21.15.47:0/1647237085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc15c420 0x7f60cc0727a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f60c400c7b0 tx=0x7f60c400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.418+0000 7f60c8c00640 1 -- 172.21.15.47:0/1647237085 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c4004b60 con 0x7f60cc15c420 2024-05-27T10:52:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.418+0000 7f60c8c00640 1 -- 172.21.15.47:0/1647237085 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60c4004d00 con 0x7f60cc15c420 2024-05-27T10:52:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.418+0000 7f60c8c00640 1 -- 172.21.15.47:0/1647237085 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c400aa90 con 0x7f60cc15c420 2024-05-27T10:52:47.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.418+0000 7f60d1800640 1 -- 172.21.15.47:0/1647237085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60cc15dbe0 con 0x7f60cc15c420 2024-05-27T10:52:47.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.419+0000 7f60d1800640 1 -- 172.21.15.47:0/1647237085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60cc15e1a0 con 0x7f60cc15c420 2024-05-27T10:52:47.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.420+0000 7f60d1800640 1 -- 172.21.15.47:0/1647237085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60cc04fce0 con 0x7f60cc15c420 2024-05-27T10:52:47.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.421+0000 7f60c8c00640 1 -- 172.21.15.47:0/1647237085 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f60c400ac30 con 0x7f60cc15c420 2024-05-27T10:52:47.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.422+0000 7f60c8c00640 1 --2- 172.21.15.47:0/1647237085 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f60a806c8f0 0x7f60a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:47.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.422+0000 7f60c8c00640 1 -- 172.21.15.47:0/1647237085 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f60c408be70 con 0x7f60cc15c420 2024-05-27T10:52:47.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.422+0000 7f60cbe00640 1 --2- 172.21.15.47:0/1647237085 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f60a806c8f0 0x7f60a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:47.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.423+0000 7f60cbe00640 1 --2- 172.21.15.47:0/1647237085 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f60a806c8f0 0x7f60a806edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00b7c0 tx=0x7f60bc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:47.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.426+0000 7f60c8c00640 1 -- 172.21.15.47:0/1647237085 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f60c4020070 con 0x7f60cc15c420 2024-05-27T10:52:47.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.660+0000 7f60d1800640 1 -- 172.21.15.47:0/1647237085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f60cc073a30 con 0x7f60cc15c420 2024-05-27T10:52:47.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.660+0000 7f60c8c00640 1 -- 172.21.15.47:0/1647237085 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f60c405a200 con 0x7f60cc15c420 2024-05-27T10:52:47.657 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-05-27T10:52:47.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.663+0000 7f60d1800640 1 -- 172.21.15.47:0/1647237085 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f60a806c8f0 msgr2=0x7f60a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:47.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.663+0000 7f60d1800640 1 --2- 172.21.15.47:0/1647237085 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f60a806c8f0 0x7f60a806edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00b7c0 tx=0x7f60bc008040 comp rx=0 tx=0).stop 2024-05-27T10:52:47.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.663+0000 7f60d1800640 1 -- 172.21.15.47:0/1647237085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc15c420 msgr2=0x7f60cc0727a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:47.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.663+0000 7f60d1800640 1 --2- 172.21.15.47:0/1647237085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc15c420 0x7f60cc0727a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f60c400c7b0 tx=0x7f60c400cc70 comp rx=0 tx=0).stop 2024-05-27T10:52:47.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.663+0000 7f60d1800640 1 -- 172.21.15.47:0/1647237085 shutdown_connections 2024-05-27T10:52:47.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.663+0000 7f60d1800640 1 --2- 172.21.15.47:0/1647237085 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f60a806c8f0 0x7f60a806edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:47.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.663+0000 7f60d1800640 1 --2- 172.21.15.47:0/1647237085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc15c420 0x7f60cc0727a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:47.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.663+0000 7f60d1800640 1 --2- 172.21.15.47:0/1647237085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60cc0b4ab0 0x7f60cc15d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:47.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.663+0000 7f60d1800640 1 --2- 172.21.15.47:0/1647237085 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f60cc073c50 0x7f60cc14d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:47.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.663+0000 7f60d1800640 1 -- 172.21.15.47:0/1647237085 >> 172.21.15.47:0/1647237085 conn(0x7f60cc06bb20 msgr2=0x7f60cc06f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:47.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.664+0000 7f60d1800640 1 -- 172.21.15.47:0/1647237085 shutdown_connections 2024-05-27T10:52:47.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.664+0000 7f60d1800640 1 -- 172.21.15.47:0/1647237085 wait complete. 2024-05-27T10:52:47.680 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:52:47.680 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:52:47.731 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:52:47.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.932+0000 7ff4e0e00640 1 Processor -- start 2024-05-27T10:52:47.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.933+0000 7ff4e0e00640 1 -- start start 2024-05-27T10:52:47.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.934+0000 7ff4e0e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff4dc15aca0 0x7ff4dc0b4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:47.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.934+0000 7ff4e0e00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff4dc0723d0 0x7ff4dc072840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:47.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.934+0000 7ff4e0e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4dc06e820 con 0x7ff4dc15a8c0 2024-05-27T10:52:47.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.934+0000 7ff4e0e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff4dc072d80 con 0x7ff4dc15aca0 2024-05-27T10:52:47.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.934+0000 7ff4e0e00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ff4dc06eb00 con 0x7ff4dc0723d0 2024-05-27T10:52:47.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.934+0000 7ff4db400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff4dc15a8c0 0x7ff4dc06f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35226/0 (socket says 172.21.15.47:35226) 2024-05-27T10:52:47.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.934+0000 7ff4db400640 1 -- 172.21.15.47:0/1222440130 learned_addr learned my addr 172.21.15.47:0/1222440130 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:47.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.934+0000 7ff4d3e00640 1 --2- 172.21.15.47:0/1222440130 >> v2:172.21.15.47:3300/0 conn(0x7ff4dc15aca0 0x7ff4dc0b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:47.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.935+0000 7ff4dbe00640 1 --2- 172.21.15.47:0/1222440130 >> v2:172.21.15.53:3300/0 conn(0x7ff4dc0723d0 0x7ff4dc072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:47.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.935+0000 7ff4d3e00640 1 -- 172.21.15.47:0/1222440130 >> v2:172.21.15.53:3300/0 conn(0x7ff4dc0723d0 msgr2=0x7ff4dc072840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:47.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.935+0000 7ff4d3e00640 1 --2- 172.21.15.47:0/1222440130 >> v2:172.21.15.53:3300/0 conn(0x7ff4dc0723d0 0x7ff4dc072840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:47.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.935+0000 7ff4d3e00640 1 -- 172.21.15.47:0/1222440130 >> v1:172.21.15.47:6789/0 conn(0x7ff4dc15a8c0 legacy=0x7ff4dc06f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:47.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.935+0000 7ff4d3e00640 1 -- 172.21.15.47:0/1222440130 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4dc06ede0 con 0x7ff4dc15aca0 2024-05-27T10:52:47.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.935+0000 7ff4dbe00640 1 --2- 172.21.15.47:0/1222440130 >> v2:172.21.15.53:3300/0 conn(0x7ff4dc0723d0 0x7ff4dc072840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:47.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.936+0000 7ff4d3e00640 1 --2- 172.21.15.47:0/1222440130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4dc15aca0 0x7ff4dc0b4520 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc073140 tx=0x7ff4c402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4d4ad965a64543 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:47.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.936+0000 7ff4daa00640 1 -- 172.21.15.47:0/1222440130 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4037070 con 0x7ff4dc15aca0 2024-05-27T10:52:47.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.936+0000 7ff4daa00640 1 -- 172.21.15.47:0/1222440130 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c4032440 con 0x7ff4dc15aca0 2024-05-27T10:52:47.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.936+0000 7ff4daa00640 1 -- 172.21.15.47:0/1222440130 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4032810 con 0x7ff4dc15aca0 2024-05-27T10:52:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.937+0000 7ff4e0e00640 1 -- 172.21.15.47:0/1222440130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4dc15aca0 msgr2=0x7ff4dc0b4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.937+0000 7ff4e0e00640 1 --2- 172.21.15.47:0/1222440130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4dc15aca0 0x7ff4dc0b4520 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc073140 tx=0x7ff4c402a1a0 comp rx=0 tx=0).stop 2024-05-27T10:52:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.937+0000 7ff4e0e00640 1 -- 172.21.15.47:0/1222440130 shutdown_connections 2024-05-27T10:52:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.937+0000 7ff4e0e00640 1 --2- 172.21.15.47:0/1222440130 >> v2:172.21.15.53:3300/0 conn(0x7ff4dc0723d0 0x7ff4dc072840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.937+0000 7ff4e0e00640 1 --2- 172.21.15.47:0/1222440130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4dc15aca0 0x7ff4dc0b4520 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.937+0000 7ff4e0e00640 1 -- 172.21.15.47:0/1222440130 >> 172.21.15.47:0/1222440130 conn(0x7ff4dc06bb20 msgr2=0x7ff4dc06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.937+0000 7ff4e0e00640 1 -- 172.21.15.47:0/1222440130 shutdown_connections 2024-05-27T10:52:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.937+0000 7ff4e0e00640 1 -- 172.21.15.47:0/1222440130 wait complete. 2024-05-27T10:52:47.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.939+0000 7ff4e0e00640 1 Processor -- start 2024-05-27T10:52:47.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.939+0000 7ff4e0e00640 1 -- start start 2024-05-27T10:52:47.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.940+0000 7ff4e0e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4dc0723d0 0x7ff4dc14f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:47.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.940+0000 7ff4e0e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff4dc15a8c0 0x7ff4dc15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:47.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.940+0000 7ff4e0e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4dc15aca0 0x7ff4dc1478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:47.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.940+0000 7ff4e0e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc06e3d0 con 0x7ff4dc15aca0 2024-05-27T10:52:47.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.940+0000 7ff4e0e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc06f3a0 con 0x7ff4dc0723d0 2024-05-27T10:52:47.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.940+0000 7ff4e0e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff4dc06e550 con 0x7ff4dc15a8c0 2024-05-27T10:52:47.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.940+0000 7ff4dbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4dc15aca0 0x7ff4dc1478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:47.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.940+0000 7ff4dbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4dc15aca0 0x7ff4dc1478b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39574/0 (socket says 172.21.15.47:39574) 2024-05-27T10:52:47.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.940+0000 7ff4dbe00640 1 -- 172.21.15.47:0/1153591681 learned_addr learned my addr 172.21.15.47:0/1153591681 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:47.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.941+0000 7ff4db400640 1 --2- 172.21.15.47:0/1153591681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4dc0723d0 0x7ff4dc14f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:47.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.941+0000 7ff4dbe00640 1 -- 172.21.15.47:0/1153591681 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff4dc15a8c0 msgr2=0x7ff4dc15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:47.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.941+0000 7ff4dbe00640 1 --2- 172.21.15.47:0/1153591681 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff4dc15a8c0 0x7ff4dc15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:47.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.941+0000 7ff4dbe00640 1 -- 172.21.15.47:0/1153591681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4dc0723d0 msgr2=0x7ff4dc14f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:47.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.941+0000 7ff4dbe00640 1 --2- 172.21.15.47:0/1153591681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4dc0723d0 0x7ff4dc14f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:47.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.941+0000 7ff4dbe00640 1 -- 172.21.15.47:0/1153591681 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4dc15c900 con 0x7ff4dc15aca0 2024-05-27T10:52:47.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.941+0000 7ff4db400640 1 --2- 172.21.15.47:0/1153591681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4dc0723d0 0x7ff4dc14f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:47.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.941+0000 7ff4dbe00640 1 --2- 172.21.15.47:0/1153591681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4dc15aca0 0x7ff4dc1478b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff4d400cef0 tx=0x7ff4d400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:47.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.941+0000 7ff4d3400640 1 -- 172.21.15.47:0/1153591681 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d401a070 con 0x7ff4dc15aca0 2024-05-27T10:52:47.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.941+0000 7ff4d3400640 1 -- 172.21.15.47:0/1153591681 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4d400d860 con 0x7ff4dc15aca0 2024-05-27T10:52:47.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.941+0000 7ff4d3400640 1 -- 172.21.15.47:0/1153591681 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d400dc50 con 0x7ff4dc15aca0 2024-05-27T10:52:47.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.941+0000 7ff4e0e00640 1 -- 172.21.15.47:0/1153591681 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4dc15cbe0 con 0x7ff4dc15aca0 2024-05-27T10:52:47.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.941+0000 7ff4e0e00640 1 -- 172.21.15.47:0/1153591681 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4dc15d1a0 con 0x7ff4dc15aca0 2024-05-27T10:52:47.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.943+0000 7ff4e0e00640 1 -- 172.21.15.47:0/1153591681 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4dc0691e0 con 0x7ff4dc15aca0 2024-05-27T10:52:47.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.944+0000 7ff4d3400640 1 -- 172.21.15.47:0/1153591681 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff4d401d070 con 0x7ff4dc15aca0 2024-05-27T10:52:47.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.945+0000 7ff4d3400640 1 --2- 172.21.15.47:0/1153591681 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff4b806c8f0 0x7ff4b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:47.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.945+0000 7ff4d3400640 1 -- 172.21.15.47:0/1153591681 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7ff4d408c490 con 0x7ff4dc15aca0 2024-05-27T10:52:47.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.946+0000 7ff4db400640 1 --2- 172.21.15.47:0/1153591681 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff4b806c8f0 0x7ff4b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:47.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.946+0000 7ff4db400640 1 --2- 172.21.15.47:0/1153591681 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff4b806c8f0 0x7ff4b806edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc000f60 tx=0x7ff4cc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:47.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:47.950+0000 7ff4d3400640 1 -- 172.21.15.47:0/1153591681 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff4dc0691e0 con 0x7ff4dc15aca0 2024-05-27T10:52:48.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.157+0000 7ff4e0e00640 1 -- 172.21.15.47:0/1153591681 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4dc04fce0 con 0x7ff4dc15aca0 2024-05-27T10:52:48.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.160+0000 7ff4d3400640 1 -- 172.21.15.47:0/1153591681 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16770 (secure 0 0 0) 0x7ff4d405a8f0 con 0x7ff4dc15aca0 2024-05-27T10:52:48.157 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:48.157 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":21,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:47.531344+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:52:48.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.162+0000 7ff4e0e00640 1 -- 172.21.15.47:0/1153591681 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff4b806c8f0 msgr2=0x7ff4b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:48.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.162+0000 7ff4e0e00640 1 --2- 172.21.15.47:0/1153591681 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff4b806c8f0 0x7ff4b806edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc000f60 tx=0x7ff4cc009040 comp rx=0 tx=0).stop 2024-05-27T10:52:48.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.162+0000 7ff4e0e00640 1 -- 172.21.15.47:0/1153591681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4dc15aca0 msgr2=0x7ff4dc1478b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:48.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.162+0000 7ff4e0e00640 1 --2- 172.21.15.47:0/1153591681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4dc15aca0 0x7ff4dc1478b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff4d400cef0 tx=0x7ff4d400a710 comp rx=0 tx=0).stop 2024-05-27T10:52:48.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.163+0000 7ff4e0e00640 1 -- 172.21.15.47:0/1153591681 shutdown_connections 2024-05-27T10:52:48.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.163+0000 7ff4e0e00640 1 --2- 172.21.15.47:0/1153591681 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff4b806c8f0 0x7ff4b806edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:48.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.163+0000 7ff4e0e00640 1 --2- 172.21.15.47:0/1153591681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4dc15aca0 0x7ff4dc1478b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:48.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.163+0000 7ff4e0e00640 1 --2- 172.21.15.47:0/1153591681 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff4dc15a8c0 0x7ff4dc15d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:48.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.163+0000 7ff4e0e00640 1 --2- 172.21.15.47:0/1153591681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4dc0723d0 0x7ff4dc14f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:48.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.163+0000 7ff4e0e00640 1 -- 172.21.15.47:0/1153591681 >> 172.21.15.47:0/1153591681 conn(0x7ff4dc06bb20 msgr2=0x7ff4dc158400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:48.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.163+0000 7ff4e0e00640 1 -- 172.21.15.47:0/1153591681 shutdown_connections 2024-05-27T10:52:48.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.163+0000 7ff4e0e00640 1 -- 172.21.15.47:0/1153591681 wait complete. 2024-05-27T10:52:48.179 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T10:51:55.073251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T10:51:59.202702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T10:52:00.664039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T10:52:48.179 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T10:52:48.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.396+0000 7fc1e1400640 1 Processor -- start 2024-05-27T10:52:48.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.397+0000 7fc1e1400640 1 -- start start 2024-05-27T10:52:48.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.398+0000 7fc1e1400640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc1dc13f690 0x7fc1dc0ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:48.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.398+0000 7fc1e1400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc1dc0cec90 0x7fc1dc071d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:48.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.398+0000 7fc1e1400640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1dc15cd60 con 0x7fc1dc072270 2024-05-27T10:52:48.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.398+0000 7fc1e1400640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fc1dc15d040 con 0x7fc1dc13f690 2024-05-27T10:52:48.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.398+0000 7fc1e1400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc1dc15d320 con 0x7fc1dc0cec90 2024-05-27T10:52:48.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.399+0000 7fc1d3e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc1dc0cec90 0x7fc1dc071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:48.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.399+0000 7fc1da800640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc1dc13f690 0x7fc1dc0ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:48.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.399+0000 7fc1d3e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc1dc0cec90 0x7fc1dc071d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:55488/0 (socket says 172.21.15.47:55488) 2024-05-27T10:52:48.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.399+0000 7fc1d3e00640 1 -- 172.21.15.47:0/3230108847 learned_addr learned my addr 172.21.15.47:0/3230108847 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:48.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.400+0000 7fc1da800640 1 -- 172.21.15.47:0/3230108847 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc1dc0cec90 msgr2=0x7fc1dc071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:48.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.400+0000 7fc1da800640 1 --2- 172.21.15.47:0/3230108847 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc1dc0cec90 0x7fc1dc071d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:48.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.400+0000 7fc1da800640 1 -- 172.21.15.47:0/3230108847 >> v1:172.21.15.53:6789/0 conn(0x7fc1dc072270 legacy=0x7fc1dc141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:48.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.400+0000 7fc1da800640 1 -- 172.21.15.47:0/3230108847 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1dc15d600 con 0x7fc1dc13f690 2024-05-27T10:52:48.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.400+0000 7fc1d3e00640 1 --2- 172.21.15.47:0/3230108847 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc1dc0cec90 0x7fc1dc071d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T10:52:48.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.402+0000 7fc1da800640 1 --2- 172.21.15.47:0/3230108847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1dc13f690 0x7fc1dc0ce750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0097a0 tx=0x7fc1cc029ff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=715b68710adfc02f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:48.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.402+0000 7fc1d9e00640 1 -- 172.21.15.47:0/3230108847 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc037070 con 0x7fc1dc13f690 2024-05-27T10:52:48.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.402+0000 7fc1d9e00640 1 -- 172.21.15.47:0/3230108847 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1cc02ac80 con 0x7fc1dc13f690 2024-05-27T10:52:48.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.402+0000 7fc1d9e00640 1 -- 172.21.15.47:0/3230108847 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc032660 con 0x7fc1dc13f690 2024-05-27T10:52:48.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.403+0000 7fc1e1400640 1 -- 172.21.15.47:0/3230108847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1dc13f690 msgr2=0x7fc1dc0ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:48.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.403+0000 7fc1e1400640 1 --2- 172.21.15.47:0/3230108847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1dc13f690 0x7fc1dc0ce750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0097a0 tx=0x7fc1cc029ff0 comp rx=0 tx=0).stop 2024-05-27T10:52:48.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.403+0000 7fc1e1400640 1 -- 172.21.15.47:0/3230108847 shutdown_connections 2024-05-27T10:52:48.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.403+0000 7fc1e1400640 1 --2- 172.21.15.47:0/3230108847 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc1dc0cec90 0x7fc1dc071d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:48.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.403+0000 7fc1e1400640 1 --2- 172.21.15.47:0/3230108847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1dc13f690 0x7fc1dc0ce750 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:48.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.403+0000 7fc1e1400640 1 -- 172.21.15.47:0/3230108847 >> 172.21.15.47:0/3230108847 conn(0x7fc1dc0b21e0 msgr2=0x7fc1dc0b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:48.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.403+0000 7fc1e1400640 1 -- 172.21.15.47:0/3230108847 shutdown_connections 2024-05-27T10:52:48.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.403+0000 7fc1e1400640 1 -- 172.21.15.47:0/3230108847 wait complete. 2024-05-27T10:52:48.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.405+0000 7fc1e1400640 1 Processor -- start 2024-05-27T10:52:48.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.405+0000 7fc1e1400640 1 -- start start 2024-05-27T10:52:48.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.406+0000 7fc1e1400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc1dc072270 0x7fc1dc0b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:48.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.406+0000 7fc1e1400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0cec90 0x7fc1dc1f3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:48.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.406+0000 7fc1e1400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1dc13f690 0x7fc1dc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:48.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.406+0000 7fc1e1400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc0ce480 con 0x7fc1dc0cec90 2024-05-27T10:52:48.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.406+0000 7fc1e1400640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc0ce300 con 0x7fc1dc13f690 2024-05-27T10:52:48.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.406+0000 7fc1e1400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc1dc140d80 con 0x7fc1dc072270 2024-05-27T10:52:48.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.406+0000 7fc1d3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0cec90 0x7fc1dc1f3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:48.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.406+0000 7fc1d3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0cec90 0x7fc1dc1f3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39584/0 (socket says 172.21.15.47:39584) 2024-05-27T10:52:48.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.406+0000 7fc1d3e00640 1 -- 172.21.15.47:0/37838051 learned_addr learned my addr 172.21.15.47:0/37838051 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:48.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.407+0000 7fc1da800640 1 --2- 172.21.15.47:0/37838051 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc1dc072270 0x7fc1dc0b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:48.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.407+0000 7fc1db200640 1 --2- 172.21.15.47:0/37838051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1dc13f690 0x7fc1dc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:48.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.407+0000 7fc1d3e00640 1 -- 172.21.15.47:0/37838051 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc1dc072270 msgr2=0x7fc1dc0b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:48.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.407+0000 7fc1d3e00640 1 --2- 172.21.15.47:0/37838051 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc1dc072270 0x7fc1dc0b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:48.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.407+0000 7fc1d3e00640 1 -- 172.21.15.47:0/37838051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1dc13f690 msgr2=0x7fc1dc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:48.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.407+0000 7fc1d3e00640 1 --2- 172.21.15.47:0/37838051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1dc13f690 0x7fc1dc0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:48.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.407+0000 7fc1d3e00640 1 -- 172.21.15.47:0/37838051 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1dc0b3e30 con 0x7fc1dc0cec90 2024-05-27T10:52:48.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.407+0000 7fc1da800640 1 --2- 172.21.15.47:0/37838051 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc1dc072270 0x7fc1dc0b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:48.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.407+0000 7fc1d3e00640 1 --2- 172.21.15.47:0/37838051 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0cec90 0x7fc1dc1f3e70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400e9d0 tx=0x7fc1c400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:48.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.408+0000 7fc1d2a00640 1 -- 172.21.15.47:0/37838051 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4017070 con 0x7fc1dc0cec90 2024-05-27T10:52:48.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.408+0000 7fc1d2a00640 1 -- 172.21.15.47:0/37838051 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c400ca60 con 0x7fc1dc0cec90 2024-05-27T10:52:48.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.408+0000 7fc1e1400640 1 -- 172.21.15.47:0/37838051 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1dc0b4110 con 0x7fc1dc0cec90 2024-05-27T10:52:48.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.408+0000 7fc1d2a00640 1 -- 172.21.15.47:0/37838051 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c400ce10 con 0x7fc1dc0cec90 2024-05-27T10:52:48.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.408+0000 7fc1e1400640 1 -- 172.21.15.47:0/37838051 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1dc0b46d0 con 0x7fc1dc0cec90 2024-05-27T10:52:48.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.409+0000 7fc1e1400640 1 -- 172.21.15.47:0/37838051 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1dc0b4bc0 con 0x7fc1dc0cec90 2024-05-27T10:52:48.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.410+0000 7fc1d2a00640 1 -- 172.21.15.47:0/37838051 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc1c401a070 con 0x7fc1dc0cec90 2024-05-27T10:52:48.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.411+0000 7fc1d2a00640 1 --2- 172.21.15.47:0/37838051 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc1b806c8f0 0x7fc1b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:48.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.411+0000 7fc1d2a00640 1 -- 172.21.15.47:0/37838051 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7fc1c408bfe0 con 0x7fc1dc0cec90 2024-05-27T10:52:48.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.411+0000 7fc1da800640 1 --2- 172.21.15.47:0/37838051 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc1b806c8f0 0x7fc1b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:48.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.412+0000 7fc1da800640 1 --2- 172.21.15.47:0/37838051 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc1b806c8f0 0x7fc1b806edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc034000 tx=0x7fc1cc02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:48.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.415+0000 7fc1d2a00640 1 -- 172.21.15.47:0/37838051 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc1c405a280 con 0x7fc1dc0cec90 2024-05-27T10:52:48.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.630+0000 7fc1e1400640 1 -- 172.21.15.47:0/37838051 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc1dc04fdc0 con 0x7fc1dc0cec90 2024-05-27T10:52:48.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.631+0000 7fc1d2a00640 1 -- 172.21.15.47:0/37838051 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fc1c4059b80 con 0x7fc1dc0cec90 2024-05-27T10:52:48.628 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-27T10:52:48.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.634+0000 7fc1e1400640 1 -- 172.21.15.47:0/37838051 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc1b806c8f0 msgr2=0x7fc1b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:48.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.634+0000 7fc1e1400640 1 --2- 172.21.15.47:0/37838051 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc1b806c8f0 0x7fc1b806edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc034000 tx=0x7fc1cc02e000 comp rx=0 tx=0).stop 2024-05-27T10:52:48.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.634+0000 7fc1e1400640 1 -- 172.21.15.47:0/37838051 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0cec90 msgr2=0x7fc1dc1f3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:48.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.634+0000 7fc1e1400640 1 --2- 172.21.15.47:0/37838051 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0cec90 0x7fc1dc1f3e70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400e9d0 tx=0x7fc1c400ee90 comp rx=0 tx=0).stop 2024-05-27T10:52:48.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.634+0000 7fc1e1400640 1 -- 172.21.15.47:0/37838051 shutdown_connections 2024-05-27T10:52:48.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.634+0000 7fc1e1400640 1 --2- 172.21.15.47:0/37838051 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc1b806c8f0 0x7fc1b806edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:48.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.634+0000 7fc1e1400640 1 --2- 172.21.15.47:0/37838051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1dc13f690 0x7fc1dc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:48.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.634+0000 7fc1e1400640 1 --2- 172.21.15.47:0/37838051 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0cec90 0x7fc1dc1f3e70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:48.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.634+0000 7fc1e1400640 1 --2- 172.21.15.47:0/37838051 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc1dc072270 0x7fc1dc0b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:48.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.634+0000 7fc1e1400640 1 -- 172.21.15.47:0/37838051 >> 172.21.15.47:0/37838051 conn(0x7fc1dc0b21e0 msgr2=0x7fc1dc15f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:48.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.634+0000 7fc1e1400640 1 -- 172.21.15.47:0/37838051 shutdown_connections 2024-05-27T10:52:48.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.635+0000 7fc1e1400640 1 -- 172.21.15.47:0/37838051 wait complete. 2024-05-27T10:52:48.652 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T10:52:48.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.858+0000 7f6cc5e00640 1 Processor -- start 2024-05-27T10:52:48.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.858+0000 7f6cc5e00640 1 -- start start 2024-05-27T10:52:48.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.860+0000 7f6cc5e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6cc015e660 0x7f6cc006e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:48.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.860+0000 7f6cc5e00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6cc00d0a30 0x7f6cc00cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:48.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.860+0000 7f6cc5e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cc006f460 con 0x7f6cc006ee30 2024-05-27T10:52:48.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.860+0000 7f6cc5e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f6cc00b4440 con 0x7f6cc015e660 2024-05-27T10:52:48.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.860+0000 7f6cc5e00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f6cc00b4720 con 0x7f6cc00d0a30 2024-05-27T10:52:48.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.861+0000 7f6cc4a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6cc015e660 0x7f6cc006e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:48.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.861+0000 7f6cbfe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f6cc006ee30 0x7f6cc00d0320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35232/0 (socket says 172.21.15.47:35232) 2024-05-27T10:52:48.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.861+0000 7f6cbfe00640 1 -- 172.21.15.47:0/2963815548 learned_addr learned my addr 172.21.15.47:0/2963815548 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:48.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.861+0000 7f6cc5400640 1 --2- 172.21.15.47:0/2963815548 >> v2:172.21.15.53:3300/0 conn(0x7f6cc00d0a30 0x7f6cc00cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:48.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.861+0000 7f6cc4a00640 1 -- 172.21.15.47:0/2963815548 >> v2:172.21.15.53:3300/0 conn(0x7f6cc00d0a30 msgr2=0x7f6cc00cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:48.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.861+0000 7f6cc4a00640 1 --2- 172.21.15.47:0/2963815548 >> v2:172.21.15.53:3300/0 conn(0x7f6cc00d0a30 0x7f6cc00cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:48.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.861+0000 7f6cc4a00640 1 -- 172.21.15.47:0/2963815548 >> v1:172.21.15.47:6789/0 conn(0x7f6cc006ee30 legacy=0x7f6cc00d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:48.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.861+0000 7f6cc4a00640 1 -- 172.21.15.47:0/2963815548 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc00b4a00 con 0x7f6cc015e660 2024-05-27T10:52:48.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.862+0000 7f6cc4a00640 1 --2- 172.21.15.47:0/2963815548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cc015e660 0x7f6cc006e8f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00cdda0 tx=0x7f6cb402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155e79ac8592c8ef server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:48.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.863+0000 7f6cbf400640 1 -- 172.21.15.47:0/2963815548 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4037070 con 0x7f6cc015e660 2024-05-27T10:52:48.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.863+0000 7f6cbf400640 1 -- 172.21.15.47:0/2963815548 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb4032440 con 0x7f6cc015e660 2024-05-27T10:52:48.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.863+0000 7f6cbf400640 1 -- 172.21.15.47:0/2963815548 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4032810 con 0x7f6cc015e660 2024-05-27T10:52:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.863+0000 7f6cc5e00640 1 -- 172.21.15.47:0/2963815548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cc015e660 msgr2=0x7f6cc006e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.863+0000 7f6cc5e00640 1 --2- 172.21.15.47:0/2963815548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cc015e660 0x7f6cc006e8f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00cdda0 tx=0x7f6cb402a1a0 comp rx=0 tx=0).stop 2024-05-27T10:52:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.864+0000 7f6cc5e00640 1 -- 172.21.15.47:0/2963815548 shutdown_connections 2024-05-27T10:52:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.864+0000 7f6cc5e00640 1 --2- 172.21.15.47:0/2963815548 >> v2:172.21.15.53:3300/0 conn(0x7f6cc00d0a30 0x7f6cc00cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.864+0000 7f6cc5e00640 1 --2- 172.21.15.47:0/2963815548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cc015e660 0x7f6cc006e8f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.864+0000 7f6cc5e00640 1 -- 172.21.15.47:0/2963815548 >> 172.21.15.47:0/2963815548 conn(0x7f6cc006bb20 msgr2=0x7f6cc006bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.864+0000 7f6cc5e00640 1 -- 172.21.15.47:0/2963815548 shutdown_connections 2024-05-27T10:52:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.864+0000 7f6cc5e00640 1 -- 172.21.15.47:0/2963815548 wait complete. 2024-05-27T10:52:48.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.866+0000 7f6cc5e00640 1 Processor -- start 2024-05-27T10:52:48.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.866+0000 7f6cc5e00640 1 -- start start 2024-05-27T10:52:48.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.867+0000 7f6cc5e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6cc006ee30 0x7f6cc00b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:48.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.867+0000 7f6cc5e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cc00d0a30 0x7f6cc0155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:48.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.867+0000 7f6cc5e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cc015e660 0x7f6cc00c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:48.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.867+0000 7f6cc5e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc00b4f20 con 0x7f6cc00d0a30 2024-05-27T10:52:48.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.867+0000 7f6cc5e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc00b4060 con 0x7f6cc015e660 2024-05-27T10:52:48.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.867+0000 7f6cc5e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f6cc00b0770 con 0x7f6cc006ee30 2024-05-27T10:52:48.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.867+0000 7f6cbfe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cc00d0a30 0x7f6cc0155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:48.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.867+0000 7f6cbfe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cc00d0a30 0x7f6cc0155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39596/0 (socket says 172.21.15.47:39596) 2024-05-27T10:52:48.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.867+0000 7f6cbfe00640 1 -- 172.21.15.47:0/3306173561 learned_addr learned my addr 172.21.15.47:0/3306173561 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:48.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.868+0000 7f6cc4a00640 1 --2- 172.21.15.47:0/3306173561 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6cc006ee30 0x7f6cc00b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:48.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.868+0000 7f6cc5400640 1 --2- 172.21.15.47:0/3306173561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cc015e660 0x7f6cc00c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:48.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.868+0000 7f6cbfe00640 1 -- 172.21.15.47:0/3306173561 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6cc006ee30 msgr2=0x7f6cc00b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:48.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.868+0000 7f6cbfe00640 1 --2- 172.21.15.47:0/3306173561 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6cc006ee30 0x7f6cc00b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:48.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.868+0000 7f6cbfe00640 1 -- 172.21.15.47:0/3306173561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cc015e660 msgr2=0x7f6cc00c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:48.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.868+0000 7f6cbfe00640 1 --2- 172.21.15.47:0/3306173561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cc015e660 0x7f6cc00c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:48.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.868+0000 7f6cbfe00640 1 -- 172.21.15.47:0/3306173561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc0155850 con 0x7f6cc00d0a30 2024-05-27T10:52:48.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.868+0000 7f6cc4a00640 1 --2- 172.21.15.47:0/3306173561 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6cc006ee30 0x7f6cc00b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:48.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.868+0000 7f6cbfe00640 1 --2- 172.21.15.47:0/3306173561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cc00d0a30 0x7f6cc0155310 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00c400 tx=0x7f6cac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:48.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.869+0000 7f6cbcc00640 1 -- 172.21.15.47:0/3306173561 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac017070 con 0x7f6cc00d0a30 2024-05-27T10:52:48.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.869+0000 7f6cbcc00640 1 -- 172.21.15.47:0/3306173561 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cac005ce0 con 0x7f6cc00d0a30 2024-05-27T10:52:48.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.869+0000 7f6cbcc00640 1 -- 172.21.15.47:0/3306173561 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac0072f0 con 0x7f6cc00d0a30 2024-05-27T10:52:48.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.869+0000 7f6cc5e00640 1 -- 172.21.15.47:0/3306173561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc00ca390 con 0x7f6cc00d0a30 2024-05-27T10:52:48.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.869+0000 7f6cc5e00640 1 -- 172.21.15.47:0/3306173561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc00b0cf0 con 0x7f6cc00d0a30 2024-05-27T10:52:48.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.870+0000 7f6cc5e00640 1 -- 172.21.15.47:0/3306173561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cc004fce0 con 0x7f6cc00d0a30 2024-05-27T10:52:48.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.871+0000 7f6cbcc00640 1 -- 172.21.15.47:0/3306173561 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6cac01a070 con 0x7f6cc00d0a30 2024-05-27T10:52:48.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.872+0000 7f6cbcc00640 1 --2- 172.21.15.47:0/3306173561 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6ca006c8f0 0x7f6ca006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:48.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.872+0000 7f6cbcc00640 1 -- 172.21.15.47:0/3306173561 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f6cac08b000 con 0x7f6cc00d0a30 2024-05-27T10:52:48.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.872+0000 7f6cc4a00640 1 --2- 172.21.15.47:0/3306173561 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6ca006c8f0 0x7f6ca006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:48.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.873+0000 7f6cc4a00640 1 --2- 172.21.15.47:0/3306173561 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6ca006c8f0 0x7f6ca006edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4034000 tx=0x7f6cb402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:48.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:48.876+0000 7f6cbcc00640 1 -- 172.21.15.47:0/3306173561 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6cac0593a0 con 0x7f6cc00d0a30 2024-05-27T10:52:49.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.081+0000 7f6cc5e00640 1 -- 172.21.15.47:0/3306173561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6cc00ce7a0 con 0x7f6cc00d0a30 2024-05-27T10:52:49.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.082+0000 7f6cbcc00640 1 -- 172.21.15.47:0/3306173561 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f6cac058ca0 con 0x7f6cc00d0a30 2024-05-27T10:52:49.080 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-27T10:52:49.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.085+0000 7f6cc5e00640 1 -- 172.21.15.47:0/3306173561 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6ca006c8f0 msgr2=0x7f6ca006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:49.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.085+0000 7f6cc5e00640 1 --2- 172.21.15.47:0/3306173561 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6ca006c8f0 0x7f6ca006edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4034000 tx=0x7f6cb402e000 comp rx=0 tx=0).stop 2024-05-27T10:52:49.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.085+0000 7f6cc5e00640 1 -- 172.21.15.47:0/3306173561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cc00d0a30 msgr2=0x7f6cc0155310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:49.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.085+0000 7f6cc5e00640 1 --2- 172.21.15.47:0/3306173561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cc00d0a30 0x7f6cc0155310 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00c400 tx=0x7f6cac00c8c0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.085+0000 7f6cc5e00640 1 -- 172.21.15.47:0/3306173561 shutdown_connections 2024-05-27T10:52:49.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.085+0000 7f6cc5e00640 1 --2- 172.21.15.47:0/3306173561 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f6ca006c8f0 0x7f6ca006edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.085+0000 7f6cc5e00640 1 --2- 172.21.15.47:0/3306173561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cc015e660 0x7f6cc00c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.085+0000 7f6cc5e00640 1 --2- 172.21.15.47:0/3306173561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cc00d0a30 0x7f6cc0155310 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.085+0000 7f6cc5e00640 1 --2- 172.21.15.47:0/3306173561 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6cc006ee30 0x7f6cc00b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.085+0000 7f6cc5e00640 1 -- 172.21.15.47:0/3306173561 >> 172.21.15.47:0/3306173561 conn(0x7f6cc006bb20 msgr2=0x7f6cc00af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:49.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.085+0000 7f6cc5e00640 1 -- 172.21.15.47:0/3306173561 shutdown_connections 2024-05-27T10:52:49.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.085+0000 7f6cc5e00640 1 -- 172.21.15.47:0/3306173561 wait complete. 2024-05-27T10:52:49.103 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T10:52:49.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.330+0000 7fea23c00640 1 Processor -- start 2024-05-27T10:52:49.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.330+0000 7fea23c00640 1 -- start start 2024-05-27T10:52:49.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.332+0000 7fea23c00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fea1c071d30 0x7fea1c072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:49.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.332+0000 7fea23c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fea1c13fd70 0x7fea1c1401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:49.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.332+0000 7fea23c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea1c15cd60 con 0x7fea1c13f690 2024-05-27T10:52:49.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.332+0000 7fea23c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fea1c0726b0 con 0x7fea1c13fd70 2024-05-27T10:52:49.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.332+0000 7fea23c00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fea1c15d040 con 0x7fea1c071d30 2024-05-27T10:52:49.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.332+0000 7fea21c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fea1c13fd70 0x7fea1c1401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:49.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.332+0000 7fea21c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fea1c13fd70 0x7fea1c1401c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39612/0 (socket says 172.21.15.47:39612) 2024-05-27T10:52:49.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.332+0000 7fea21c00640 1 -- 172.21.15.47:0/3599987524 learned_addr learned my addr 172.21.15.47:0/3599987524 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:49.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.332+0000 7fea1be00640 1 --2- 172.21.15.47:0/3599987524 >> v2:172.21.15.53:3300/0 conn(0x7fea1c071d30 0x7fea1c072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:49.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.333+0000 7fea21c00640 1 -- 172.21.15.47:0/3599987524 >> v2:172.21.15.53:3300/0 conn(0x7fea1c071d30 msgr2=0x7fea1c072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:49.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.333+0000 7fea21c00640 1 --2- 172.21.15.47:0/3599987524 >> v2:172.21.15.53:3300/0 conn(0x7fea1c071d30 0x7fea1c072170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.333+0000 7fea21c00640 1 -- 172.21.15.47:0/3599987524 >> v1:172.21.15.47:6789/0 conn(0x7fea1c13f690 legacy=0x7fea1c0ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:49.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.333+0000 7fea21c00640 1 -- 172.21.15.47:0/3599987524 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1c15d320 con 0x7fea1c13fd70 2024-05-27T10:52:49.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.334+0000 7fea21c00640 1 --2- 172.21.15.47:0/3599987524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea1c13fd70 0x7fea1c1401c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0708b0 tx=0x7fea1402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5afd554aefe16c9c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:49.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.334+0000 7fea1b400640 1 -- 172.21.15.47:0/3599987524 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14036070 con 0x7fea1c13fd70 2024-05-27T10:52:49.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.334+0000 7fea1b400640 1 -- 172.21.15.47:0/3599987524 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea14031600 con 0x7fea1c13fd70 2024-05-27T10:52:49.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.334+0000 7fea1b400640 1 -- 172.21.15.47:0/3599987524 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea140319d0 con 0x7fea1c13fd70 2024-05-27T10:52:49.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.335+0000 7fea23c00640 1 -- 172.21.15.47:0/3599987524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea1c13fd70 msgr2=0x7fea1c1401c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:49.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.335+0000 7fea23c00640 1 --2- 172.21.15.47:0/3599987524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea1c13fd70 0x7fea1c1401c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0708b0 tx=0x7fea1402a6a0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.335+0000 7fea23c00640 1 -- 172.21.15.47:0/3599987524 shutdown_connections 2024-05-27T10:52:49.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.335+0000 7fea23c00640 1 --2- 172.21.15.47:0/3599987524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea1c13fd70 0x7fea1c1401c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.335+0000 7fea23c00640 1 --2- 172.21.15.47:0/3599987524 >> v2:172.21.15.53:3300/0 conn(0x7fea1c071d30 0x7fea1c072170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.335+0000 7fea23c00640 1 -- 172.21.15.47:0/3599987524 >> 172.21.15.47:0/3599987524 conn(0x7fea1c0b21e0 msgr2=0x7fea1c0b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:49.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.335+0000 7fea23c00640 1 -- 172.21.15.47:0/3599987524 shutdown_connections 2024-05-27T10:52:49.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.335+0000 7fea23c00640 1 -- 172.21.15.47:0/3599987524 wait complete. 2024-05-27T10:52:49.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.337+0000 7fea23c00640 1 Processor -- start 2024-05-27T10:52:49.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.337+0000 7fea23c00640 1 -- start start 2024-05-27T10:52:49.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.338+0000 7fea23c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea1c071d30 0x7fea1c1f8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:49.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.338+0000 7fea23c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea1c13f690 0x7fea1c15f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:49.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.338+0000 7fea23c00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea1c13fd70 0x7fea1c136e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:49.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.338+0000 7fea23c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fea1c0cee60 con 0x7fea1c13f690 2024-05-27T10:52:49.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.338+0000 7fea23c00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fea1c15d8e0 con 0x7fea1c13fd70 2024-05-27T10:52:49.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.338+0000 7fea23c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fea1c0ce300 con 0x7fea1c071d30 2024-05-27T10:52:49.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.338+0000 7fea1be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea1c13f690 0x7fea1c15f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:49.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.338+0000 7fea1be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea1c13f690 0x7fea1c15f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39622/0 (socket says 172.21.15.47:39622) 2024-05-27T10:52:49.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.338+0000 7fea1be00640 1 -- 172.21.15.47:0/2751900501 learned_addr learned my addr 172.21.15.47:0/2751900501 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.339+0000 7fea21200640 1 --2- 172.21.15.47:0/2751900501 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea1c071d30 0x7fea1c1f8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.339+0000 7fea1be00640 1 -- 172.21.15.47:0/2751900501 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea1c071d30 msgr2=0x7fea1c1f8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.339+0000 7fea1be00640 1 --2- 172.21.15.47:0/2751900501 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea1c071d30 0x7fea1c1f8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.339+0000 7fea1be00640 1 -- 172.21.15.47:0/2751900501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea1c13fd70 msgr2=0x7fea1c136e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.339+0000 7fea1be00640 1 --2- 172.21.15.47:0/2751900501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea1c13fd70 0x7fea1c136e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.339+0000 7fea1be00640 1 -- 172.21.15.47:0/2751900501 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1c1e7600 con 0x7fea1c13f690 2024-05-27T10:52:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.339+0000 7fea21200640 1 --2- 172.21.15.47:0/2751900501 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea1c071d30 0x7fea1c1f8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.339+0000 7fea1be00640 1 --2- 172.21.15.47:0/2751900501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea1c13f690 0x7fea1c15f440 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fea0800d800 tx=0x7fea0800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.339+0000 7fea18c00640 1 -- 172.21.15.47:0/2751900501 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0800b640 con 0x7fea1c13f690 2024-05-27T10:52:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.339+0000 7fea18c00640 1 -- 172.21.15.47:0/2751900501 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea08019070 con 0x7fea1c13f690 2024-05-27T10:52:49.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.339+0000 7fea18c00640 1 -- 172.21.15.47:0/2751900501 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0800ba00 con 0x7fea1c13f690 2024-05-27T10:52:49.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.339+0000 7fea23c00640 1 -- 172.21.15.47:0/2751900501 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea1c1e78e0 con 0x7fea1c13f690 2024-05-27T10:52:49.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.340+0000 7fea23c00640 1 -- 172.21.15.47:0/2751900501 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea1c1e7ea0 con 0x7fea1c13f690 2024-05-27T10:52:49.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.341+0000 7fea23c00640 1 -- 172.21.15.47:0/2751900501 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea1c073800 con 0x7fea1c13f690 2024-05-27T10:52:49.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.342+0000 7fea18c00640 1 -- 172.21.15.47:0/2751900501 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fea0800bba0 con 0x7fea1c13f690 2024-05-27T10:52:49.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.343+0000 7fea18c00640 1 --2- 172.21.15.47:0/2751900501 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe9fc06c920 0x7fe9fc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:49.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.343+0000 7fea18c00640 1 -- 172.21.15.47:0/2751900501 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fea0808bff0 con 0x7fea1c13f690 2024-05-27T10:52:49.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.343+0000 7fea21200640 1 --2- 172.21.15.47:0/2751900501 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe9fc06c920 0x7fe9fc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:49.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.344+0000 7fea21200640 1 --2- 172.21.15.47:0/2751900501 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe9fc06c920 0x7fe9fc06ede0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fea10001680 tx=0x7fea10009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:49.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.347+0000 7fea18c00640 1 -- 172.21.15.47:0/2751900501 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fea0805a390 con 0x7fea1c13f690 2024-05-27T10:52:49.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.556+0000 7fea23c00640 1 -- 172.21.15.47:0/2751900501 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fea1c1e82a0 con 0x7fea1c13f690 2024-05-27T10:52:49.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.557+0000 7fea18c00640 1 -- 172.21.15.47:0/2751900501 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fea08059c90 con 0x7fea1c13f690 2024-05-27T10:52:49.555 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-27T10:52:49.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.560+0000 7fea23c00640 1 -- 172.21.15.47:0/2751900501 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe9fc06c920 msgr2=0x7fe9fc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:49.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.560+0000 7fea23c00640 1 --2- 172.21.15.47:0/2751900501 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe9fc06c920 0x7fe9fc06ede0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fea10001680 tx=0x7fea10009040 comp rx=0 tx=0).stop 2024-05-27T10:52:49.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.560+0000 7fea23c00640 1 -- 172.21.15.47:0/2751900501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea1c13f690 msgr2=0x7fea1c15f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:49.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.560+0000 7fea23c00640 1 --2- 172.21.15.47:0/2751900501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea1c13f690 0x7fea1c15f440 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fea0800d800 tx=0x7fea0800dcc0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.560+0000 7fea23c00640 1 -- 172.21.15.47:0/2751900501 shutdown_connections 2024-05-27T10:52:49.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.560+0000 7fea23c00640 1 --2- 172.21.15.47:0/2751900501 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe9fc06c920 0x7fe9fc06ede0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.560+0000 7fea23c00640 1 --2- 172.21.15.47:0/2751900501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea1c13fd70 0x7fea1c136e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.560+0000 7fea23c00640 1 --2- 172.21.15.47:0/2751900501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea1c13f690 0x7fea1c15f440 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.560+0000 7fea23c00640 1 --2- 172.21.15.47:0/2751900501 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea1c071d30 0x7fea1c1f8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.560+0000 7fea23c00640 1 -- 172.21.15.47:0/2751900501 >> 172.21.15.47:0/2751900501 conn(0x7fea1c0b21e0 msgr2=0x7fea1c0cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:49.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.561+0000 7fea23c00640 1 -- 172.21.15.47:0/2751900501 shutdown_connections 2024-05-27T10:52:49.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.561+0000 7fea23c00640 1 -- 172.21.15.47:0/2751900501 wait complete. 2024-05-27T10:52:49.577 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T10:52:49.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.789+0000 7f3ae5800640 1 Processor -- start 2024-05-27T10:52:49.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.789+0000 7f3ae5800640 1 -- start start 2024-05-27T10:52:49.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.790+0000 7f3ae5800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3ae0072330 0x7f3ae006eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:49.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.790+0000 7f3ae5800640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3ae00d0360 0x7f3ae00d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:49.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.790+0000 7f3ae5800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3ae015eb90 0x7f3ae015f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:49.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.790+0000 7f3ae5800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f3ae00d0d00 con 0x7f3ae0072330 2024-05-27T10:52:49.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.790+0000 7f3ae5800640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f3ae0072710 con 0x7f3ae00d0360 2024-05-27T10:52:49.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.790+0000 7f3ae5800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae015fb10 con 0x7f3ae015eb90 2024-05-27T10:52:49.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.791+0000 7f3adfe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3ae0072330 0x7f3ae006eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:49.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.791+0000 7f3adfe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3ae0072330 0x7f3ae006eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39632/0 (socket says 172.21.15.47:39632) 2024-05-27T10:52:49.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.791+0000 7f3adfe00640 1 -- 172.21.15.47:0/95097472 learned_addr learned my addr 172.21.15.47:0/95097472 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:49.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.791+0000 7f3ae4e00640 1 --2- 172.21.15.47:0/95097472 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3ae015eb90 0x7f3ae015f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:49.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.791+0000 7f3ad7e00640 1 --2- 172.21.15.47:0/95097472 >> v2:172.21.15.53:3300/0 conn(0x7f3ae00d0360 0x7f3ae00d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:49.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.791+0000 7f3adfe00640 1 -- 172.21.15.47:0/95097472 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3ae015eb90 msgr2=0x7f3ae015f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:49.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.791+0000 7f3adfe00640 1 --2- 172.21.15.47:0/95097472 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3ae015eb90 0x7f3ae015f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.791+0000 7f3adfe00640 1 -- 172.21.15.47:0/95097472 >> v2:172.21.15.53:3300/0 conn(0x7f3ae00d0360 msgr2=0x7f3ae00d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:49.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.791+0000 7f3adfe00640 1 --2- 172.21.15.47:0/95097472 >> v2:172.21.15.53:3300/0 conn(0x7f3ae00d0360 0x7f3ae00d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.791+0000 7f3adfe00640 1 -- 172.21.15.47:0/95097472 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae006fe40 con 0x7f3ae0072330 2024-05-27T10:52:49.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.792+0000 7f3adfe00640 1 --2- 172.21.15.47:0/95097472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ae0072330 0x7f3ae006eab0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3ae009e500 tx=0x7f3ad002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f12061b946f492 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:49.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.793+0000 7f3adf400640 1 -- 172.21.15.47:0/95097472 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0037070 con 0x7f3ae0072330 2024-05-27T10:52:49.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.793+0000 7f3adf400640 1 -- 172.21.15.47:0/95097472 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad002ae00 con 0x7f3ae0072330 2024-05-27T10:52:49.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.793+0000 7f3adf400640 1 -- 172.21.15.47:0/95097472 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0032660 con 0x7f3ae0072330 2024-05-27T10:52:49.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.793+0000 7f3ae5800640 1 -- 172.21.15.47:0/95097472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ae0072330 msgr2=0x7f3ae006eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:49.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.793+0000 7f3ae5800640 1 --2- 172.21.15.47:0/95097472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ae0072330 0x7f3ae006eab0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3ae009e500 tx=0x7f3ad002a0b0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.794+0000 7f3ae5800640 1 -- 172.21.15.47:0/95097472 shutdown_connections 2024-05-27T10:52:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.794+0000 7f3ae5800640 1 --2- 172.21.15.47:0/95097472 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3ae015eb90 0x7f3ae015f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.794+0000 7f3ae5800640 1 --2- 172.21.15.47:0/95097472 >> v2:172.21.15.53:3300/0 conn(0x7f3ae00d0360 0x7f3ae00d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.794+0000 7f3ae5800640 1 --2- 172.21.15.47:0/95097472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ae0072330 0x7f3ae006eab0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.794+0000 7f3ae5800640 1 -- 172.21.15.47:0/95097472 >> 172.21.15.47:0/95097472 conn(0x7f3ae006bb20 msgr2=0x7f3ae006bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.794+0000 7f3ae5800640 1 -- 172.21.15.47:0/95097472 shutdown_connections 2024-05-27T10:52:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.794+0000 7f3ae5800640 1 -- 172.21.15.47:0/95097472 wait complete. 2024-05-27T10:52:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.796+0000 7f3ae5800640 1 Processor -- start 2024-05-27T10:52:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.796+0000 7f3ae5800640 1 -- start start 2024-05-27T10:52:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.797+0000 7f3ae5800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3ae0072330 0x7f3ae0099a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.797+0000 7f3ae5800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae00d0360 0x7f3ae0153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.797+0000 7f3ae5800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ae015eb90 0x7f3ae0157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.797+0000 7f3ae5800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae015f830 con 0x7f3ae015eb90 2024-05-27T10:52:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.797+0000 7f3ae5800640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae006e620 con 0x7f3ae00d0360 2024-05-27T10:52:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.797+0000 7f3ae5800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae006dfd0 con 0x7f3ae0072330 2024-05-27T10:52:49.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.798+0000 7f3ae4e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ae015eb90 0x7f3ae0157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:49.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.798+0000 7f3ae4e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ae015eb90 0x7f3ae0157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39642/0 (socket says 172.21.15.47:39642) 2024-05-27T10:52:49.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.798+0000 7f3ae4e00640 1 -- 172.21.15.47:0/890002979 learned_addr learned my addr 172.21.15.47:0/890002979 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:49.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.798+0000 7f3adfe00640 1 --2- 172.21.15.47:0/890002979 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3ae0072330 0x7f3ae0099a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:49.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.798+0000 7f3ad7e00640 1 --2- 172.21.15.47:0/890002979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae00d0360 0x7f3ae0153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:49.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.798+0000 7f3ae4e00640 1 -- 172.21.15.47:0/890002979 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3ae0072330 msgr2=0x7f3ae0099a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:49.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.798+0000 7f3ae4e00640 1 --2- 172.21.15.47:0/890002979 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3ae0072330 0x7f3ae0099a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.798+0000 7f3ae4e00640 1 -- 172.21.15.47:0/890002979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae00d0360 msgr2=0x7f3ae0153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:49.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.798+0000 7f3ae4e00640 1 --2- 172.21.15.47:0/890002979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae00d0360 0x7f3ae0153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:49.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.799+0000 7f3ae4e00640 1 -- 172.21.15.47:0/890002979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae01546b0 con 0x7f3ae015eb90 2024-05-27T10:52:49.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.799+0000 7f3ae4e00640 1 --2- 172.21.15.47:0/890002979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ae015eb90 0x7f3ae0157650 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8007e40 tx=0x7f3ad800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:49.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.799+0000 7f3adcc00640 1 -- 172.21.15.47:0/890002979 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8014620 con 0x7f3ae015eb90 2024-05-27T10:52:49.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.799+0000 7f3adcc00640 1 -- 172.21.15.47:0/890002979 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad8019070 con 0x7f3ae015eb90 2024-05-27T10:52:49.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.799+0000 7f3adcc00640 1 -- 172.21.15.47:0/890002979 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8014a20 con 0x7f3ae015eb90 2024-05-27T10:52:49.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.799+0000 7f3ae5800640 1 -- 172.21.15.47:0/890002979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae01445b0 con 0x7f3ae015eb90 2024-05-27T10:52:49.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.799+0000 7f3ae5800640 1 -- 172.21.15.47:0/890002979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae0154280 con 0x7f3ae015eb90 2024-05-27T10:52:49.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.800+0000 7f3ae5800640 1 -- 172.21.15.47:0/890002979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ae004fce0 con 0x7f3ae015eb90 2024-05-27T10:52:49.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.801+0000 7f3adcc00640 1 -- 172.21.15.47:0/890002979 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3ad8014bc0 con 0x7f3ae015eb90 2024-05-27T10:52:49.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.802+0000 7f3adcc00640 1 --2- 172.21.15.47:0/890002979 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3abc06c920 0x7f3abc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:49.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.802+0000 7f3adcc00640 1 -- 172.21.15.47:0/890002979 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f3ad808c3e0 con 0x7f3ae015eb90 2024-05-27T10:52:49.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.802+0000 7f3adfe00640 1 --2- 172.21.15.47:0/890002979 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3abc06c920 0x7f3abc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:49.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.803+0000 7f3adfe00640 1 --2- 172.21.15.47:0/890002979 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3abc06c920 0x7f3abc06ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0034000 tx=0x7f3ad002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:49.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:49.808+0000 7f3adcc00640 1 -- 172.21.15.47:0/890002979 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3ad805a0a0 con 0x7f3ae015eb90 2024-05-27T10:52:50.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.023+0000 7f3ae5800640 1 -- 172.21.15.47:0/890002979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3ae00b5080 con 0x7f3ae015eb90 2024-05-27T10:52:50.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.024+0000 7f3adcc00640 1 -- 172.21.15.47:0/890002979 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f3ad805e3a0 con 0x7f3ae015eb90 2024-05-27T10:52:50.022 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-05-27T10:52:50.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.026+0000 7f3ae5800640 1 -- 172.21.15.47:0/890002979 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3abc06c920 msgr2=0x7f3abc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:50.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.026+0000 7f3ae5800640 1 --2- 172.21.15.47:0/890002979 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3abc06c920 0x7f3abc06ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0034000 tx=0x7f3ad002e000 comp rx=0 tx=0).stop 2024-05-27T10:52:50.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.026+0000 7f3ae5800640 1 -- 172.21.15.47:0/890002979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ae015eb90 msgr2=0x7f3ae0157650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:50.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.026+0000 7f3ae5800640 1 --2- 172.21.15.47:0/890002979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ae015eb90 0x7f3ae0157650 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8007e40 tx=0x7f3ad800e4b0 comp rx=0 tx=0).stop 2024-05-27T10:52:50.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.026+0000 7f3ae5800640 1 -- 172.21.15.47:0/890002979 shutdown_connections 2024-05-27T10:52:50.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.026+0000 7f3ae5800640 1 --2- 172.21.15.47:0/890002979 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3abc06c920 0x7f3abc06ede0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:50.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.026+0000 7f3ae5800640 1 --2- 172.21.15.47:0/890002979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ae015eb90 0x7f3ae0157650 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:50.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.026+0000 7f3ae5800640 1 --2- 172.21.15.47:0/890002979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae00d0360 0x7f3ae0153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:50.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.026+0000 7f3ae5800640 1 --2- 172.21.15.47:0/890002979 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3ae0072330 0x7f3ae0099a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:50.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.026+0000 7f3ae5800640 1 -- 172.21.15.47:0/890002979 >> 172.21.15.47:0/890002979 conn(0x7f3ae006bb20 msgr2=0x7f3ae006bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:50.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.027+0000 7f3ae5800640 1 -- 172.21.15.47:0/890002979 shutdown_connections 2024-05-27T10:52:50.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.027+0000 7f3ae5800640 1 -- 172.21.15.47:0/890002979 wait complete. 2024-05-27T10:52:50.042 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi047.front.sepia.ceph.com... 2024-05-27T10:52:50.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:50.043 DEBUG:teuthology.orchestra.run.smithi047:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-27T10:52:50.126 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T10:52:50.126 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-05-27T10:52:50.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:50.127 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-27T10:52:50.189 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:52:50.189 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:52:50.250 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:52:50.250 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:52:50.310 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:52:50.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.529+0000 7f6207200640 1 Processor -- start 2024-05-27T10:52:50.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.530+0000 7f6207200640 1 -- start start 2024-05-27T10:52:50.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.531+0000 7f6207200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f620806ca40 0x7f62080d2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:50.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.531+0000 7f6207200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62080d0950 con 0x7f620815eaa0 2024-05-27T10:52:50.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.531+0000 7f6207200640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62080cebc0 con 0x7f620806d240 2024-05-27T10:52:50.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.531+0000 7f6207200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f62080cf4b0 con 0x7f620806ca40 2024-05-27T10:52:50.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.532+0000 7f61fd400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f620815eaa0 0x7f62080d2680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35240/0 (socket says 172.21.15.47:35240) 2024-05-27T10:52:50.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.532+0000 7f61fd400640 1 -- 172.21.15.47:0/4185129531 learned_addr learned my addr 172.21.15.47:0/4185129531 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:50.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.532+0000 7f6206800640 1 --2- 172.21.15.47:0/4185129531 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f620806ca40 0x7f62080d2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:50.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.532+0000 7f6205400640 1 -- 172.21.15.47:0/4185129531 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 650460787 0 0) 0x7f62080d0950 con 0x7f620815eaa0 2024-05-27T10:52:50.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.532+0000 7f6205400640 1 -- 172.21.15.47:0/4185129531 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61ec003520 con 0x7f620815eaa0 2024-05-27T10:52:50.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.533+0000 7f6205400640 1 -- 172.21.15.47:0/4185129531 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4273079383 0 0) 0x7f61ec003520 con 0x7f620815eaa0 2024-05-27T10:52:50.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.533+0000 7f6206800640 1 -- 172.21.15.47:0/4185129531 >> v1:172.21.15.53:6789/0 conn(0x7f620806d240 legacy=0x7f620806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:50.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.533+0000 7f6206800640 1 -- 172.21.15.47:0/4185129531 >> v1:172.21.15.47:6789/0 conn(0x7f620815eaa0 legacy=0x7f62080d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:50.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.533+0000 7f6206800640 1 -- 172.21.15.47:0/4185129531 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62080cee60 con 0x7f620806ca40 2024-05-27T10:52:50.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.534+0000 7f6206800640 1 --2- 172.21.15.47:0/4185129531 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f620806ca40 0x7f62080d2d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6200009dc0 tx=0x7f620002a580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e01cc1c57f95f3c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:50.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.534+0000 7f6205400640 1 -- 172.21.15.47:0/4185129531 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200035020 con 0x7f620806ca40 2024-05-27T10:52:50.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.535+0000 7f6205400640 1 -- 172.21.15.47:0/4185129531 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6200007540 con 0x7f620806ca40 2024-05-27T10:52:50.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.535+0000 7f6205400640 1 -- 172.21.15.47:0/4185129531 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f00017f0 con 0x7f620806ca40 2024-05-27T10:52:50.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.535+0000 7f6207200640 1 -- 172.21.15.47:0/4185129531 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f620806ca40 msgr2=0x7f62080d2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:50.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.535+0000 7f6207200640 1 --2- 172.21.15.47:0/4185129531 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f620806ca40 0x7f62080d2d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6200009dc0 tx=0x7f620002a580 comp rx=0 tx=0).stop 2024-05-27T10:52:50.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.535+0000 7f6207200640 1 -- 172.21.15.47:0/4185129531 shutdown_connections 2024-05-27T10:52:50.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.535+0000 7f6207200640 1 --2- 172.21.15.47:0/4185129531 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f620806ca40 0x7f62080d2d90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:50.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.535+0000 7f6207200640 1 -- 172.21.15.47:0/4185129531 >> 172.21.15.47:0/4185129531 conn(0x7f620808bfd0 msgr2=0x7f62080d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:50.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.535+0000 7f6207200640 1 -- 172.21.15.47:0/4185129531 shutdown_connections 2024-05-27T10:52:50.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.535+0000 7f6207200640 1 -- 172.21.15.47:0/4185129531 wait complete. 2024-05-27T10:52:50.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.537+0000 7f6207200640 1 Processor -- start 2024-05-27T10:52:50.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.537+0000 7f6207200640 1 -- start start 2024-05-27T10:52:50.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.538+0000 7f6207200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f620806ca40 0x7f62080c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:50.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.538+0000 7f6207200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f620806d240 0x7f62080ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:50.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.538+0000 7f6207200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f620815eaa0 0x7f620814c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:50.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.538+0000 7f6207200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f62080b10a0 con 0x7f620806d240 2024-05-27T10:52:50.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.538+0000 7f6207200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f620806cf40 con 0x7f620806ca40 2024-05-27T10:52:50.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.538+0000 7f6207200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f62080b1220 con 0x7f620815eaa0 2024-05-27T10:52:50.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.538+0000 7f61fd400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f620806d240 0x7f62080ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:50.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.539+0000 7f61fd400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f620806d240 0x7f62080ca600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39650/0 (socket says 172.21.15.47:39650) 2024-05-27T10:52:50.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.539+0000 7f61fd400640 1 -- 172.21.15.47:0/3027879036 learned_addr learned my addr 172.21.15.47:0/3027879036 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:50.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.539+0000 7f6205e00640 1 --2- 172.21.15.47:0/3027879036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f620806ca40 0x7f62080c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:50.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.539+0000 7f61fd400640 1 -- 172.21.15.47:0/3027879036 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f620815eaa0 msgr2=0x7f620814c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:50.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.539+0000 7f61fd400640 1 --2- 172.21.15.47:0/3027879036 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f620815eaa0 0x7f620814c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:50.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.539+0000 7f61fd400640 1 -- 172.21.15.47:0/3027879036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f620806ca40 msgr2=0x7f62080c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:50.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.539+0000 7f61fd400640 1 --2- 172.21.15.47:0/3027879036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f620806ca40 0x7f62080c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:50.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.539+0000 7f61fd400640 1 -- 172.21.15.47:0/3027879036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f620814cea0 con 0x7f620806d240 2024-05-27T10:52:50.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.539+0000 7f6205e00640 1 --2- 172.21.15.47:0/3027879036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f620806ca40 0x7f62080c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:50.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.539+0000 7f61fd400640 1 --2- 172.21.15.47:0/3027879036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f620806d240 0x7f62080ca600 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f61f000c750 tx=0x7f61f000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:50.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.540+0000 7f61fea00640 1 -- 172.21.15.47:0/3027879036 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f0007270 con 0x7f620806d240 2024-05-27T10:52:50.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.540+0000 7f61fea00640 1 -- 172.21.15.47:0/3027879036 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f0007410 con 0x7f620806d240 2024-05-27T10:52:50.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.540+0000 7f61fea00640 1 -- 172.21.15.47:0/3027879036 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f00059a0 con 0x7f620806d240 2024-05-27T10:52:50.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.540+0000 7f6207200640 1 -- 172.21.15.47:0/3027879036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62080ca190 con 0x7f620806d240 2024-05-27T10:52:50.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.540+0000 7f6207200640 1 -- 172.21.15.47:0/3027879036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62080cb920 con 0x7f620806d240 2024-05-27T10:52:50.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.541+0000 7f6207200640 1 -- 172.21.15.47:0/3027879036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f620804fce0 con 0x7f620806d240 2024-05-27T10:52:50.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.542+0000 7f61fea00640 1 -- 172.21.15.47:0/3027879036 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f61f0005b40 con 0x7f620806d240 2024-05-27T10:52:50.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.543+0000 7f61fea00640 1 --2- 172.21.15.47:0/3027879036 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f61e406c8f0 0x7f61e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:50.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.543+0000 7f61fea00640 1 -- 172.21.15.47:0/3027879036 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f61f008ba20 con 0x7f620806d240 2024-05-27T10:52:50.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.543+0000 7f6205e00640 1 --2- 172.21.15.47:0/3027879036 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f61e406c8f0 0x7f61e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:50.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.544+0000 7f6205e00640 1 --2- 172.21.15.47:0/3027879036 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f61e406c8f0 0x7f61e406edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f61f8000f60 tx=0x7f61f8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:50.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.548+0000 7f61fea00640 1 -- 172.21.15.47:0/3027879036 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f61f0059d30 con 0x7f620806d240 2024-05-27T10:52:50.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.747+0000 7f6207200640 1 -- 172.21.15.47:0/3027879036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62080b6cf0 con 0x7f620806d240 2024-05-27T10:52:50.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.750+0000 7f61fea00640 1 -- 172.21.15.47:0/3027879036 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16770 (secure 0 0 0) 0x7f61f0059630 con 0x7f620806d240 2024-05-27T10:52:50.749 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:50.749 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":22,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:48.545555+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:52:50.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.753+0000 7f6207200640 1 -- 172.21.15.47:0/3027879036 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f61e406c8f0 msgr2=0x7f61e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:50.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.753+0000 7f6207200640 1 --2- 172.21.15.47:0/3027879036 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f61e406c8f0 0x7f61e406edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f61f8000f60 tx=0x7f61f8009040 comp rx=0 tx=0).stop 2024-05-27T10:52:50.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.753+0000 7f6207200640 1 -- 172.21.15.47:0/3027879036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f620806d240 msgr2=0x7f62080ca600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:50.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.753+0000 7f6207200640 1 --2- 172.21.15.47:0/3027879036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f620806d240 0x7f62080ca600 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f61f000c750 tx=0x7f61f000cc10 comp rx=0 tx=0).stop 2024-05-27T10:52:50.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.753+0000 7f6207200640 1 -- 172.21.15.47:0/3027879036 shutdown_connections 2024-05-27T10:52:50.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.753+0000 7f6207200640 1 --2- 172.21.15.47:0/3027879036 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f61e406c8f0 0x7f61e406edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:50.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.753+0000 7f6207200640 1 --2- 172.21.15.47:0/3027879036 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f620815eaa0 0x7f620814c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:50.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.753+0000 7f6207200640 1 --2- 172.21.15.47:0/3027879036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f620806d240 0x7f62080ca600 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:50.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.753+0000 7f6207200640 1 --2- 172.21.15.47:0/3027879036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f620806ca40 0x7f62080c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:50.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.753+0000 7f6207200640 1 -- 172.21.15.47:0/3027879036 >> 172.21.15.47:0/3027879036 conn(0x7f620808bfd0 msgr2=0x7f62080b91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:50.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.753+0000 7f6207200640 1 -- 172.21.15.47:0/3027879036 shutdown_connections 2024-05-27T10:52:50.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.753+0000 7f6207200640 1 -- 172.21.15.47:0/3027879036 wait complete. 2024-05-27T10:52:50.769 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T10:51:55.073251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T10:51:59.202702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T10:52:00.664039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T10:52:50.769 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T10:52:50.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.979+0000 7f2da8a00640 1 Processor -- start 2024-05-27T10:52:50.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.979+0000 7f2da8a00640 1 -- start start 2024-05-27T10:52:50.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.980+0000 7f2da8a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2da415e630 0x7f2da40d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:50.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.981+0000 7f2da8a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2da40ced40 con 0x7f2da40cfde0 2024-05-27T10:52:50.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.981+0000 7f2da8a00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2da40cf020 con 0x7f2da40b6670 2024-05-27T10:52:50.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.981+0000 7f2da8a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2da40cf950 con 0x7f2da415e630 2024-05-27T10:52:50.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.981+0000 7f2da3400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2da415e630 0x7f2da40d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:50.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.981+0000 7f2da3400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2da415e630 0x7f2da40d3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44784/0 (socket says 172.21.15.47:44784) 2024-05-27T10:52:50.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.981+0000 7f2da3400640 1 -- 172.21.15.47:0/2330329573 learned_addr learned my addr 172.21.15.47:0/2330329573 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:50.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.981+0000 7f2da2a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f2da40cfde0 0x7f2da40b5f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49114/0 (socket says 172.21.15.47:49114) 2024-05-27T10:52:50.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.982+0000 7f2da3400640 1 -- 172.21.15.47:0/2330329573 >> v1:172.21.15.53:6789/0 conn(0x7f2da40b6670 legacy=0x7f2da41685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:50.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.982+0000 7f2da3400640 1 -- 172.21.15.47:0/2330329573 >> v1:172.21.15.47:6789/0 conn(0x7f2da40cfde0 legacy=0x7f2da40b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:50.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.982+0000 7f2da3400640 1 -- 172.21.15.47:0/2330329573 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da40cf300 con 0x7f2da415e630 2024-05-27T10:52:50.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.982+0000 7f2da2000640 1 -- 172.21.15.47:0/2330329573 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2468492813 0 0) 0x7f2da40ced40 con 0x7f2da40cfde0 2024-05-27T10:52:50.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.983+0000 7f2da3400640 1 --2- 172.21.15.47:0/2330329573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da415e630 0x7f2da40d3230 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009870 tx=0x7f2d9402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ee5f06198a453b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:50.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.983+0000 7f2da2000640 1 -- 172.21.15.47:0/2330329573 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d94037070 con 0x7f2da415e630 2024-05-27T10:52:50.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.983+0000 7f2da2000640 1 -- 172.21.15.47:0/2330329573 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d94032440 con 0x7f2da415e630 2024-05-27T10:52:50.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.983+0000 7f2da2000640 1 -- 172.21.15.47:0/2330329573 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d94032810 con 0x7f2da415e630 2024-05-27T10:52:50.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.984+0000 7f2da8a00640 1 -- 172.21.15.47:0/2330329573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da415e630 msgr2=0x7f2da40d3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:50.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.984+0000 7f2da8a00640 1 --2- 172.21.15.47:0/2330329573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da415e630 0x7f2da40d3230 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009870 tx=0x7f2d9402a2a0 comp rx=0 tx=0).stop 2024-05-27T10:52:50.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.984+0000 7f2da8a00640 1 -- 172.21.15.47:0/2330329573 shutdown_connections 2024-05-27T10:52:50.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.984+0000 7f2da8a00640 1 --2- 172.21.15.47:0/2330329573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da415e630 0x7f2da40d3230 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:50.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.984+0000 7f2da8a00640 1 -- 172.21.15.47:0/2330329573 >> 172.21.15.47:0/2330329573 conn(0x7f2da408bfd0 msgr2=0x7f2da40d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:50.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.984+0000 7f2da8a00640 1 -- 172.21.15.47:0/2330329573 shutdown_connections 2024-05-27T10:52:50.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.984+0000 7f2da8a00640 1 -- 172.21.15.47:0/2330329573 wait complete. 2024-05-27T10:52:50.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.986+0000 7f2da8a00640 1 Processor -- start 2024-05-27T10:52:50.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.986+0000 7f2da8a00640 1 -- start start 2024-05-27T10:52:50.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.987+0000 7f2da8a00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2da40b6670 0x7f2da415ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:50.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.987+0000 7f2da8a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2da40cfde0 0x7f2da40b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:50.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.987+0000 7f2da8a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da415e630 0x7f2da40cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:50.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.987+0000 7f2da8a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2da415eb90 con 0x7f2da415e630 2024-05-27T10:52:50.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.987+0000 7f2da8a00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2da415ea10 con 0x7f2da40b6670 2024-05-27T10:52:50.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.987+0000 7f2da8a00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f2da40d3770 con 0x7f2da40cfde0 2024-05-27T10:52:50.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.987+0000 7f2da3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da415e630 0x7f2da40cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:50.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.987+0000 7f2da3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da415e630 0x7f2da40cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44788/0 (socket says 172.21.15.47:44788) 2024-05-27T10:52:50.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.987+0000 7f2da3e00640 1 -- 172.21.15.47:0/2729937009 learned_addr learned my addr 172.21.15.47:0/2729937009 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:50.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.987+0000 7f2da3400640 1 --2- 172.21.15.47:0/2729937009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2da40b6670 0x7f2da415ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:50.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.988+0000 7f2da2a00640 1 --2- 172.21.15.47:0/2729937009 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2da40cfde0 0x7f2da40b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:50.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.988+0000 7f2da3e00640 1 -- 172.21.15.47:0/2729937009 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2da40cfde0 msgr2=0x7f2da40b7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:50.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.988+0000 7f2da3e00640 1 --2- 172.21.15.47:0/2729937009 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2da40cfde0 0x7f2da40b7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:50.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.988+0000 7f2da3e00640 1 -- 172.21.15.47:0/2729937009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2da40b6670 msgr2=0x7f2da415ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:50.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.988+0000 7f2da3e00640 1 --2- 172.21.15.47:0/2729937009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2da40b6670 0x7f2da415ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:50.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.988+0000 7f2da3e00640 1 -- 172.21.15.47:0/2729937009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da40ca1f0 con 0x7f2da415e630 2024-05-27T10:52:50.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.988+0000 7f2da3e00640 1 --2- 172.21.15.47:0/2729937009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da415e630 0x7f2da40cd300 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00c780 tx=0x7f2d9c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:50.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.988+0000 7f2d9b400640 1 -- 172.21.15.47:0/2729937009 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c004b60 con 0x7f2da415e630 2024-05-27T10:52:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.988+0000 7f2d9b400640 1 -- 172.21.15.47:0/2729937009 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d9c004d00 con 0x7f2da415e630 2024-05-27T10:52:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.988+0000 7f2d9b400640 1 -- 172.21.15.47:0/2729937009 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c00aa90 con 0x7f2da415e630 2024-05-27T10:52:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.988+0000 7f2da8a00640 1 -- 172.21.15.47:0/2729937009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2da40ca4d0 con 0x7f2da415e630 2024-05-27T10:52:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.988+0000 7f2da8a00640 1 -- 172.21.15.47:0/2729937009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2da415f250 con 0x7f2da415e630 2024-05-27T10:52:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.990+0000 7f2da8a00640 1 -- 172.21.15.47:0/2729937009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2da404fce0 con 0x7f2da415e630 2024-05-27T10:52:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.991+0000 7f2d9b400640 1 -- 172.21.15.47:0/2729937009 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2d9c00ac30 con 0x7f2da415e630 2024-05-27T10:52:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.991+0000 7f2d9b400640 1 --2- 172.21.15.47:0/2729937009 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2d8406c920 0x7f2d8406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.992+0000 7f2d9b400640 1 -- 172.21.15.47:0/2729937009 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f2d9c08be40 con 0x7f2da415e630 2024-05-27T10:52:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.992+0000 7f2da3400640 1 --2- 172.21.15.47:0/2729937009 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2d8406c920 0x7f2d8406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:50.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.992+0000 7f2da3400640 1 --2- 172.21.15.47:0/2729937009 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2d8406c920 0x7f2d8406ede0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2d94034000 tx=0x7f2d9402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:50.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:50.996+0000 7f2d9b400640 1 -- 172.21.15.47:0/2729937009 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2d9c020070 con 0x7f2da415e630 2024-05-27T10:52:51.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.192+0000 7f2da8a00640 1 -- 172.21.15.47:0/2729937009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2da408e600 con 0x7f2da415e630 2024-05-27T10:52:51.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.193+0000 7f2d9b400640 1 -- 172.21.15.47:0/2729937009 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f2d9c05a1e0 con 0x7f2da415e630 2024-05-27T10:52:51.191 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-27T10:52:51.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.196+0000 7f2da8a00640 1 -- 172.21.15.47:0/2729937009 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2d8406c920 msgr2=0x7f2d8406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:51.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.196+0000 7f2da8a00640 1 --2- 172.21.15.47:0/2729937009 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2d8406c920 0x7f2d8406ede0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2d94034000 tx=0x7f2d9402e000 comp rx=0 tx=0).stop 2024-05-27T10:52:51.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.196+0000 7f2da8a00640 1 -- 172.21.15.47:0/2729937009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da415e630 msgr2=0x7f2da40cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:51.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.196+0000 7f2da8a00640 1 --2- 172.21.15.47:0/2729937009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da415e630 0x7f2da40cd300 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00c780 tx=0x7f2d9c00cc40 comp rx=0 tx=0).stop 2024-05-27T10:52:51.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.196+0000 7f2da8a00640 1 -- 172.21.15.47:0/2729937009 shutdown_connections 2024-05-27T10:52:51.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.196+0000 7f2da8a00640 1 --2- 172.21.15.47:0/2729937009 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2d8406c920 0x7f2d8406ede0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:51.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.196+0000 7f2da8a00640 1 --2- 172.21.15.47:0/2729937009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da415e630 0x7f2da40cd300 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:51.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.196+0000 7f2da8a00640 1 --2- 172.21.15.47:0/2729937009 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2da40cfde0 0x7f2da40b7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:51.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.196+0000 7f2da8a00640 1 --2- 172.21.15.47:0/2729937009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2da40b6670 0x7f2da415ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:51.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.196+0000 7f2da8a00640 1 -- 172.21.15.47:0/2729937009 >> 172.21.15.47:0/2729937009 conn(0x7f2da408bfd0 msgr2=0x7f2da406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:51.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.196+0000 7f2da8a00640 1 -- 172.21.15.47:0/2729937009 shutdown_connections 2024-05-27T10:52:51.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.197+0000 7f2da8a00640 1 -- 172.21.15.47:0/2729937009 wait complete. 2024-05-27T10:52:51.213 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T10:52:51.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.426+0000 7f5186600640 1 Processor -- start 2024-05-27T10:52:51.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.426+0000 7f5186600640 1 -- start start 2024-05-27T10:52:51.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.428+0000 7f5186600640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51800d0a30 0x7f5180167470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:51.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.428+0000 7f5186600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51800b4620 con 0x7f518006da80 2024-05-27T10:52:51.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.428+0000 7f5186600640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51800b4900 con 0x7f518015c510 2024-05-27T10:52:51.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.428+0000 7f5186600640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f51800b43e0 con 0x7f51800d0a30 2024-05-27T10:52:51.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.428+0000 7f517fe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f518006da80 0x7f51800d0320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49116/0 (socket says 172.21.15.47:49116) 2024-05-27T10:52:51.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.428+0000 7f517fe00640 1 -- 172.21.15.47:0/3423993793 learned_addr learned my addr 172.21.15.47:0/3423993793 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.429+0000 7f517f400640 1 -- 172.21.15.47:0/3423993793 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 778039595 0 0) 0x7f51800b4620 con 0x7f518006da80 2024-05-27T10:52:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.429+0000 7f517f400640 1 -- 172.21.15.47:0/3423993793 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5168003520 con 0x7f518006da80 2024-05-27T10:52:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.429+0000 7f5185c00640 1 --2- 172.21.15.47:0/3423993793 >> v2:172.21.15.53:3300/0 conn(0x7f51800d0a30 0x7f5180167470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.429+0000 7f517f400640 1 -- 172.21.15.47:0/3423993793 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4151585127 0 0) 0x7f5168003520 con 0x7f518006da80 2024-05-27T10:52:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.429+0000 7f517f400640 1 -- 172.21.15.47:0/3423993793 >> v2:172.21.15.53:3300/0 conn(0x7f51800d0a30 msgr2=0x7f5180167470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.429+0000 7f517f400640 1 --2- 172.21.15.47:0/3423993793 >> v2:172.21.15.53:3300/0 conn(0x7f51800d0a30 0x7f5180167470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.429+0000 7f517f400640 1 -- 172.21.15.47:0/3423993793 >> v1:172.21.15.53:6789/0 conn(0x7f518015c510 legacy=0x7f51800b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.429+0000 7f517f400640 1 -- 172.21.15.47:0/3423993793 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51800b4be0 con 0x7f518006da80 2024-05-27T10:52:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.429+0000 7f517f400640 1 -- 172.21.15.47:0/3423993793 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f516c001670 con 0x7f518006da80 2024-05-27T10:52:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.429+0000 7f517f400640 1 -- 172.21.15.47:0/3423993793 >> v1:172.21.15.47:6789/0 conn(0x7f518006da80 legacy=0x7f51800d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.429+0000 7f517f400640 1 --2- 172.21.15.47:0/3423993793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51680039b0 0x7f5168003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.429+0000 7f517f400640 1 --2- 172.21.15.47:0/3423993793 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5168004800 0x7f5168004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.429+0000 7f517f400640 1 --2- 172.21.15.47:0/3423993793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51680051c0 0x7f516800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.429+0000 7f517f400640 1 -- 172.21.15.47:0/3423993793 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f51800b43e0 con 0x7f51680051c0 2024-05-27T10:52:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.429+0000 7f517f400640 1 -- 172.21.15.47:0/3423993793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f516800c110 con 0x7f51680039b0 2024-05-27T10:52:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.429+0000 7f517f400640 1 -- 172.21.15.47:0/3423993793 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f516800c310 con 0x7f5168004800 2024-05-27T10:52:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.429+0000 7f5185c00640 1 --2- 172.21.15.47:0/3423993793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51680051c0 0x7f516800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.430+0000 7f5185200640 1 --2- 172.21.15.47:0/3423993793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51680039b0 0x7f5168003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:51.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.430+0000 7f517fe00640 1 --2- 172.21.15.47:0/3423993793 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5168004800 0x7f5168004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:51.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.430+0000 7f5185c00640 1 -- 172.21.15.47:0/3423993793 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5168004800 msgr2=0x7f5168004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:51.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.430+0000 7f5185c00640 1 --2- 172.21.15.47:0/3423993793 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5168004800 0x7f5168004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:51.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.430+0000 7f5185c00640 1 -- 172.21.15.47:0/3423993793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51680039b0 msgr2=0x7f5168003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:51.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.430+0000 7f5185c00640 1 --2- 172.21.15.47:0/3423993793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51680039b0 0x7f5168003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:51.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.430+0000 7f5185c00640 1 -- 172.21.15.47:0/3423993793 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5168003520 con 0x7f51680051c0 2024-05-27T10:52:51.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.430+0000 7f5185200640 1 --2- 172.21.15.47:0/3423993793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51680039b0 0x7f5168003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:52:51.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.430+0000 7f517fe00640 1 --2- 172.21.15.47:0/3423993793 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5168004800 0x7f5168004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:51.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.431+0000 7f5185c00640 1 -- 172.21.15.47:0/3423993793 reap_dead start 2024-05-27T10:52:51.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.431+0000 7f5185c00640 1 --2- 172.21.15.47:0/3423993793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51680051c0 0x7f516800b9c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5178007360 tx=0x7f5168005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76344e32ef5d219 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:51.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.431+0000 7f517f400640 1 -- 172.21.15.47:0/3423993793 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178009be0 con 0x7f51680051c0 2024-05-27T10:52:51.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.431+0000 7f517f400640 1 -- 172.21.15.47:0/3423993793 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5178003bd0 con 0x7f51680051c0 2024-05-27T10:52:51.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.431+0000 7f517f400640 1 -- 172.21.15.47:0/3423993793 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178004020 con 0x7f51680051c0 2024-05-27T10:52:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.432+0000 7f5186600640 1 -- 172.21.15.47:0/3423993793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51680051c0 msgr2=0x7f516800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.432+0000 7f5186600640 1 --2- 172.21.15.47:0/3423993793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51680051c0 0x7f516800b9c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5178007360 tx=0x7f5168005830 comp rx=0 tx=0).stop 2024-05-27T10:52:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.432+0000 7f5186600640 1 -- 172.21.15.47:0/3423993793 shutdown_connections 2024-05-27T10:52:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.432+0000 7f5186600640 1 --2- 172.21.15.47:0/3423993793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51680051c0 0x7f516800b9c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.432+0000 7f5186600640 1 -- 172.21.15.47:0/3423993793 >> 172.21.15.47:0/3423993793 conn(0x7f518006bb20 msgr2=0x7f518006bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.432+0000 7f5186600640 1 -- 172.21.15.47:0/3423993793 shutdown_connections 2024-05-27T10:52:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.432+0000 7f5186600640 1 -- 172.21.15.47:0/3423993793 wait complete. 2024-05-27T10:52:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.434+0000 7f5186600640 1 Processor -- start 2024-05-27T10:52:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.434+0000 7f5186600640 1 -- start start 2024-05-27T10:52:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.435+0000 7f5186600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51680051c0 0x7f5180151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.435+0000 7f5186600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f518009ae70 0x7f518009cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.435+0000 7f5186600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f518009d2f0 0x7f51800ad490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.435+0000 7f5186600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f51800d0320 con 0x7f518009ae70 2024-05-27T10:52:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.435+0000 7f5186600640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f518015c8f0 con 0x7f51680051c0 2024-05-27T10:52:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.435+0000 7f5186600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f51800d04a0 con 0x7f518009d2f0 2024-05-27T10:52:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.435+0000 7f517fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f518009ae70 0x7f518009cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.435+0000 7f517fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f518009ae70 0x7f518009cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44814/0 (socket says 172.21.15.47:44814) 2024-05-27T10:52:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.435+0000 7f517fe00640 1 -- 172.21.15.47:0/1759817909 learned_addr learned my addr 172.21.15.47:0/1759817909 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.436+0000 7f5185200640 1 --2- 172.21.15.47:0/1759817909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51680051c0 0x7f5180151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.436+0000 7f517fe00640 1 -- 172.21.15.47:0/1759817909 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f518009d2f0 msgr2=0x7f51800ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.436+0000 7f517fe00640 1 --2- 172.21.15.47:0/1759817909 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f518009d2f0 0x7f51800ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.436+0000 7f517fe00640 1 -- 172.21.15.47:0/1759817909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51680051c0 msgr2=0x7f5180151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.436+0000 7f517fe00640 1 --2- 172.21.15.47:0/1759817909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51680051c0 0x7f5180151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.436+0000 7f517fe00640 1 -- 172.21.15.47:0/1759817909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518009b370 con 0x7f518009ae70 2024-05-27T10:52:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.436+0000 7f5185200640 1 --2- 172.21.15.47:0/1759817909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51680051c0 0x7f5180151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.436+0000 7f517fe00640 1 --2- 172.21.15.47:0/1759817909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f518009ae70 0x7f518009cdb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f516c00d860 tx=0x7f516c00dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.436+0000 7f517cc00640 1 -- 172.21.15.47:0/1759817909 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516c019070 con 0x7f518009ae70 2024-05-27T10:52:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.436+0000 7f517cc00640 1 -- 172.21.15.47:0/1759817909 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f516c0074e0 con 0x7f518009ae70 2024-05-27T10:52:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.436+0000 7f517cc00640 1 -- 172.21.15.47:0/1759817909 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516c0049e0 con 0x7f518009ae70 2024-05-27T10:52:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.436+0000 7f5186600640 1 -- 172.21.15.47:0/1759817909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f518009b650 con 0x7f518009ae70 2024-05-27T10:52:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.437+0000 7f5186600640 1 -- 172.21.15.47:0/1759817909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f518009bc10 con 0x7f518009ae70 2024-05-27T10:52:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.438+0000 7f5186600640 1 -- 172.21.15.47:0/1759817909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51801f46e0 con 0x7f518009ae70 2024-05-27T10:52:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.438+0000 7f517cc00640 1 -- 172.21.15.47:0/1759817909 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f516c01c070 con 0x7f518009ae70 2024-05-27T10:52:51.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.439+0000 7f517cc00640 1 --2- 172.21.15.47:0/1759817909 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f516006c8f0 0x7f516006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:51.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.439+0000 7f517cc00640 1 -- 172.21.15.47:0/1759817909 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f516c08b640 con 0x7f518009ae70 2024-05-27T10:52:51.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.440+0000 7f5185200640 1 --2- 172.21.15.47:0/1759817909 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f516006c8f0 0x7f516006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:51.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.440+0000 7f5185200640 1 --2- 172.21.15.47:0/1759817909 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f516006c8f0 0x7f516006edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5174000c00 tx=0x7f5174009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:51.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.444+0000 7f517cc00640 1 -- 172.21.15.47:0/1759817909 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f516c0599e0 con 0x7f518009ae70 2024-05-27T10:52:51.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.649+0000 7f5186600640 1 -- 172.21.15.47:0/1759817909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f518004fce0 con 0x7f518009ae70 2024-05-27T10:52:51.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.650+0000 7f517cc00640 1 -- 172.21.15.47:0/1759817909 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f516c0592e0 con 0x7f518009ae70 2024-05-27T10:52:51.648 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-27T10:52:51.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.652+0000 7f5186600640 1 -- 172.21.15.47:0/1759817909 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f516006c8f0 msgr2=0x7f516006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:51.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.652+0000 7f5186600640 1 --2- 172.21.15.47:0/1759817909 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f516006c8f0 0x7f516006edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5174000c00 tx=0x7f5174009040 comp rx=0 tx=0).stop 2024-05-27T10:52:51.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.652+0000 7f5186600640 1 -- 172.21.15.47:0/1759817909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f518009ae70 msgr2=0x7f518009cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:51.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.652+0000 7f5186600640 1 --2- 172.21.15.47:0/1759817909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f518009ae70 0x7f518009cdb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f516c00d860 tx=0x7f516c00dd20 comp rx=0 tx=0).stop 2024-05-27T10:52:51.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.653+0000 7f5186600640 1 -- 172.21.15.47:0/1759817909 shutdown_connections 2024-05-27T10:52:51.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.653+0000 7f5186600640 1 --2- 172.21.15.47:0/1759817909 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f516006c8f0 0x7f516006edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:51.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.653+0000 7f5186600640 1 --2- 172.21.15.47:0/1759817909 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f518009d2f0 0x7f51800ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:51.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.653+0000 7f5186600640 1 --2- 172.21.15.47:0/1759817909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f518009ae70 0x7f518009cdb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:51.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.653+0000 7f5186600640 1 --2- 172.21.15.47:0/1759817909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51680051c0 0x7f5180151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:51.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.653+0000 7f5186600640 1 -- 172.21.15.47:0/1759817909 >> 172.21.15.47:0/1759817909 conn(0x7f518006bb20 msgr2=0x7f51800b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:51.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.653+0000 7f5186600640 1 -- 172.21.15.47:0/1759817909 shutdown_connections 2024-05-27T10:52:51.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.653+0000 7f5186600640 1 -- 172.21.15.47:0/1759817909 wait complete. 2024-05-27T10:52:51.670 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T10:52:51.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.889+0000 7f94f5800640 1 Processor -- start 2024-05-27T10:52:51.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.890+0000 7f94f5800640 1 -- start start 2024-05-27T10:52:51.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.891+0000 7f94f5800640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f94f0162d10 0x7f94f006f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:51.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.891+0000 7f94f5800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f94f00cff00 0x7f94f00b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:51.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.891+0000 7f94f5800640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94f006e710 con 0x7f94f0071d30 2024-05-27T10:52:51.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.891+0000 7f94f5800640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f94f00ce250 con 0x7f94f0162d10 2024-05-27T10:52:51.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.891+0000 7f94f5800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f94f00cfcd0 con 0x7f94f00cff00 2024-05-27T10:52:51.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.892+0000 7f94ef400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f94f00cff00 0x7f94f00b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:51.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.892+0000 7f94ef400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f94f00cff00 0x7f94f00b34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:40482/0 (socket says 172.21.15.47:40482) 2024-05-27T10:52:51.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.892+0000 7f94ef400640 1 -- 172.21.15.47:0/307667523 learned_addr learned my addr 172.21.15.47:0/307667523 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:51.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.892+0000 7f94ee000640 1 --2- 172.21.15.47:0/307667523 >> v2:172.21.15.53:3300/0 conn(0x7f94f0162d10 0x7f94f006f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:51.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.893+0000 7f94ef400640 1 -- 172.21.15.47:0/307667523 >> v2:172.21.15.53:3300/0 conn(0x7f94f0162d10 msgr2=0x7f94f006f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:51.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.893+0000 7f94ef400640 1 --2- 172.21.15.47:0/307667523 >> v2:172.21.15.53:3300/0 conn(0x7f94f0162d10 0x7f94f006f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:51.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.893+0000 7f94ef400640 1 -- 172.21.15.47:0/307667523 >> v1:172.21.15.53:6789/0 conn(0x7f94f0071d30 legacy=0x7f94f0072110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:51.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.893+0000 7f94ef400640 1 -- 172.21.15.47:0/307667523 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f006e980 con 0x7f94f00cff00 2024-05-27T10:52:51.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.894+0000 7f94ef400640 1 --2- 172.21.15.47:0/307667523 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f94f00cff00 0x7f94f00b34e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009870 tx=0x7f94e802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a31ee757f7767c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:51.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.895+0000 7f94ed600640 1 -- 172.21.15.47:0/307667523 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e8037070 con 0x7f94f00cff00 2024-05-27T10:52:51.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.895+0000 7f94ed600640 1 -- 172.21.15.47:0/307667523 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e8032440 con 0x7f94f00cff00 2024-05-27T10:52:51.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.895+0000 7f94ed600640 1 -- 172.21.15.47:0/307667523 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e8032810 con 0x7f94f00cff00 2024-05-27T10:52:51.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.896+0000 7f94f5800640 1 -- 172.21.15.47:0/307667523 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f94f00cff00 msgr2=0x7f94f00b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:51.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.896+0000 7f94f5800640 1 --2- 172.21.15.47:0/307667523 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f94f00cff00 0x7f94f00b34e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009870 tx=0x7f94e802a250 comp rx=0 tx=0).stop 2024-05-27T10:52:51.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.896+0000 7f94f5800640 1 -- 172.21.15.47:0/307667523 shutdown_connections 2024-05-27T10:52:51.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.896+0000 7f94f5800640 1 --2- 172.21.15.47:0/307667523 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f94f00cff00 0x7f94f00b34e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:51.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.896+0000 7f94f5800640 1 --2- 172.21.15.47:0/307667523 >> v2:172.21.15.53:3300/0 conn(0x7f94f0162d10 0x7f94f006f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:51.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.896+0000 7f94f5800640 1 -- 172.21.15.47:0/307667523 >> 172.21.15.47:0/307667523 conn(0x7f94f00b21e0 msgr2=0x7f94f00b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:51.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.896+0000 7f94f5800640 1 -- 172.21.15.47:0/307667523 shutdown_connections 2024-05-27T10:52:51.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.896+0000 7f94f5800640 1 -- 172.21.15.47:0/307667523 wait complete. 2024-05-27T10:52:51.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.898+0000 7f94f5800640 1 Processor -- start 2024-05-27T10:52:51.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.898+0000 7f94f5800640 1 -- start start 2024-05-27T10:52:51.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.899+0000 7f94f5800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f94f0071d30 0x7f94f01fc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:51.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.899+0000 7f94f5800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94f00cff00 0x7f94f0145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:51.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.899+0000 7f94f5800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94f0162d10 0x7f94f0146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:51.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.899+0000 7f94f5800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f94f00b3a20 con 0x7f94f00cff00 2024-05-27T10:52:51.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.899+0000 7f94f5800640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f94f00ce760 con 0x7f94f0162d10 2024-05-27T10:52:51.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.899+0000 7f94f5800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f94f00cec80 con 0x7f94f0071d30 2024-05-27T10:52:51.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.900+0000 7f94ee000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94f00cff00 0x7f94f0145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:51.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.900+0000 7f94ee000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94f00cff00 0x7f94f0145c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44830/0 (socket says 172.21.15.47:44830) 2024-05-27T10:52:51.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.900+0000 7f94ee000640 1 -- 172.21.15.47:0/144603358 learned_addr learned my addr 172.21.15.47:0/144603358 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:51.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.900+0000 7f94eea00640 1 --2- 172.21.15.47:0/144603358 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f94f0071d30 0x7f94f01fc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:51.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.900+0000 7f94ef400640 1 --2- 172.21.15.47:0/144603358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94f0162d10 0x7f94f0146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:51.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.900+0000 7f94ee000640 1 -- 172.21.15.47:0/144603358 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f94f0071d30 msgr2=0x7f94f01fc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:51.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.900+0000 7f94ee000640 1 --2- 172.21.15.47:0/144603358 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f94f0071d30 0x7f94f01fc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:51.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.900+0000 7f94ee000640 1 -- 172.21.15.47:0/144603358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94f0162d10 msgr2=0x7f94f0146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:51.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.900+0000 7f94ee000640 1 --2- 172.21.15.47:0/144603358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94f0162d10 0x7f94f0146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:51.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.900+0000 7f94ee000640 1 -- 172.21.15.47:0/144603358 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f0164230 con 0x7f94f00cff00 2024-05-27T10:52:51.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.901+0000 7f94ee000640 1 --2- 172.21.15.47:0/144603358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94f00cff00 0x7f94f0145c10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f94d800e870 tx=0x7f94d800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:51.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.901+0000 7f94e6a00640 1 -- 172.21.15.47:0/144603358 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8017070 con 0x7f94f00cff00 2024-05-27T10:52:51.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.901+0000 7f94e6a00640 1 -- 172.21.15.47:0/144603358 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d800c940 con 0x7f94f00cff00 2024-05-27T10:52:51.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.901+0000 7f94e6a00640 1 -- 172.21.15.47:0/144603358 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d800cd10 con 0x7f94f00cff00 2024-05-27T10:52:51.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.901+0000 7f94f5800640 1 -- 172.21.15.47:0/144603358 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f01467f0 con 0x7f94f00cff00 2024-05-27T10:52:51.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.901+0000 7f94f5800640 1 -- 172.21.15.47:0/144603358 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f01fd1e0 con 0x7f94f00cff00 2024-05-27T10:52:51.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.902+0000 7f94f5800640 1 -- 172.21.15.47:0/144603358 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94f0072ee0 con 0x7f94f00cff00 2024-05-27T10:52:51.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.903+0000 7f94e6a00640 1 -- 172.21.15.47:0/144603358 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f94d801a070 con 0x7f94f00cff00 2024-05-27T10:52:51.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.904+0000 7f94e6a00640 1 --2- 172.21.15.47:0/144603358 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f94cc06c8f0 0x7f94cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:51.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.904+0000 7f94e6a00640 1 -- 172.21.15.47:0/144603358 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f94d808baa0 con 0x7f94f00cff00 2024-05-27T10:52:51.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.904+0000 7f94eea00640 1 --2- 172.21.15.47:0/144603358 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f94cc06c8f0 0x7f94cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:51.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.905+0000 7f94eea00640 1 --2- 172.21.15.47:0/144603358 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f94cc06c8f0 0x7f94cc06edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f94f01fc5a0 tx=0x7f94e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:51.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:51.909+0000 7f94e6a00640 1 -- 172.21.15.47:0/144603358 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f94f0072ee0 con 0x7f94f00cff00 2024-05-27T10:52:52.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.124+0000 7f94f5800640 1 -- 172.21.15.47:0/144603358 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f94f004fdc0 con 0x7f94f00cff00 2024-05-27T10:52:52.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.125+0000 7f94e6a00640 1 -- 172.21.15.47:0/144603358 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f94d8059760 con 0x7f94f00cff00 2024-05-27T10:52:52.123 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-27T10:52:52.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.128+0000 7f94f5800640 1 -- 172.21.15.47:0/144603358 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f94cc06c8f0 msgr2=0x7f94cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:52.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.128+0000 7f94f5800640 1 --2- 172.21.15.47:0/144603358 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f94cc06c8f0 0x7f94cc06edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f94f01fc5a0 tx=0x7f94e0009040 comp rx=0 tx=0).stop 2024-05-27T10:52:52.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.128+0000 7f94f5800640 1 -- 172.21.15.47:0/144603358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94f00cff00 msgr2=0x7f94f0145c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:52.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.128+0000 7f94f5800640 1 --2- 172.21.15.47:0/144603358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94f00cff00 0x7f94f0145c10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f94d800e870 tx=0x7f94d800ed30 comp rx=0 tx=0).stop 2024-05-27T10:52:52.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.128+0000 7f94f5800640 1 -- 172.21.15.47:0/144603358 shutdown_connections 2024-05-27T10:52:52.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.128+0000 7f94f5800640 1 --2- 172.21.15.47:0/144603358 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f94cc06c8f0 0x7f94cc06edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:52.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.128+0000 7f94f5800640 1 --2- 172.21.15.47:0/144603358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94f0162d10 0x7f94f0146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:52.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.128+0000 7f94f5800640 1 --2- 172.21.15.47:0/144603358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94f00cff00 0x7f94f0145c10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:52.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.128+0000 7f94f5800640 1 --2- 172.21.15.47:0/144603358 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f94f0071d30 0x7f94f01fc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:52.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.128+0000 7f94f5800640 1 -- 172.21.15.47:0/144603358 >> 172.21.15.47:0/144603358 conn(0x7f94f00b21e0 msgr2=0x7f94f00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:52.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.129+0000 7f94f5800640 1 -- 172.21.15.47:0/144603358 shutdown_connections 2024-05-27T10:52:52.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.129+0000 7f94f5800640 1 -- 172.21.15.47:0/144603358 wait complete. 2024-05-27T10:52:52.146 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T10:52:52.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.351+0000 7f10f3e00640 1 Processor -- start 2024-05-27T10:52:52.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.351+0000 7f10f3e00640 1 -- start start 2024-05-27T10:52:52.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.352+0000 7f10f3e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f10f40d0a70 0x7f10f406e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.352+0000 7f10f3e00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f10f406ebd0 0x7f10f40ae130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.352+0000 7f10f3e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10f406f3a0 con 0x7f10f415b380 2024-05-27T10:52:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.352+0000 7f10f3e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f10f40adcc0 con 0x7f10f40d0a70 2024-05-27T10:52:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.352+0000 7f10f3e00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f10f406ff20 con 0x7f10f406ebd0 2024-05-27T10:52:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.353+0000 7f10f2a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f10f415b380 0x7f10f40d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49128/0 (socket says 172.21.15.47:49128) 2024-05-27T10:52:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.353+0000 7f10f2a00640 1 -- 172.21.15.47:0/4259316499 learned_addr learned my addr 172.21.15.47:0/4259316499 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.353+0000 7f10f2000640 1 --2- 172.21.15.47:0/4259316499 >> v2:172.21.15.47:3300/0 conn(0x7f10f40d0a70 0x7f10f406e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:52.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.353+0000 7f10f3400640 1 --2- 172.21.15.47:0/4259316499 >> v2:172.21.15.53:3300/0 conn(0x7f10f406ebd0 0x7f10f40ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:52.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.353+0000 7f10f1600640 1 -- 172.21.15.47:0/4259316499 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1394291020 0 0) 0x7f10f406f3a0 con 0x7f10f415b380 2024-05-27T10:52:52.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.353+0000 7f10f2000640 1 -- 172.21.15.47:0/4259316499 >> v2:172.21.15.53:3300/0 conn(0x7f10f406ebd0 msgr2=0x7f10f40ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:52.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.353+0000 7f10f2000640 1 --2- 172.21.15.47:0/4259316499 >> v2:172.21.15.53:3300/0 conn(0x7f10f406ebd0 0x7f10f40ae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:52.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.353+0000 7f10f2000640 1 -- 172.21.15.47:0/4259316499 >> v1:172.21.15.47:6789/0 conn(0x7f10f415b380 legacy=0x7f10f40d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:52.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.353+0000 7f10f2000640 1 -- 172.21.15.47:0/4259316499 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f406f680 con 0x7f10f40d0a70 2024-05-27T10:52:52.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.354+0000 7f10f2000640 1 --2- 172.21.15.47:0/4259316499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10f40d0a70 0x7f10f406e690 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f10f406c890 tx=0x7f10dc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4144e2f39e0d7e6f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:52.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.355+0000 7f10f1600640 1 -- 172.21.15.47:0/4259316499 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10dc037070 con 0x7f10f40d0a70 2024-05-27T10:52:52.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.355+0000 7f10f1600640 1 -- 172.21.15.47:0/4259316499 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10dc032440 con 0x7f10f40d0a70 2024-05-27T10:52:52.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.355+0000 7f10f1600640 1 -- 172.21.15.47:0/4259316499 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10dc02ae60 con 0x7f10f40d0a70 2024-05-27T10:52:52.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.355+0000 7f10f3e00640 1 -- 172.21.15.47:0/4259316499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10f40d0a70 msgr2=0x7f10f406e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:52.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.355+0000 7f10f3e00640 1 --2- 172.21.15.47:0/4259316499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10f40d0a70 0x7f10f406e690 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f10f406c890 tx=0x7f10dc02a110 comp rx=0 tx=0).stop 2024-05-27T10:52:52.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.356+0000 7f10f3e00640 1 -- 172.21.15.47:0/4259316499 shutdown_connections 2024-05-27T10:52:52.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.356+0000 7f10f3e00640 1 --2- 172.21.15.47:0/4259316499 >> v2:172.21.15.53:3300/0 conn(0x7f10f406ebd0 0x7f10f40ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:52.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.356+0000 7f10f3e00640 1 --2- 172.21.15.47:0/4259316499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10f40d0a70 0x7f10f406e690 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:52.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.356+0000 7f10f3e00640 1 -- 172.21.15.47:0/4259316499 >> 172.21.15.47:0/4259316499 conn(0x7f10f406bb20 msgr2=0x7f10f406bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:52.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.356+0000 7f10f3e00640 1 -- 172.21.15.47:0/4259316499 shutdown_connections 2024-05-27T10:52:52.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.356+0000 7f10f3e00640 1 -- 172.21.15.47:0/4259316499 wait complete. 2024-05-27T10:52:52.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.357+0000 7f10f3e00640 1 Processor -- start 2024-05-27T10:52:52.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.358+0000 7f10f3e00640 1 -- start start 2024-05-27T10:52:52.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.359+0000 7f10f3e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10f406ebd0 0x7f10f41461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:52.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.359+0000 7f10f3e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f10f40d0a70 0x7f10f4150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:52.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.359+0000 7f10f3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10f415b380 0x7f10f4151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:52.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.359+0000 7f10f3e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f10f406f000 con 0x7f10f415b380 2024-05-27T10:52:52.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.359+0000 7f10f3e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f10f406fc40 con 0x7f10f406ebd0 2024-05-27T10:52:52.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.359+0000 7f10f3e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f10f406f180 con 0x7f10f40d0a70 2024-05-27T10:52:52.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.359+0000 7f10f3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10f415b380 0x7f10f4151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.359+0000 7f10f3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10f415b380 0x7f10f4151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44840/0 (socket says 172.21.15.47:44840) 2024-05-27T10:52:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.359+0000 7f10f3400640 1 -- 172.21.15.47:0/2675458344 learned_addr learned my addr 172.21.15.47:0/2675458344 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.359+0000 7f10f2a00640 1 --2- 172.21.15.47:0/2675458344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10f406ebd0 0x7f10f41461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.359+0000 7f10f2000640 1 --2- 172.21.15.47:0/2675458344 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f10f40d0a70 0x7f10f4150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.359+0000 7f10f3400640 1 -- 172.21.15.47:0/2675458344 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f10f40d0a70 msgr2=0x7f10f4150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.359+0000 7f10f3400640 1 --2- 172.21.15.47:0/2675458344 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f10f40d0a70 0x7f10f4150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.359+0000 7f10f3400640 1 -- 172.21.15.47:0/2675458344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10f406ebd0 msgr2=0x7f10f41461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.359+0000 7f10f3400640 1 --2- 172.21.15.47:0/2675458344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10f406ebd0 0x7f10f41461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.359+0000 7f10f3400640 1 -- 172.21.15.47:0/2675458344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f4150fe0 con 0x7f10f415b380 2024-05-27T10:52:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.359+0000 7f10f2a00640 1 --2- 172.21.15.47:0/2675458344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10f406ebd0 0x7f10f41461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.359+0000 7f10f2000640 1 --2- 172.21.15.47:0/2675458344 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f10f40d0a70 0x7f10f4150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.360+0000 7f10f3400640 1 --2- 172.21.15.47:0/2675458344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10f415b380 0x7f10f4151f70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f10ec007e70 tx=0x7f10ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.360+0000 7f10eaa00640 1 -- 172.21.15.47:0/2675458344 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec014620 con 0x7f10f415b380 2024-05-27T10:52:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.360+0000 7f10eaa00640 1 -- 172.21.15.47:0/2675458344 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10ec019070 con 0x7f10f415b380 2024-05-27T10:52:52.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.360+0000 7f10f3e00640 1 -- 172.21.15.47:0/2675458344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f41512c0 con 0x7f10f415b380 2024-05-27T10:52:52.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.360+0000 7f10eaa00640 1 -- 172.21.15.47:0/2675458344 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec014a20 con 0x7f10f415b380 2024-05-27T10:52:52.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.360+0000 7f10f3e00640 1 -- 172.21.15.47:0/2675458344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f415cbb0 con 0x7f10f415b380 2024-05-27T10:52:52.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.361+0000 7f10f3e00640 1 -- 172.21.15.47:0/2675458344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10f404fce0 con 0x7f10f415b380 2024-05-27T10:52:52.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.362+0000 7f10eaa00640 1 -- 172.21.15.47:0/2675458344 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f10ec014bc0 con 0x7f10f415b380 2024-05-27T10:52:52.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.363+0000 7f10eaa00640 1 --2- 172.21.15.47:0/2675458344 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f10d006c8f0 0x7f10d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:52.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.363+0000 7f10eaa00640 1 -- 172.21.15.47:0/2675458344 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f10ec08c650 con 0x7f10f415b380 2024-05-27T10:52:52.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.364+0000 7f10f2a00640 1 --2- 172.21.15.47:0/2675458344 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f10d006c8f0 0x7f10d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:52.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.364+0000 7f10f2a00640 1 --2- 172.21.15.47:0/2675458344 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f10d006c8f0 0x7f10d006edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f10e4000f60 tx=0x7f10e4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:52.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.368+0000 7f10eaa00640 1 -- 172.21.15.47:0/2675458344 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f10ec011260 con 0x7f10f415b380 2024-05-27T10:52:52.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.583+0000 7f10f3e00640 1 -- 172.21.15.47:0/2675458344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f10f415a9f0 con 0x7f10f415b380 2024-05-27T10:52:52.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.584+0000 7f10eaa00640 1 -- 172.21.15.47:0/2675458344 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f10ec05a8d0 con 0x7f10f415b380 2024-05-27T10:52:52.581 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-05-27T10:52:52.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.586+0000 7f10f3e00640 1 -- 172.21.15.47:0/2675458344 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f10d006c8f0 msgr2=0x7f10d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.586+0000 7f10f3e00640 1 --2- 172.21.15.47:0/2675458344 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f10d006c8f0 0x7f10d006edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f10e4000f60 tx=0x7f10e4009040 comp rx=0 tx=0).stop 2024-05-27T10:52:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.586+0000 7f10f3e00640 1 -- 172.21.15.47:0/2675458344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10f415b380 msgr2=0x7f10f4151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.586+0000 7f10f3e00640 1 --2- 172.21.15.47:0/2675458344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10f415b380 0x7f10f4151f70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f10ec007e70 tx=0x7f10ec00e4b0 comp rx=0 tx=0).stop 2024-05-27T10:52:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.587+0000 7f10f3e00640 1 -- 172.21.15.47:0/2675458344 shutdown_connections 2024-05-27T10:52:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.587+0000 7f10f3e00640 1 --2- 172.21.15.47:0/2675458344 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f10d006c8f0 0x7f10d006edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.587+0000 7f10f3e00640 1 --2- 172.21.15.47:0/2675458344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10f415b380 0x7f10f4151f70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.587+0000 7f10f3e00640 1 --2- 172.21.15.47:0/2675458344 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f10f40d0a70 0x7f10f4150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.587+0000 7f10f3e00640 1 --2- 172.21.15.47:0/2675458344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10f406ebd0 0x7f10f41461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.587+0000 7f10f3e00640 1 -- 172.21.15.47:0/2675458344 >> 172.21.15.47:0/2675458344 conn(0x7f10f406bb20 msgr2=0x7f10f40aed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.587+0000 7f10f3e00640 1 -- 172.21.15.47:0/2675458344 shutdown_connections 2024-05-27T10:52:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.587+0000 7f10f3e00640 1 -- 172.21.15.47:0/2675458344 wait complete. 2024-05-27T10:52:52.604 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:52:52.604 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:52:52.667 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:52:52.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.886+0000 7fe5de200640 1 Processor -- start 2024-05-27T10:52:52.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.887+0000 7fe5de200640 1 -- start start 2024-05-27T10:52:52.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.888+0000 7fe5de200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5d806d240 0x7fe5d806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:52.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.888+0000 7fe5de200640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe5d806ca40 0x7fe5d80d3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:52.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.888+0000 7fe5de200640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5d80cebc0 con 0x7fe5d815eaa0 2024-05-27T10:52:52.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.888+0000 7fe5de200640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe5d80cf4b0 con 0x7fe5d806ca40 2024-05-27T10:52:52.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.888+0000 7fe5de200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe5d806db60 con 0x7fe5d806d240 2024-05-27T10:52:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.889+0000 7fe5dce00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5d806d240 0x7fe5d806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.889+0000 7fe5dce00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5d806d240 0x7fe5d806d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:40514/0 (socket says 172.21.15.47:40514) 2024-05-27T10:52:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.889+0000 7fe5dce00640 1 -- 172.21.15.47:0/1979519032 learned_addr learned my addr 172.21.15.47:0/1979519032 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.889+0000 7fe5dd800640 1 --2- 172.21.15.47:0/1979519032 >> v2:172.21.15.53:3300/0 conn(0x7fe5d806ca40 0x7fe5d80d3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:52.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.890+0000 7fe5dce00640 1 -- 172.21.15.47:0/1979519032 >> v2:172.21.15.53:3300/0 conn(0x7fe5d806ca40 msgr2=0x7fe5d80d3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:52.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.890+0000 7fe5dce00640 1 --2- 172.21.15.47:0/1979519032 >> v2:172.21.15.53:3300/0 conn(0x7fe5d806ca40 0x7fe5d80d3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:52.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.890+0000 7fe5dce00640 1 -- 172.21.15.47:0/1979519032 >> v1:172.21.15.53:6789/0 conn(0x7fe5d815eaa0 legacy=0x7fe5d80cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:52.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.890+0000 7fe5dce00640 1 -- 172.21.15.47:0/1979519032 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d80cee60 con 0x7fe5d806d240 2024-05-27T10:52:52.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.891+0000 7fe5dce00640 1 --2- 172.21.15.47:0/1979519032 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5d806d240 0x7fe5d806d620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009870 tx=0x7fe5cc02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d86bc08eb2b244d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:52.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.892+0000 7fe5d7400640 1 -- 172.21.15.47:0/1979519032 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc037070 con 0x7fe5d806d240 2024-05-27T10:52:52.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.892+0000 7fe5d7400640 1 -- 172.21.15.47:0/1979519032 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5cc032440 con 0x7fe5d806d240 2024-05-27T10:52:52.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.892+0000 7fe5d7400640 1 -- 172.21.15.47:0/1979519032 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc032810 con 0x7fe5d806d240 2024-05-27T10:52:52.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.893+0000 7fe5de200640 1 -- 172.21.15.47:0/1979519032 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5d806d240 msgr2=0x7fe5d806d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:52.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.893+0000 7fe5de200640 1 --2- 172.21.15.47:0/1979519032 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5d806d240 0x7fe5d806d620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009870 tx=0x7fe5cc02a270 comp rx=0 tx=0).stop 2024-05-27T10:52:52.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.893+0000 7fe5de200640 1 -- 172.21.15.47:0/1979519032 shutdown_connections 2024-05-27T10:52:52.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.893+0000 7fe5de200640 1 --2- 172.21.15.47:0/1979519032 >> v2:172.21.15.53:3300/0 conn(0x7fe5d806ca40 0x7fe5d80d3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:52.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.893+0000 7fe5de200640 1 --2- 172.21.15.47:0/1979519032 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5d806d240 0x7fe5d806d620 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:52.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.893+0000 7fe5de200640 1 -- 172.21.15.47:0/1979519032 >> 172.21.15.47:0/1979519032 conn(0x7fe5d808bfd0 msgr2=0x7fe5d80d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:52.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.893+0000 7fe5de200640 1 -- 172.21.15.47:0/1979519032 shutdown_connections 2024-05-27T10:52:52.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.893+0000 7fe5de200640 1 -- 172.21.15.47:0/1979519032 wait complete. 2024-05-27T10:52:52.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.895+0000 7fe5de200640 1 Processor -- start 2024-05-27T10:52:52.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.895+0000 7fe5de200640 1 -- start start 2024-05-27T10:52:52.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.896+0000 7fe5de200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5d806ca40 0x7fe5d815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:52.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.896+0000 7fe5de200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5d806d240 0x7fe5d8157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:52.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.896+0000 7fe5de200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d815eaa0 0x7fe5d8159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:52.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.896+0000 7fe5de200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d80b10a0 con 0x7fe5d806d240 2024-05-27T10:52:52.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.896+0000 7fe5de200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d806cf40 con 0x7fe5d815eaa0 2024-05-27T10:52:52.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.896+0000 7fe5de200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe5d80b1220 con 0x7fe5d806ca40 2024-05-27T10:52:52.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.896+0000 7fe5d7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5d806d240 0x7fe5d8157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:52.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.896+0000 7fe5d7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5d806d240 0x7fe5d8157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44846/0 (socket says 172.21.15.47:44846) 2024-05-27T10:52:52.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.896+0000 7fe5d7e00640 1 -- 172.21.15.47:0/1404243309 learned_addr learned my addr 172.21.15.47:0/1404243309 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.897+0000 7fe5dce00640 1 --2- 172.21.15.47:0/1404243309 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5d806ca40 0x7fe5d815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.897+0000 7fe5dd800640 1 --2- 172.21.15.47:0/1404243309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d815eaa0 0x7fe5d8159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.897+0000 7fe5d7e00640 1 -- 172.21.15.47:0/1404243309 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5d806ca40 msgr2=0x7fe5d815a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.897+0000 7fe5d7e00640 1 --2- 172.21.15.47:0/1404243309 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5d806ca40 0x7fe5d815a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.897+0000 7fe5d7e00640 1 -- 172.21.15.47:0/1404243309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d815eaa0 msgr2=0x7fe5d8159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.897+0000 7fe5d7e00640 1 --2- 172.21.15.47:0/1404243309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d815eaa0 0x7fe5d8159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.897+0000 7fe5d7e00640 1 -- 172.21.15.47:0/1404243309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d815aad0 con 0x7fe5d806d240 2024-05-27T10:52:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.897+0000 7fe5d7e00640 1 --2- 172.21.15.47:0/1404243309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5d806d240 0x7fe5d8157bc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400c3a0 tx=0x7fe5c400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.897+0000 7fe5d4c00640 1 -- 172.21.15.47:0/1404243309 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4017070 con 0x7fe5d806d240 2024-05-27T10:52:52.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.897+0000 7fe5d4c00640 1 -- 172.21.15.47:0/1404243309 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c4005310 con 0x7fe5d806d240 2024-05-27T10:52:52.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.897+0000 7fe5de200640 1 -- 172.21.15.47:0/1404243309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d815adb0 con 0x7fe5d806d240 2024-05-27T10:52:52.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.897+0000 7fe5d4c00640 1 -- 172.21.15.47:0/1404243309 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c40038a0 con 0x7fe5d806d240 2024-05-27T10:52:52.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.897+0000 7fe5de200640 1 -- 172.21.15.47:0/1404243309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d815b370 con 0x7fe5d806d240 2024-05-27T10:52:52.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.899+0000 7fe5de200640 1 -- 172.21.15.47:0/1404243309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d804fce0 con 0x7fe5d806d240 2024-05-27T10:52:52.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.900+0000 7fe5d4c00640 1 -- 172.21.15.47:0/1404243309 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe5c401a070 con 0x7fe5d806d240 2024-05-27T10:52:52.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.901+0000 7fe5d4c00640 1 --2- 172.21.15.47:0/1404243309 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe5b806c970 0x7fe5b806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:52.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.901+0000 7fe5d4c00640 1 -- 172.21.15.47:0/1404243309 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fe5c408aee0 con 0x7fe5d806d240 2024-05-27T10:52:52.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.901+0000 7fe5dce00640 1 --2- 172.21.15.47:0/1404243309 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe5b806c970 0x7fe5b806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:52.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.902+0000 7fe5dce00640 1 --2- 172.21.15.47:0/1404243309 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe5b806c970 0x7fe5b806ee30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc034000 tx=0x7fe5cc02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:52.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:52.906+0000 7fe5d4c00640 1 -- 172.21.15.47:0/1404243309 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe5c40054c0 con 0x7fe5d806d240 2024-05-27T10:52:53.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.109+0000 7fe5de200640 1 -- 172.21.15.47:0/1404243309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5d815fec0 con 0x7fe5d806d240 2024-05-27T10:52:53.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.112+0000 7fe5d4c00640 1 -- 172.21.15.47:0/1404243309 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16770 (secure 0 0 0) 0x7fe5c4058c20 con 0x7fe5d806d240 2024-05-27T10:52:53.111 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:53.111 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":22,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:48.545555+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:52:53.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.115+0000 7fe5de200640 1 -- 172.21.15.47:0/1404243309 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe5b806c970 msgr2=0x7fe5b806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:53.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.115+0000 7fe5de200640 1 --2- 172.21.15.47:0/1404243309 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe5b806c970 0x7fe5b806ee30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc034000 tx=0x7fe5cc02e000 comp rx=0 tx=0).stop 2024-05-27T10:52:53.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.115+0000 7fe5de200640 1 -- 172.21.15.47:0/1404243309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5d806d240 msgr2=0x7fe5d8157bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:53.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.115+0000 7fe5de200640 1 --2- 172.21.15.47:0/1404243309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5d806d240 0x7fe5d8157bc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400c3a0 tx=0x7fe5c400c860 comp rx=0 tx=0).stop 2024-05-27T10:52:53.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.116+0000 7fe5de200640 1 -- 172.21.15.47:0/1404243309 shutdown_connections 2024-05-27T10:52:53.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.116+0000 7fe5de200640 1 --2- 172.21.15.47:0/1404243309 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe5b806c970 0x7fe5b806ee30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:53.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.116+0000 7fe5de200640 1 --2- 172.21.15.47:0/1404243309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d815eaa0 0x7fe5d8159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:53.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.116+0000 7fe5de200640 1 --2- 172.21.15.47:0/1404243309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5d806d240 0x7fe5d8157bc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:53.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.116+0000 7fe5de200640 1 --2- 172.21.15.47:0/1404243309 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5d806ca40 0x7fe5d815a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:53.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.116+0000 7fe5de200640 1 -- 172.21.15.47:0/1404243309 >> 172.21.15.47:0/1404243309 conn(0x7fe5d808bfd0 msgr2=0x7fe5d80b94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:53.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.116+0000 7fe5de200640 1 -- 172.21.15.47:0/1404243309 shutdown_connections 2024-05-27T10:52:53.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.116+0000 7fe5de200640 1 -- 172.21.15.47:0/1404243309 wait complete. 2024-05-27T10:52:53.134 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T10:51:55.073251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T10:51:59.202702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T10:52:00.664039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T10:52:53.135 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T10:52:53.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.343+0000 7faceb200640 1 Processor -- start 2024-05-27T10:52:53.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.344+0000 7faceb200640 1 -- start start 2024-05-27T10:52:53.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.345+0000 7faceb200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7facec06da80 0x7facec0d0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:53.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.345+0000 7faceb200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facec0d0c70 con 0x7facec0d0860 2024-05-27T10:52:53.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.345+0000 7faceb200640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facec0b4620 con 0x7facec15c510 2024-05-27T10:52:53.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.345+0000 7faceb200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7facec0b43e0 con 0x7facec06da80 2024-05-27T10:52:53.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.346+0000 7face3e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7facec06da80 0x7facec0d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:53.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.346+0000 7face3e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7facec06da80 0x7facec0d0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44862/0 (socket says 172.21.15.47:44862) 2024-05-27T10:52:53.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.346+0000 7face3e00640 1 -- 172.21.15.47:0/1916126348 learned_addr learned my addr 172.21.15.47:0/1916126348 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:53.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.346+0000 7facea800640 1 --1- 172.21.15.47:0/1916126348 >> v1:172.21.15.47:6789/0 conn(0x7facec0d0860 0x7facec0ce9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49138/0 (socket says 172.21.15.47:49138) 2024-05-27T10:52:53.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.346+0000 7face3e00640 1 -- 172.21.15.47:0/1916126348 >> v1:172.21.15.53:6789/0 conn(0x7facec15c510 legacy=0x7facec0b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:53.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.346+0000 7face3e00640 1 -- 172.21.15.47:0/1916126348 >> v1:172.21.15.47:6789/0 conn(0x7facec0d0860 legacy=0x7facec0ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:53.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.346+0000 7face3e00640 1 -- 172.21.15.47:0/1916126348 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec0b4900 con 0x7facec06da80 2024-05-27T10:52:53.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.347+0000 7face3e00640 1 --2- 172.21.15.47:0/1916126348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facec06da80 0x7facec0d0320 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7facd4009870 tx=0x7facd402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1103f337f0d68cb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:53.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.347+0000 7face9400640 1 -- 172.21.15.47:0/1916126348 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd4037070 con 0x7facec06da80 2024-05-27T10:52:53.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.348+0000 7face9400640 1 -- 172.21.15.47:0/1916126348 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd4032440 con 0x7facec06da80 2024-05-27T10:52:53.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.348+0000 7face9400640 1 -- 172.21.15.47:0/1916126348 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd4032810 con 0x7facec06da80 2024-05-27T10:52:53.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.348+0000 7faceb200640 1 -- 172.21.15.47:0/1916126348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facec06da80 msgr2=0x7facec0d0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:53.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.348+0000 7faceb200640 1 --2- 172.21.15.47:0/1916126348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facec06da80 0x7facec0d0320 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7facd4009870 tx=0x7facd402a2a0 comp rx=0 tx=0).stop 2024-05-27T10:52:53.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.348+0000 7faceb200640 1 -- 172.21.15.47:0/1916126348 shutdown_connections 2024-05-27T10:52:53.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.348+0000 7faceb200640 1 --2- 172.21.15.47:0/1916126348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facec06da80 0x7facec0d0320 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:53.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.348+0000 7faceb200640 1 -- 172.21.15.47:0/1916126348 >> 172.21.15.47:0/1916126348 conn(0x7facec06bb20 msgr2=0x7facec06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:53.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.348+0000 7faceb200640 1 -- 172.21.15.47:0/1916126348 shutdown_connections 2024-05-27T10:52:53.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.349+0000 7faceb200640 1 -- 172.21.15.47:0/1916126348 wait complete. 2024-05-27T10:52:53.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.350+0000 7faceb200640 1 Processor -- start 2024-05-27T10:52:53.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.350+0000 7faceb200640 1 -- start start 2024-05-27T10:52:53.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.351+0000 7faceb200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facec06da80 0x7facec1f5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:53.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.351+0000 7faceb200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facec0d0860 0x7facec157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:53.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.351+0000 7faceb200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facec15c510 0x7facec153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:53.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.351+0000 7faceb200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7facec15c8f0 con 0x7facec0d0860 2024-05-27T10:52:53.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.351+0000 7faceb200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7facec0b4ec0 con 0x7facec15c510 2024-05-27T10:52:53.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.351+0000 7faceb200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7facec0cf100 con 0x7facec06da80 2024-05-27T10:52:53.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.351+0000 7face3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facec0d0860 0x7facec157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:53.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.351+0000 7face3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facec0d0860 0x7facec157510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44874/0 (socket says 172.21.15.47:44874) 2024-05-27T10:52:53.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.351+0000 7face3e00640 1 -- 172.21.15.47:0/2079747403 learned_addr learned my addr 172.21.15.47:0/2079747403 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:53.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.352+0000 7face3e00640 1 -- 172.21.15.47:0/2079747403 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facec06da80 msgr2=0x7facec1f5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:53.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.352+0000 7face3e00640 1 --2- 172.21.15.47:0/2079747403 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facec06da80 0x7facec1f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:53.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.352+0000 7face3e00640 1 -- 172.21.15.47:0/2079747403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facec15c510 msgr2=0x7facec153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:53.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.352+0000 7face3e00640 1 --2- 172.21.15.47:0/2079747403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facec15c510 0x7facec153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:53.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.352+0000 7face3e00640 1 -- 172.21.15.47:0/2079747403 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec156790 con 0x7facec0d0860 2024-05-27T10:52:53.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.352+0000 7face3e00640 1 --2- 172.21.15.47:0/2079747403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facec0d0860 0x7facec157510 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7facd4009870 tx=0x7facd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:53.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.352+0000 7face2000640 1 -- 172.21.15.47:0/2079747403 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd4037040 con 0x7facec0d0860 2024-05-27T10:52:53.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.352+0000 7face2000640 1 -- 172.21.15.47:0/2079747403 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd4042070 con 0x7facec0d0860 2024-05-27T10:52:53.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.352+0000 7face2000640 1 -- 172.21.15.47:0/2079747403 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd4030bb0 con 0x7facec0d0860 2024-05-27T10:52:53.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.352+0000 7faceb200640 1 -- 172.21.15.47:0/2079747403 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facec154ff0 con 0x7facec0d0860 2024-05-27T10:52:53.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.353+0000 7faceb200640 1 -- 172.21.15.47:0/2079747403 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facec156a30 con 0x7facec0d0860 2024-05-27T10:52:53.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.354+0000 7faceb200640 1 -- 172.21.15.47:0/2079747403 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facec04fce0 con 0x7facec0d0860 2024-05-27T10:52:53.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.355+0000 7face2000640 1 -- 172.21.15.47:0/2079747403 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7facd4047460 con 0x7facec0d0860 2024-05-27T10:52:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.355+0000 7face2000640 1 --2- 172.21.15.47:0/2079747403 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7facc806c8f0 0x7facc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.356+0000 7face2000640 1 -- 172.21.15.47:0/2079747403 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7facd40ac870 con 0x7facec0d0860 2024-05-27T10:52:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.356+0000 7face9e00640 1 --2- 172.21.15.47:0/2079747403 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7facc806c8f0 0x7facc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:53.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.357+0000 7face9e00640 1 --2- 172.21.15.47:0/2079747403 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7facc806c8f0 0x7facc806edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7facdc006fd0 tx=0x7facdc006bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:53.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.360+0000 7face2000640 1 -- 172.21.15.47:0/2079747403 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7facd4045360 con 0x7facec0d0860 2024-05-27T10:52:53.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.553+0000 7faceb200640 1 -- 172.21.15.47:0/2079747403 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7facec0ce430 con 0x7facec0d0860 2024-05-27T10:52:53.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.554+0000 7face2000640 1 -- 172.21.15.47:0/2079747403 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7facd407ab80 con 0x7facec0d0860 2024-05-27T10:52:53.552 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-27T10:52:53.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.556+0000 7faceb200640 1 -- 172.21.15.47:0/2079747403 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7facc806c8f0 msgr2=0x7facc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:53.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.556+0000 7faceb200640 1 --2- 172.21.15.47:0/2079747403 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7facc806c8f0 0x7facc806edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7facdc006fd0 tx=0x7facdc006bc0 comp rx=0 tx=0).stop 2024-05-27T10:52:53.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.556+0000 7faceb200640 1 -- 172.21.15.47:0/2079747403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facec0d0860 msgr2=0x7facec157510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:53.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.556+0000 7faceb200640 1 --2- 172.21.15.47:0/2079747403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facec0d0860 0x7facec157510 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7facd4009870 tx=0x7facd40046c0 comp rx=0 tx=0).stop 2024-05-27T10:52:53.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.556+0000 7faceb200640 1 -- 172.21.15.47:0/2079747403 shutdown_connections 2024-05-27T10:52:53.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.556+0000 7faceb200640 1 --2- 172.21.15.47:0/2079747403 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7facc806c8f0 0x7facc806edb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:53.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.556+0000 7faceb200640 1 --2- 172.21.15.47:0/2079747403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facec15c510 0x7facec153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:53.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.556+0000 7faceb200640 1 --2- 172.21.15.47:0/2079747403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facec0d0860 0x7facec157510 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:53.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.556+0000 7faceb200640 1 --2- 172.21.15.47:0/2079747403 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facec06da80 0x7facec1f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:53.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.556+0000 7faceb200640 1 -- 172.21.15.47:0/2079747403 >> 172.21.15.47:0/2079747403 conn(0x7facec06bb20 msgr2=0x7facec160050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:53.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.556+0000 7faceb200640 1 -- 172.21.15.47:0/2079747403 shutdown_connections 2024-05-27T10:52:53.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.556+0000 7faceb200640 1 -- 172.21.15.47:0/2079747403 wait complete. 2024-05-27T10:52:53.573 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T10:52:53.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.789+0000 7f7f9a400640 1 Processor -- start 2024-05-27T10:52:53.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.790+0000 7f7f9a400640 1 -- start start 2024-05-27T10:52:53.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.791+0000 7f7f9a400640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7f940d0320 0x7f7f940d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:53.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.791+0000 7f7f9a400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7f940cef60 0x7f7f940cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:53.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.791+0000 7f7f9a400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f9406e2d0 con 0x7f7f940aeab0 2024-05-27T10:52:53.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.791+0000 7f7f9a400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f7f940aee90 con 0x7f7f940cef60 2024-05-27T10:52:53.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.791+0000 7f7f9a400640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f7f94162f50 con 0x7f7f940d0320 2024-05-27T10:52:53.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.792+0000 7f7f99a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7f940cef60 0x7f7f940cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:53.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.792+0000 7f7f99000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f7f940aeab0 0x7f7f940b4b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49144/0 (socket says 172.21.15.47:49144) 2024-05-27T10:52:53.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.792+0000 7f7f99000640 1 -- 172.21.15.47:0/881132584 learned_addr learned my addr 172.21.15.47:0/881132584 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:53.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.792+0000 7f7f93e00640 1 --2- 172.21.15.47:0/881132584 >> v2:172.21.15.53:3300/0 conn(0x7f7f940d0320 0x7f7f940d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:53.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.792+0000 7f7f99a00640 1 -- 172.21.15.47:0/881132584 >> v2:172.21.15.53:3300/0 conn(0x7f7f940d0320 msgr2=0x7f7f940d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:53.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.792+0000 7f7f99a00640 1 --2- 172.21.15.47:0/881132584 >> v2:172.21.15.53:3300/0 conn(0x7f7f940d0320 0x7f7f940d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:53.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.792+0000 7f7f99a00640 1 -- 172.21.15.47:0/881132584 >> v1:172.21.15.47:6789/0 conn(0x7f7f940aeab0 legacy=0x7f7f940b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:53.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.792+0000 7f7f99a00640 1 -- 172.21.15.47:0/881132584 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f9406e900 con 0x7f7f940cef60 2024-05-27T10:52:53.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.792+0000 7f7f93400640 1 -- 172.21.15.47:0/881132584 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1599242578 0 0) 0x7f7f9406e2d0 con 0x7f7f940aeab0 2024-05-27T10:52:53.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.793+0000 7f7f99a00640 1 --2- 172.21.15.47:0/881132584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f940cef60 0x7f7f940cf3d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7f9406dfd0 tx=0x7f7f8c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49bfccbc776e18b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:53.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.794+0000 7f7f93400640 1 -- 172.21.15.47:0/881132584 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c007740 con 0x7f7f940cef60 2024-05-27T10:52:53.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.794+0000 7f7f93400640 1 -- 172.21.15.47:0/881132584 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f8c0078e0 con 0x7f7f940cef60 2024-05-27T10:52:53.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.794+0000 7f7f93400640 1 -- 172.21.15.47:0/881132584 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c007cb0 con 0x7f7f940cef60 2024-05-27T10:52:53.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.794+0000 7f7f9a400640 1 -- 172.21.15.47:0/881132584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f940cef60 msgr2=0x7f7f940cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:53.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.794+0000 7f7f9a400640 1 --2- 172.21.15.47:0/881132584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f940cef60 0x7f7f940cf3d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7f9406dfd0 tx=0x7f7f8c02a5f0 comp rx=0 tx=0).stop 2024-05-27T10:52:53.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.794+0000 7f7f9a400640 1 -- 172.21.15.47:0/881132584 shutdown_connections 2024-05-27T10:52:53.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.794+0000 7f7f9a400640 1 --2- 172.21.15.47:0/881132584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f940cef60 0x7f7f940cf3d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:53.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.794+0000 7f7f9a400640 1 --2- 172.21.15.47:0/881132584 >> v2:172.21.15.53:3300/0 conn(0x7f7f940d0320 0x7f7f940d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:53.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.794+0000 7f7f9a400640 1 -- 172.21.15.47:0/881132584 >> 172.21.15.47:0/881132584 conn(0x7f7f9406bb20 msgr2=0x7f7f9406bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:53.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.795+0000 7f7f9a400640 1 -- 172.21.15.47:0/881132584 shutdown_connections 2024-05-27T10:52:53.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.795+0000 7f7f9a400640 1 -- 172.21.15.47:0/881132584 wait complete. 2024-05-27T10:52:53.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.796+0000 7f7f9a400640 1 Processor -- start 2024-05-27T10:52:53.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.796+0000 7f7f9a400640 1 -- start start 2024-05-27T10:52:53.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.797+0000 7f7f9a400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f940aeab0 0x7f7f9415cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:53.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.797+0000 7f7f9a400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7f940cef60 0x7f7f9415f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:53.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.797+0000 7f7f9a400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f940d0320 0x7f7f941f8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:53.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.797+0000 7f7f9a400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9406f1a0 con 0x7f7f940d0320 2024-05-27T10:52:53.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.797+0000 7f7f9a400640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9406eec0 con 0x7f7f940aeab0 2024-05-27T10:52:53.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.797+0000 7f7f9a400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f7f9406f480 con 0x7f7f940cef60 2024-05-27T10:52:53.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.798+0000 7f7f99a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f940d0320 0x7f7f941f8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:53.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.798+0000 7f7f99a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f940d0320 0x7f7f941f8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44896/0 (socket says 172.21.15.47:44896) 2024-05-27T10:52:53.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.798+0000 7f7f99a00640 1 -- 172.21.15.47:0/3213130001 learned_addr learned my addr 172.21.15.47:0/3213130001 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:53.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.798+0000 7f7f99000640 1 --2- 172.21.15.47:0/3213130001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f940aeab0 0x7f7f9415cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:53.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.798+0000 7f7f93e00640 1 --2- 172.21.15.47:0/3213130001 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7f940cef60 0x7f7f9415f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:53.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.798+0000 7f7f99a00640 1 -- 172.21.15.47:0/3213130001 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7f940cef60 msgr2=0x7f7f9415f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:53.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.798+0000 7f7f99a00640 1 --2- 172.21.15.47:0/3213130001 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7f940cef60 0x7f7f9415f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:53.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.798+0000 7f7f99a00640 1 -- 172.21.15.47:0/3213130001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f940aeab0 msgr2=0x7f7f9415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:53.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.798+0000 7f7f99a00640 1 --2- 172.21.15.47:0/3213130001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f940aeab0 0x7f7f9415cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:53.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.798+0000 7f7f99a00640 1 -- 172.21.15.47:0/3213130001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f940b0e90 con 0x7f7f940d0320 2024-05-27T10:52:53.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.798+0000 7f7f93e00640 1 --2- 172.21.15.47:0/3213130001 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7f940cef60 0x7f7f9415f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:53.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.799+0000 7f7f99a00640 1 --2- 172.21.15.47:0/3213130001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f940d0320 0x7f7f941f8730 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009e50 tx=0x7f7f8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:53.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.799+0000 7f7f90c00640 1 -- 172.21.15.47:0/3213130001 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c040070 con 0x7f7f940d0320 2024-05-27T10:52:53.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.799+0000 7f7f90c00640 1 -- 172.21.15.47:0/3213130001 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f8c031bf0 con 0x7f7f940d0320 2024-05-27T10:52:53.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.799+0000 7f7f9a400640 1 -- 172.21.15.47:0/3213130001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f940b1170 con 0x7f7f940d0320 2024-05-27T10:52:53.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.799+0000 7f7f90c00640 1 -- 172.21.15.47:0/3213130001 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c045460 con 0x7f7f940d0320 2024-05-27T10:52:53.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.799+0000 7f7f9a400640 1 -- 172.21.15.47:0/3213130001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f940b1730 con 0x7f7f940d0320 2024-05-27T10:52:53.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.800+0000 7f7f9a400640 1 -- 172.21.15.47:0/3213130001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f940b1930 con 0x7f7f940d0320 2024-05-27T10:52:53.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.801+0000 7f7f90c00640 1 -- 172.21.15.47:0/3213130001 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7f8c039040 con 0x7f7f940d0320 2024-05-27T10:52:53.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.802+0000 7f7f90c00640 1 --2- 172.21.15.47:0/3213130001 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7f7406c8f0 0x7f7f7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:53.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.802+0000 7f7f90c00640 1 -- 172.21.15.47:0/3213130001 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f7f8c0ad570 con 0x7f7f940d0320 2024-05-27T10:52:53.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.803+0000 7f7f99000640 1 --2- 172.21.15.47:0/3213130001 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7f7406c8f0 0x7f7f7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:53.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.803+0000 7f7f99000640 1 --2- 172.21.15.47:0/3213130001 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7f7406c8f0 0x7f7f7406edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7f88000f60 tx=0x7f7f88009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:53.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:53.807+0000 7f7f90c00640 1 -- 172.21.15.47:0/3213130001 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7f940b1930 con 0x7f7f940d0320 2024-05-27T10:52:54.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.002+0000 7f7f9a400640 1 -- 172.21.15.47:0/3213130001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7f9404fce0 con 0x7f7f940d0320 2024-05-27T10:52:54.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.002+0000 7f7f90c00640 1 -- 172.21.15.47:0/3213130001 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f7f8c07b9a0 con 0x7f7f940d0320 2024-05-27T10:52:54.000 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-27T10:52:54.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.005+0000 7f7f9a400640 1 -- 172.21.15.47:0/3213130001 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7f7406c8f0 msgr2=0x7f7f7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:54.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.005+0000 7f7f9a400640 1 --2- 172.21.15.47:0/3213130001 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7f7406c8f0 0x7f7f7406edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7f88000f60 tx=0x7f7f88009040 comp rx=0 tx=0).stop 2024-05-27T10:52:54.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.005+0000 7f7f9a400640 1 -- 172.21.15.47:0/3213130001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f940d0320 msgr2=0x7f7f941f8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:54.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.005+0000 7f7f9a400640 1 --2- 172.21.15.47:0/3213130001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f940d0320 0x7f7f941f8730 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009e50 tx=0x7f7f8c004a40 comp rx=0 tx=0).stop 2024-05-27T10:52:54.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.006+0000 7f7f9a400640 1 -- 172.21.15.47:0/3213130001 shutdown_connections 2024-05-27T10:52:54.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.006+0000 7f7f9a400640 1 --2- 172.21.15.47:0/3213130001 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7f7406c8f0 0x7f7f7406edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.006+0000 7f7f9a400640 1 --2- 172.21.15.47:0/3213130001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f940d0320 0x7f7f941f8730 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.006+0000 7f7f9a400640 1 --2- 172.21.15.47:0/3213130001 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7f940cef60 0x7f7f9415f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.006+0000 7f7f9a400640 1 --2- 172.21.15.47:0/3213130001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f940aeab0 0x7f7f9415cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.006+0000 7f7f9a400640 1 -- 172.21.15.47:0/3213130001 >> 172.21.15.47:0/3213130001 conn(0x7f7f9406bb20 msgr2=0x7f7f94165870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:54.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.006+0000 7f7f9a400640 1 -- 172.21.15.47:0/3213130001 shutdown_connections 2024-05-27T10:52:54.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.006+0000 7f7f9a400640 1 -- 172.21.15.47:0/3213130001 wait complete. 2024-05-27T10:52:54.022 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T10:52:54.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.226+0000 7f8cc6800640 1 Processor -- start 2024-05-27T10:52:54.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.226+0000 7f8cc6800640 1 -- start start 2024-05-27T10:52:54.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.228+0000 7f8cc6800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8cc00b5f70 0x7f8cc00b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:54.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.228+0000 7f8cc6800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cc00ceb40 0x7f8cc00cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:54.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.228+0000 7f8cc6800640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cc015eb50 con 0x7f8cc015e770 2024-05-27T10:52:54.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.228+0000 7f8cc6800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f8cc00b6910 con 0x7f8cc00b5f70 2024-05-27T10:52:54.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.228+0000 7f8cc6800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8cc006cba0 con 0x7f8cc00ceb40 2024-05-27T10:52:54.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.228+0000 7f8cc4a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8cc00b5f70 0x7f8cc00b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:54.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.228+0000 7f8cc4a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8cc00b5f70 0x7f8cc00b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44898/0 (socket says 172.21.15.47:44898) 2024-05-27T10:52:54.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.228+0000 7f8cc4a00640 1 -- 172.21.15.47:0/2218589736 learned_addr learned my addr 172.21.15.47:0/2218589736 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:54.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.229+0000 7f8cc5e00640 1 --2- 172.21.15.47:0/2218589736 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cc00ceb40 0x7f8cc00cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:54.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.229+0000 7f8cc4a00640 1 -- 172.21.15.47:0/2218589736 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cc00ceb40 msgr2=0x7f8cc00cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:54.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.229+0000 7f8cc4a00640 1 --2- 172.21.15.47:0/2218589736 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cc00ceb40 0x7f8cc00cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.229+0000 7f8cc4a00640 1 -- 172.21.15.47:0/2218589736 >> v1:172.21.15.53:6789/0 conn(0x7f8cc015e770 legacy=0x7f8cc00d31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:54.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.229+0000 7f8cc4a00640 1 -- 172.21.15.47:0/2218589736 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc006ce80 con 0x7f8cc00b5f70 2024-05-27T10:52:54.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.230+0000 7f8cc4a00640 1 --2- 172.21.15.47:0/2218589736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cc00b5f70 0x7f8cc00b63d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009870 tx=0x7f8cac02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4994aadd5869ccf4 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:54.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.230+0000 7f8cbfe00640 1 -- 172.21.15.47:0/2218589736 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac037070 con 0x7f8cc00b5f70 2024-05-27T10:52:54.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.230+0000 7f8cbfe00640 1 -- 172.21.15.47:0/2218589736 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cac032440 con 0x7f8cc00b5f70 2024-05-27T10:52:54.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.230+0000 7f8cbfe00640 1 -- 172.21.15.47:0/2218589736 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac032810 con 0x7f8cc00b5f70 2024-05-27T10:52:54.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.231+0000 7f8cc6800640 1 -- 172.21.15.47:0/2218589736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cc00b5f70 msgr2=0x7f8cc00b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:54.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.231+0000 7f8cc6800640 1 --2- 172.21.15.47:0/2218589736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cc00b5f70 0x7f8cc00b63d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009870 tx=0x7f8cac02a180 comp rx=0 tx=0).stop 2024-05-27T10:52:54.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.231+0000 7f8cc6800640 1 -- 172.21.15.47:0/2218589736 shutdown_connections 2024-05-27T10:52:54.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.231+0000 7f8cc6800640 1 --2- 172.21.15.47:0/2218589736 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cc00ceb40 0x7f8cc00cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.231+0000 7f8cc6800640 1 --2- 172.21.15.47:0/2218589736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cc00b5f70 0x7f8cc00b63d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.231+0000 7f8cc6800640 1 -- 172.21.15.47:0/2218589736 >> 172.21.15.47:0/2218589736 conn(0x7f8cc008bfd0 msgr2=0x7f8cc00d44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:54.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.231+0000 7f8cc6800640 1 -- 172.21.15.47:0/2218589736 shutdown_connections 2024-05-27T10:52:54.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.231+0000 7f8cc6800640 1 -- 172.21.15.47:0/2218589736 wait complete. 2024-05-27T10:52:54.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.233+0000 7f8cc6800640 1 Processor -- start 2024-05-27T10:52:54.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.233+0000 7f8cc6800640 1 -- start start 2024-05-27T10:52:54.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.234+0000 7f8cc6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cc00b5f70 0x7f8cc00b9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:54.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.234+0000 7f8cc6800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cc00ceb40 0x7f8cc00b9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:54.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.234+0000 7f8cc6800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cc015e770 0x7f8cc00c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:54.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.234+0000 7f8cc6800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc006c830 con 0x7f8cc00b5f70 2024-05-27T10:52:54.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.234+0000 7f8cc6800640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc006d440 con 0x7f8cc015e770 2024-05-27T10:52:54.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.234+0000 7f8cc6800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8cc00d38e0 con 0x7f8cc00ceb40 2024-05-27T10:52:54.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.234+0000 7f8cc5400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cc00b5f70 0x7f8cc00b9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:54.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.234+0000 7f8cc5400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cc00b5f70 0x7f8cc00b9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44914/0 (socket says 172.21.15.47:44914) 2024-05-27T10:52:54.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.234+0000 7f8cc5400640 1 -- 172.21.15.47:0/3735062959 learned_addr learned my addr 172.21.15.47:0/3735062959 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:54.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.235+0000 7f8cc4a00640 1 --2- 172.21.15.47:0/3735062959 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cc00ceb40 0x7f8cc00b9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:54.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.235+0000 7f8cc5400640 1 -- 172.21.15.47:0/3735062959 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cc00ceb40 msgr2=0x7f8cc00b9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:54.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.235+0000 7f8cc5400640 1 --2- 172.21.15.47:0/3735062959 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cc00ceb40 0x7f8cc00b9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.235+0000 7f8cc5400640 1 -- 172.21.15.47:0/3735062959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cc015e770 msgr2=0x7f8cc00c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:54.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.235+0000 7f8cc5e00640 1 --2- 172.21.15.47:0/3735062959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cc015e770 0x7f8cc00c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:54.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.235+0000 7f8cc5400640 1 --2- 172.21.15.47:0/3735062959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cc015e770 0x7f8cc00c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.235+0000 7f8cc5400640 1 -- 172.21.15.47:0/3735062959 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc00c8660 con 0x7f8cc00b5f70 2024-05-27T10:52:54.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.235+0000 7f8cc4a00640 1 --2- 172.21.15.47:0/3735062959 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cc00ceb40 0x7f8cc00b9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:54.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.235+0000 7f8cc5400640 1 --2- 172.21.15.47:0/3735062959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cc00b5f70 0x7f8cc00b9690 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8cb400c430 tx=0x7f8cb400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:54.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.235+0000 7f8cbd600640 1 -- 172.21.15.47:0/3735062959 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4011790 con 0x7f8cc00b5f70 2024-05-27T10:52:54.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.235+0000 7f8cbd600640 1 -- 172.21.15.47:0/3735062959 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cb4017070 con 0x7f8cc00b5f70 2024-05-27T10:52:54.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.235+0000 7f8cbd600640 1 -- 172.21.15.47:0/3735062959 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4011bb0 con 0x7f8cc00b5f70 2024-05-27T10:52:54.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.235+0000 7f8cc6800640 1 -- 172.21.15.47:0/3735062959 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cc00c8940 con 0x7f8cc00b5f70 2024-05-27T10:52:54.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.236+0000 7f8cc6800640 1 -- 172.21.15.47:0/3735062959 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cc00c8f00 con 0x7f8cc00b5f70 2024-05-27T10:52:54.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.237+0000 7f8cc6800640 1 -- 172.21.15.47:0/3735062959 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cc008c3b0 con 0x7f8cc00b5f70 2024-05-27T10:52:54.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.238+0000 7f8cbd600640 1 -- 172.21.15.47:0/3735062959 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8cb401c460 con 0x7f8cc00b5f70 2024-05-27T10:52:54.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.239+0000 7f8cbd600640 1 --2- 172.21.15.47:0/3735062959 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f8ca006c920 0x7f8ca006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:54.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.239+0000 7f8cbd600640 1 -- 172.21.15.47:0/3735062959 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f8cb408ba10 con 0x7f8cc00b5f70 2024-05-27T10:52:54.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.239+0000 7f8cc4a00640 1 --2- 172.21.15.47:0/3735062959 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f8ca006c920 0x7f8ca006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:54.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.240+0000 7f8cc4a00640 1 --2- 172.21.15.47:0/3735062959 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f8ca006c920 0x7f8ca006ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8cac034000 tx=0x7f8cac02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:54.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.244+0000 7f8cbd600640 1 -- 172.21.15.47:0/3735062959 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8cc008c3b0 con 0x7f8cc00b5f70 2024-05-27T10:52:54.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.450+0000 7f8cc6800640 1 -- 172.21.15.47:0/3735062959 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8cc004fce0 con 0x7f8cc00b5f70 2024-05-27T10:52:54.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.451+0000 7f8cbd600640 1 -- 172.21.15.47:0/3735062959 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f8cb4059db0 con 0x7f8cc00b5f70 2024-05-27T10:52:54.449 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-27T10:52:54.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.453+0000 7f8cc6800640 1 -- 172.21.15.47:0/3735062959 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f8ca006c920 msgr2=0x7f8ca006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:54.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.453+0000 7f8cc6800640 1 --2- 172.21.15.47:0/3735062959 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f8ca006c920 0x7f8ca006ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8cac034000 tx=0x7f8cac02e000 comp rx=0 tx=0).stop 2024-05-27T10:52:54.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.453+0000 7f8cc6800640 1 -- 172.21.15.47:0/3735062959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cc00b5f70 msgr2=0x7f8cc00b9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:54.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.453+0000 7f8cc6800640 1 --2- 172.21.15.47:0/3735062959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cc00b5f70 0x7f8cc00b9690 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8cb400c430 tx=0x7f8cb400c8f0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.454+0000 7f8cc6800640 1 -- 172.21.15.47:0/3735062959 shutdown_connections 2024-05-27T10:52:54.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.454+0000 7f8cc6800640 1 --2- 172.21.15.47:0/3735062959 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f8ca006c920 0x7f8ca006ede0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.454+0000 7f8cc6800640 1 --2- 172.21.15.47:0/3735062959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cc015e770 0x7f8cc00c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.454+0000 7f8cc6800640 1 --2- 172.21.15.47:0/3735062959 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cc00ceb40 0x7f8cc00b9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.454+0000 7f8cc6800640 1 --2- 172.21.15.47:0/3735062959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cc00b5f70 0x7f8cc00b9690 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.454+0000 7f8cc6800640 1 -- 172.21.15.47:0/3735062959 >> 172.21.15.47:0/3735062959 conn(0x7f8cc008bfd0 msgr2=0x7f8cc0157a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:54.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.454+0000 7f8cc6800640 1 -- 172.21.15.47:0/3735062959 shutdown_connections 2024-05-27T10:52:54.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.454+0000 7f8cc6800640 1 -- 172.21.15.47:0/3735062959 wait complete. 2024-05-27T10:52:54.470 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T10:52:54.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.682+0000 7fb00f200640 1 Processor -- start 2024-05-27T10:52:54.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.682+0000 7fb00f200640 1 -- start start 2024-05-27T10:52:54.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.683+0000 7fb00f200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb01015b380 0x7fb0100d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:54.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.683+0000 7fb00f200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb0100d08a0 0x7fb01006e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:54.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.683+0000 7fb00f200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb01006f3a0 con 0x7fb01006ebd0 2024-05-27T10:52:54.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.683+0000 7fb00f200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb0100adcc0 con 0x7fb01015b380 2024-05-27T10:52:54.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.683+0000 7fb00f200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb01006ff20 con 0x7fb0100d08a0 2024-05-27T10:52:54.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.684+0000 7fb00de00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb01015b380 0x7fb0100d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:54.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.684+0000 7fb00e800640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb01006ebd0 0x7fb0100b43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49154/0 (socket says 172.21.15.47:49154) 2024-05-27T10:52:54.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.684+0000 7fb00e800640 1 -- 172.21.15.47:0/3066446498 learned_addr learned my addr 172.21.15.47:0/3066446498 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:54.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.684+0000 7fb00d400640 1 --2- 172.21.15.47:0/3066446498 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb0100d08a0 0x7fb01006e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:54.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.684+0000 7fb00de00640 1 -- 172.21.15.47:0/3066446498 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb0100d08a0 msgr2=0x7fb01006e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:54.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.684+0000 7fb00de00640 1 --2- 172.21.15.47:0/3066446498 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb0100d08a0 0x7fb01006e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.684+0000 7fb00de00640 1 -- 172.21.15.47:0/3066446498 >> v1:172.21.15.47:6789/0 conn(0x7fb01006ebd0 legacy=0x7fb0100b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:54.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.684+0000 7fb00de00640 1 -- 172.21.15.47:0/3066446498 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01006f680 con 0x7fb01015b380 2024-05-27T10:52:54.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.684+0000 7fb00ca00640 1 -- 172.21.15.47:0/3066446498 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3298833612 0 0) 0x7fb01006f3a0 con 0x7fb01006ebd0 2024-05-27T10:52:54.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.685+0000 7fb00de00640 1 --2- 172.21.15.47:0/3066446498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb01015b380 0x7fb0100d0360 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb0000097a0 tx=0x7fb00002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4a46c2a5b10aac server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:54.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.686+0000 7fb00ca00640 1 -- 172.21.15.47:0/3066446498 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb000037070 con 0x7fb01015b380 2024-05-27T10:52:54.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.686+0000 7fb00ca00640 1 -- 172.21.15.47:0/3066446498 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb00002ae50 con 0x7fb01015b380 2024-05-27T10:52:54.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.686+0000 7fb00ca00640 1 -- 172.21.15.47:0/3066446498 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb000032660 con 0x7fb01015b380 2024-05-27T10:52:54.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.686+0000 7fb00f200640 1 -- 172.21.15.47:0/3066446498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb01015b380 msgr2=0x7fb0100d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:54.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.686+0000 7fb00f200640 1 --2- 172.21.15.47:0/3066446498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb01015b380 0x7fb0100d0360 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb0000097a0 tx=0x7fb00002a100 comp rx=0 tx=0).stop 2024-05-27T10:52:54.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.686+0000 7fb00f200640 1 -- 172.21.15.47:0/3066446498 shutdown_connections 2024-05-27T10:52:54.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.686+0000 7fb00f200640 1 --2- 172.21.15.47:0/3066446498 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb0100d08a0 0x7fb01006e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.686+0000 7fb00f200640 1 --2- 172.21.15.47:0/3066446498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb01015b380 0x7fb0100d0360 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.686+0000 7fb00f200640 1 -- 172.21.15.47:0/3066446498 >> 172.21.15.47:0/3066446498 conn(0x7fb01006bb20 msgr2=0x7fb01006bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:54.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.687+0000 7fb00f200640 1 -- 172.21.15.47:0/3066446498 shutdown_connections 2024-05-27T10:52:54.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.687+0000 7fb00f200640 1 -- 172.21.15.47:0/3066446498 wait complete. 2024-05-27T10:52:54.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.688+0000 7fb00f200640 1 Processor -- start 2024-05-27T10:52:54.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.688+0000 7fb00f200640 1 -- start start 2024-05-27T10:52:54.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.689+0000 7fb00f200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb01006ebd0 0x7fb010145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:54.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.689+0000 7fb00f200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0100d08a0 0x7fb01009d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:54.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.689+0000 7fb00f200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb01015b380 0x7fb0101541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:54.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.689+0000 7fb00f200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb01006fc40 con 0x7fb0100d08a0 2024-05-27T10:52:54.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.689+0000 7fb00f200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb0100d0ce0 con 0x7fb01015b380 2024-05-27T10:52:54.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.689+0000 7fb00f200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb01006f020 con 0x7fb01006ebd0 2024-05-27T10:52:54.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.690+0000 7fb00d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0100d08a0 0x7fb01009d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:54.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.690+0000 7fb00d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0100d08a0 0x7fb01009d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44940/0 (socket says 172.21.15.47:44940) 2024-05-27T10:52:54.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.690+0000 7fb00d400640 1 -- 172.21.15.47:0/3612733708 learned_addr learned my addr 172.21.15.47:0/3612733708 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:54.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.690+0000 7fb00de00640 1 --2- 172.21.15.47:0/3612733708 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb01006ebd0 0x7fb010145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:54.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.690+0000 7fb00e800640 1 --2- 172.21.15.47:0/3612733708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb01015b380 0x7fb0101541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:54.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.690+0000 7fb00d400640 1 -- 172.21.15.47:0/3612733708 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb01006ebd0 msgr2=0x7fb010145d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:54.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.690+0000 7fb00d400640 1 --2- 172.21.15.47:0/3612733708 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb01006ebd0 0x7fb010145d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.690+0000 7fb00d400640 1 -- 172.21.15.47:0/3612733708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb01015b380 msgr2=0x7fb0101541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.690+0000 7fb00d400640 1 --2- 172.21.15.47:0/3612733708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb01015b380 0x7fb0101541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.690+0000 7fb00d400640 1 -- 172.21.15.47:0/3612733708 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0101462d0 con 0x7fb0100d08a0 2024-05-27T10:52:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.690+0000 7fb00e800640 1 --2- 172.21.15.47:0/3612733708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb01015b380 0x7fb0101541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.691+0000 7fb00d400640 1 --2- 172.21.15.47:0/3612733708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0100d08a0 0x7fb01009d6c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7faff800d800 tx=0x7faff800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.691+0000 7fb006000640 1 -- 172.21.15.47:0/3612733708 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff800b6c0 con 0x7fb0100d08a0 2024-05-27T10:52:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.691+0000 7fb006000640 1 -- 172.21.15.47:0/3612733708 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff8019070 con 0x7fb0100d08a0 2024-05-27T10:52:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.691+0000 7fb006000640 1 -- 172.21.15.47:0/3612733708 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff800ba80 con 0x7fb0100d08a0 2024-05-27T10:52:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.691+0000 7fb00f200640 1 -- 172.21.15.47:0/3612733708 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0100b0bb0 con 0x7fb0100d08a0 2024-05-27T10:52:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.691+0000 7fb00f200640 1 -- 172.21.15.47:0/3612733708 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0100b1450 con 0x7fb0100d08a0 2024-05-27T10:52:54.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.692+0000 7fb00f200640 1 -- 172.21.15.47:0/3612733708 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0100b0fa0 con 0x7fb0100d08a0 2024-05-27T10:52:54.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.693+0000 7fb006000640 1 -- 172.21.15.47:0/3612733708 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faff800bc20 con 0x7fb0100d08a0 2024-05-27T10:52:54.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.694+0000 7fb006000640 1 --2- 172.21.15.47:0/3612733708 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fafec06c8f0 0x7fafec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:54.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.694+0000 7fb006000640 1 -- 172.21.15.47:0/3612733708 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7faff808c150 con 0x7fb0100d08a0 2024-05-27T10:52:54.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.694+0000 7fb00de00640 1 --2- 172.21.15.47:0/3612733708 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fafec06c8f0 0x7fafec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:54.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.695+0000 7fb00de00640 1 --2- 172.21.15.47:0/3612733708 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fafec06c8f0 0x7fafec06edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb000034000 tx=0x7fb00002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.699+0000 7fb006000640 1 -- 172.21.15.47:0/3612733708 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faff801c360 con 0x7fb0100d08a0 2024-05-27T10:52:54.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.917+0000 7fb00f200640 1 -- 172.21.15.47:0/3612733708 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb01004fce0 con 0x7fb0100d08a0 2024-05-27T10:52:54.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.918+0000 7fb006000640 1 -- 172.21.15.47:0/3612733708 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7faff805a470 con 0x7fb0100d08a0 2024-05-27T10:52:54.916 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-05-27T10:52:54.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.920+0000 7fb00f200640 1 -- 172.21.15.47:0/3612733708 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fafec06c8f0 msgr2=0x7fafec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:54.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.920+0000 7fb00f200640 1 --2- 172.21.15.47:0/3612733708 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fafec06c8f0 0x7fafec06edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb000034000 tx=0x7fb00002e000 comp rx=0 tx=0).stop 2024-05-27T10:52:54.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.920+0000 7fb00f200640 1 -- 172.21.15.47:0/3612733708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0100d08a0 msgr2=0x7fb01009d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:54.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.920+0000 7fb00f200640 1 --2- 172.21.15.47:0/3612733708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0100d08a0 0x7fb01009d6c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7faff800d800 tx=0x7faff800dcc0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.921+0000 7fb00f200640 1 -- 172.21.15.47:0/3612733708 shutdown_connections 2024-05-27T10:52:54.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.921+0000 7fb00f200640 1 --2- 172.21.15.47:0/3612733708 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fafec06c8f0 0x7fafec06edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.921+0000 7fb00f200640 1 --2- 172.21.15.47:0/3612733708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb01015b380 0x7fb0101541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.921+0000 7fb00f200640 1 --2- 172.21.15.47:0/3612733708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0100d08a0 0x7fb01009d6c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.921+0000 7fb00f200640 1 --2- 172.21.15.47:0/3612733708 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb01006ebd0 0x7fb010145d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:54.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.921+0000 7fb00f200640 1 -- 172.21.15.47:0/3612733708 >> 172.21.15.47:0/3612733708 conn(0x7fb01006bb20 msgr2=0x7fb0100afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:54.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.921+0000 7fb00f200640 1 -- 172.21.15.47:0/3612733708 shutdown_connections 2024-05-27T10:52:54.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:54.921+0000 7fb00f200640 1 -- 172.21.15.47:0/3612733708 wait complete. 2024-05-27T10:52:54.937 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2024-05-27T10:52:54.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:54.937 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-05-27T10:52:55.031 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T10:52:55.031 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-05-27T10:52:55.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:55.031 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-27T10:52:55.103 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:52:55.103 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:52:55.164 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:52:55.164 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:52:55.219 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:52:55.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.430+0000 7fe70de00640 1 Processor -- start 2024-05-27T10:52:55.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.431+0000 7fe70de00640 1 -- start start 2024-05-27T10:52:55.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.432+0000 7fe70de00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe70806d240 0x7fe70806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:55.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.432+0000 7fe70de00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe70815eaa0 0x7fe7080cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:55.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.432+0000 7fe70de00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7080cebc0 con 0x7fe70806ca40 2024-05-27T10:52:55.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.432+0000 7fe70de00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe7080cf4b0 con 0x7fe70806d240 2024-05-27T10:52:55.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.432+0000 7fe70de00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe70806db60 con 0x7fe70815eaa0 2024-05-27T10:52:55.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.432+0000 7fe70ca00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe70806d240 0x7fe70806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:55.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.433+0000 7fe70ca00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe70806d240 0x7fe70806d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44954/0 (socket says 172.21.15.47:44954) 2024-05-27T10:52:55.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.433+0000 7fe70ca00640 1 -- 172.21.15.47:0/2009756395 learned_addr learned my addr 172.21.15.47:0/2009756395 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:55.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.433+0000 7fe70ca00640 1 -- 172.21.15.47:0/2009756395 >> v2:172.21.15.53:3300/0 conn(0x7fe70815eaa0 msgr2=0x7fe7080cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:55.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.433+0000 7fe70ca00640 1 --2- 172.21.15.47:0/2009756395 >> v2:172.21.15.53:3300/0 conn(0x7fe70815eaa0 0x7fe7080cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:55.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.433+0000 7fe70ca00640 1 -- 172.21.15.47:0/2009756395 >> v1:172.21.15.53:6789/0 conn(0x7fe70806ca40 legacy=0x7fe7080cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:55.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.433+0000 7fe70ca00640 1 -- 172.21.15.47:0/2009756395 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7080cee60 con 0x7fe70806d240 2024-05-27T10:52:55.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.434+0000 7fe70ca00640 1 --2- 172.21.15.47:0/2009756395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe70806d240 0x7fe70806d620 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe7080c7e00 tx=0x7fe6fc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b37322ddca3d1ee server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:55.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.434+0000 7fe707400640 1 -- 172.21.15.47:0/2009756395 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc037070 con 0x7fe70806d240 2024-05-27T10:52:55.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.434+0000 7fe707400640 1 -- 172.21.15.47:0/2009756395 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6fc032440 con 0x7fe70806d240 2024-05-27T10:52:55.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.435+0000 7fe707400640 1 -- 172.21.15.47:0/2009756395 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc032810 con 0x7fe70806d240 2024-05-27T10:52:55.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.435+0000 7fe70de00640 1 -- 172.21.15.47:0/2009756395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe70806d240 msgr2=0x7fe70806d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:55.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.435+0000 7fe70de00640 1 --2- 172.21.15.47:0/2009756395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe70806d240 0x7fe70806d620 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe7080c7e00 tx=0x7fe6fc02a230 comp rx=0 tx=0).stop 2024-05-27T10:52:55.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.435+0000 7fe70de00640 1 -- 172.21.15.47:0/2009756395 shutdown_connections 2024-05-27T10:52:55.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.435+0000 7fe70de00640 1 --2- 172.21.15.47:0/2009756395 >> v2:172.21.15.53:3300/0 conn(0x7fe70815eaa0 0x7fe7080cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:55.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.435+0000 7fe70de00640 1 --2- 172.21.15.47:0/2009756395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe70806d240 0x7fe70806d620 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:55.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.435+0000 7fe70de00640 1 -- 172.21.15.47:0/2009756395 >> 172.21.15.47:0/2009756395 conn(0x7fe70808bfd0 msgr2=0x7fe7080d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:55.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.436+0000 7fe70de00640 1 -- 172.21.15.47:0/2009756395 shutdown_connections 2024-05-27T10:52:55.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.436+0000 7fe70de00640 1 -- 172.21.15.47:0/2009756395 wait complete. 2024-05-27T10:52:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.438+0000 7fe70de00640 1 Processor -- start 2024-05-27T10:52:55.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.438+0000 7fe70de00640 1 -- start start 2024-05-27T10:52:55.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.439+0000 7fe70de00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe70806ca40 0x7fe7080cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:55.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.439+0000 7fe70de00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe70806d240 0x7fe7080ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:55.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.440+0000 7fe70de00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe70815eaa0 0x7fe7081492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:55.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.440+0000 7fe70de00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe7080b10a0 con 0x7fe70815eaa0 2024-05-27T10:52:55.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.440+0000 7fe70de00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe70806cf40 con 0x7fe70806d240 2024-05-27T10:52:55.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.440+0000 7fe70de00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe7080b1220 con 0x7fe70806ca40 2024-05-27T10:52:55.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.440+0000 7fe70d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe70815eaa0 0x7fe7081492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:55.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.440+0000 7fe70d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe70815eaa0 0x7fe7081492e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44960/0 (socket says 172.21.15.47:44960) 2024-05-27T10:52:55.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.440+0000 7fe70d400640 1 -- 172.21.15.47:0/3911534623 learned_addr learned my addr 172.21.15.47:0/3911534623 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:55.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.440+0000 7fe70ca00640 1 --2- 172.21.15.47:0/3911534623 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe70806ca40 0x7fe7080cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:55.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.440+0000 7fe707e00640 1 --2- 172.21.15.47:0/3911534623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe70806d240 0x7fe7080ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:55.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.440+0000 7fe70d400640 1 -- 172.21.15.47:0/3911534623 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe70806ca40 msgr2=0x7fe7080cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:55.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.440+0000 7fe70d400640 1 --2- 172.21.15.47:0/3911534623 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe70806ca40 0x7fe7080cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:55.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.440+0000 7fe70d400640 1 -- 172.21.15.47:0/3911534623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe70806d240 msgr2=0x7fe7080ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:55.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.440+0000 7fe70d400640 1 --2- 172.21.15.47:0/3911534623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe70806d240 0x7fe7080ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:55.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.440+0000 7fe70d400640 1 -- 172.21.15.47:0/3911534623 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7081f4340 con 0x7fe70815eaa0 2024-05-27T10:52:55.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.440+0000 7fe70ca00640 1 --2- 172.21.15.47:0/3911534623 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe70806ca40 0x7fe7080cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:52:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.441+0000 7fe70d400640 1 --2- 172.21.15.47:0/3911534623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe70815eaa0 0x7fe7081492e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe70000b9e0 tx=0x7fe70000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.441+0000 7fe704c00640 1 -- 172.21.15.47:0/3911534623 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe700019070 con 0x7fe70815eaa0 2024-05-27T10:52:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.441+0000 7fe704c00640 1 -- 172.21.15.47:0/3911534623 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe70000cb20 con 0x7fe70815eaa0 2024-05-27T10:52:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.441+0000 7fe704c00640 1 -- 172.21.15.47:0/3911534623 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe700014440 con 0x7fe70815eaa0 2024-05-27T10:52:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.441+0000 7fe70de00640 1 -- 172.21.15.47:0/3911534623 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7080cbc60 con 0x7fe70815eaa0 2024-05-27T10:52:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.441+0000 7fe70de00640 1 -- 172.21.15.47:0/3911534623 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7080cd920 con 0x7fe70815eaa0 2024-05-27T10:52:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.443+0000 7fe70de00640 1 -- 172.21.15.47:0/3911534623 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe70804fce0 con 0x7fe70815eaa0 2024-05-27T10:52:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.443+0000 7fe704c00640 1 -- 172.21.15.47:0/3911534623 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe70001c070 con 0x7fe70815eaa0 2024-05-27T10:52:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.444+0000 7fe704c00640 1 --2- 172.21.15.47:0/3911534623 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe6e806c8f0 0x7fe6e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.444+0000 7fe704c00640 1 -- 172.21.15.47:0/3911534623 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fe70008b9e0 con 0x7fe70815eaa0 2024-05-27T10:52:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.445+0000 7fe70ca00640 1 --2- 172.21.15.47:0/3911534623 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe6e806c8f0 0x7fe6e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.445+0000 7fe70ca00640 1 --2- 172.21.15.47:0/3911534623 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe6e806c8f0 0x7fe6e806edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc034000 tx=0x7fe6fc02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:55.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.449+0000 7fe704c00640 1 -- 172.21.15.47:0/3911534623 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe700059cf0 con 0x7fe70815eaa0 2024-05-27T10:52:55.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.656+0000 7fe70de00640 1 -- 172.21.15.47:0/3911534623 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7080d0650 con 0x7fe70815eaa0 2024-05-27T10:52:55.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.658+0000 7fe704c00640 1 -- 172.21.15.47:0/3911534623 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16770 (secure 0 0 0) 0x7fe7000595f0 con 0x7fe70815eaa0 2024-05-27T10:52:55.657 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:55.657 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":22,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:48.545555+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:52:55.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.661+0000 7fe70de00640 1 -- 172.21.15.47:0/3911534623 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe6e806c8f0 msgr2=0x7fe6e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:55.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.661+0000 7fe70de00640 1 --2- 172.21.15.47:0/3911534623 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe6e806c8f0 0x7fe6e806edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc034000 tx=0x7fe6fc02e000 comp rx=0 tx=0).stop 2024-05-27T10:52:55.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.661+0000 7fe70de00640 1 -- 172.21.15.47:0/3911534623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe70815eaa0 msgr2=0x7fe7081492e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:55.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.661+0000 7fe70de00640 1 --2- 172.21.15.47:0/3911534623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe70815eaa0 0x7fe7081492e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe70000b9e0 tx=0x7fe70000bea0 comp rx=0 tx=0).stop 2024-05-27T10:52:55.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.661+0000 7fe70de00640 1 -- 172.21.15.47:0/3911534623 shutdown_connections 2024-05-27T10:52:55.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.661+0000 7fe70de00640 1 --2- 172.21.15.47:0/3911534623 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe6e806c8f0 0x7fe6e806edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:55.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.661+0000 7fe70de00640 1 --2- 172.21.15.47:0/3911534623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe70815eaa0 0x7fe7081492e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:55.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.661+0000 7fe70de00640 1 --2- 172.21.15.47:0/3911534623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe70806d240 0x7fe7080ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:55.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.661+0000 7fe70de00640 1 --2- 172.21.15.47:0/3911534623 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe70806ca40 0x7fe7080cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:55.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.661+0000 7fe70de00640 1 -- 172.21.15.47:0/3911534623 >> 172.21.15.47:0/3911534623 conn(0x7fe70808bfd0 msgr2=0x7fe70815eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:55.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.661+0000 7fe70de00640 1 -- 172.21.15.47:0/3911534623 shutdown_connections 2024-05-27T10:52:55.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.661+0000 7fe70de00640 1 -- 172.21.15.47:0/3911534623 wait complete. 2024-05-27T10:52:55.679 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T10:51:55.073251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T10:51:59.202702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T10:52:00.664039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T10:52:55.679 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T10:52:55.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.897+0000 7fef41200640 1 Processor -- start 2024-05-27T10:52:55.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.897+0000 7fef41200640 1 -- start start 2024-05-27T10:52:55.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.898+0000 7fef41200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fef3c15c510 0x7fef3c0b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:55.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.898+0000 7fef41200640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fef3c0d0a30 0x7fef3c0ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:55.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.898+0000 7fef41200640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef3c0b4620 con 0x7fef3c06da80 2024-05-27T10:52:55.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.898+0000 7fef41200640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fef3c0b4900 con 0x7fef3c0d0a30 2024-05-27T10:52:55.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.898+0000 7fef41200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fef3c0b4be0 con 0x7fef3c15c510 2024-05-27T10:52:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.899+0000 7fef3b400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fef3c15c510 0x7fef3c0b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.899+0000 7fef3b400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fef3c15c510 0x7fef3c0b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:40612/0 (socket says 172.21.15.47:40612) 2024-05-27T10:52:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.899+0000 7fef3b400640 1 -- 172.21.15.47:0/1024280187 learned_addr learned my addr 172.21.15.47:0/1024280187 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.899+0000 7fef3be00640 1 --2- 172.21.15.47:0/1024280187 >> v2:172.21.15.53:3300/0 conn(0x7fef3c0d0a30 0x7fef3c0ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.899+0000 7fef32a00640 1 --1- 172.21.15.47:0/1024280187 >> v1:172.21.15.53:6789/0 conn(0x7fef3c06da80 0x7fef3c0d0320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.47:49142/0 (socket says 172.21.15.47:49142) 2024-05-27T10:52:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.900+0000 7fef3b400640 1 -- 172.21.15.47:0/1024280187 >> v2:172.21.15.53:3300/0 conn(0x7fef3c0d0a30 msgr2=0x7fef3c0ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.900+0000 7fef3b400640 1 --2- 172.21.15.47:0/1024280187 >> v2:172.21.15.53:3300/0 conn(0x7fef3c0d0a30 0x7fef3c0ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.900+0000 7fef3b400640 1 -- 172.21.15.47:0/1024280187 >> v1:172.21.15.53:6789/0 conn(0x7fef3c06da80 legacy=0x7fef3c0d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.900+0000 7fef3b400640 1 -- 172.21.15.47:0/1024280187 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3c0b4ec0 con 0x7fef3c15c510 2024-05-27T10:52:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.900+0000 7fef3be00640 1 --2- 172.21.15.47:0/1024280187 >> v2:172.21.15.53:3300/0 conn(0x7fef3c0d0a30 0x7fef3c0ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T10:52:55.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.901+0000 7fef3b400640 1 --2- 172.21.15.47:0/1024280187 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fef3c15c510 0x7fef3c0b3cd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fef2c009870 tx=0x7fef2c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=660f3aaecb6ff2df server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:55.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.902+0000 7fef3aa00640 1 -- 172.21.15.47:0/1024280187 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c037070 con 0x7fef3c15c510 2024-05-27T10:52:55.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.902+0000 7fef3aa00640 1 -- 172.21.15.47:0/1024280187 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2c032440 con 0x7fef3c15c510 2024-05-27T10:52:55.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.902+0000 7fef3aa00640 1 -- 172.21.15.47:0/1024280187 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c032810 con 0x7fef3c15c510 2024-05-27T10:52:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.903+0000 7fef41200640 1 -- 172.21.15.47:0/1024280187 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fef3c15c510 msgr2=0x7fef3c0b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.903+0000 7fef41200640 1 --2- 172.21.15.47:0/1024280187 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fef3c15c510 0x7fef3c0b3cd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fef2c009870 tx=0x7fef2c02a270 comp rx=0 tx=0).stop 2024-05-27T10:52:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.903+0000 7fef41200640 1 -- 172.21.15.47:0/1024280187 shutdown_connections 2024-05-27T10:52:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.903+0000 7fef41200640 1 --2- 172.21.15.47:0/1024280187 >> v2:172.21.15.53:3300/0 conn(0x7fef3c0d0a30 0x7fef3c0ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.903+0000 7fef41200640 1 --2- 172.21.15.47:0/1024280187 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fef3c15c510 0x7fef3c0b3cd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.903+0000 7fef41200640 1 -- 172.21.15.47:0/1024280187 >> 172.21.15.47:0/1024280187 conn(0x7fef3c06bb20 msgr2=0x7fef3c06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.903+0000 7fef41200640 1 -- 172.21.15.47:0/1024280187 shutdown_connections 2024-05-27T10:52:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.903+0000 7fef41200640 1 -- 172.21.15.47:0/1024280187 wait complete. 2024-05-27T10:52:55.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.905+0000 7fef41200640 1 Processor -- start 2024-05-27T10:52:55.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.905+0000 7fef41200640 1 -- start start 2024-05-27T10:52:55.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.906+0000 7fef41200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef3c06da80 0x7fef3c156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:55.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.906+0000 7fef41200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fef3c0d0a30 0x7fef3c1e5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:55.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.906+0000 7fef41200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef3c15c510 0x7fef3c1e6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:55.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.906+0000 7fef41200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c0b4390 con 0x7fef3c06da80 2024-05-27T10:52:55.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.906+0000 7fef41200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c0b4210 con 0x7fef3c15c510 2024-05-27T10:52:55.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.906+0000 7fef41200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fef3c0cef30 con 0x7fef3c0d0a30 2024-05-27T10:52:55.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.906+0000 7fef3b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef3c06da80 0x7fef3c156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:55.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.906+0000 7fef3b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef3c06da80 0x7fef3c156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44972/0 (socket says 172.21.15.47:44972) 2024-05-27T10:52:55.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.906+0000 7fef3b400640 1 -- 172.21.15.47:0/4210181563 learned_addr learned my addr 172.21.15.47:0/4210181563 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:55.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.906+0000 7fef32a00640 1 --2- 172.21.15.47:0/4210181563 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fef3c0d0a30 0x7fef3c1e5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:55.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.906+0000 7fef3be00640 1 --2- 172.21.15.47:0/4210181563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef3c15c510 0x7fef3c1e6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:55.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.907+0000 7fef3b400640 1 -- 172.21.15.47:0/4210181563 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fef3c0d0a30 msgr2=0x7fef3c1e5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:55.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.907+0000 7fef3b400640 1 --2- 172.21.15.47:0/4210181563 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fef3c0d0a30 0x7fef3c1e5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:55.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.907+0000 7fef3b400640 1 -- 172.21.15.47:0/4210181563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef3c15c510 msgr2=0x7fef3c1e6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:55.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.907+0000 7fef3b400640 1 --2- 172.21.15.47:0/4210181563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef3c15c510 0x7fef3c1e6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:55.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.907+0000 7fef3b400640 1 -- 172.21.15.47:0/4210181563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3c14e830 con 0x7fef3c06da80 2024-05-27T10:52:55.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.907+0000 7fef3b400640 1 --2- 172.21.15.47:0/4210181563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef3c06da80 0x7fef3c156bb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fef2c02a2b0 tx=0x7fef2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:55.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.907+0000 7fef33e00640 1 -- 172.21.15.47:0/4210181563 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c041030 con 0x7fef3c06da80 2024-05-27T10:52:55.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.907+0000 7fef33e00640 1 -- 172.21.15.47:0/4210181563 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2c030440 con 0x7fef3c06da80 2024-05-27T10:52:55.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.907+0000 7fef33e00640 1 -- 172.21.15.47:0/4210181563 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c037040 con 0x7fef3c06da80 2024-05-27T10:52:55.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.907+0000 7fef41200640 1 -- 172.21.15.47:0/4210181563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef3c1e8c30 con 0x7fef3c06da80 2024-05-27T10:52:55.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.908+0000 7fef41200640 1 -- 172.21.15.47:0/4210181563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef3c15d980 con 0x7fef3c06da80 2024-05-27T10:52:55.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.909+0000 7fef41200640 1 -- 172.21.15.47:0/4210181563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef3c04fce0 con 0x7fef3c06da80 2024-05-27T10:52:55.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.910+0000 7fef33e00640 1 -- 172.21.15.47:0/4210181563 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef2c044070 con 0x7fef3c06da80 2024-05-27T10:52:55.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.911+0000 7fef33e00640 1 --2- 172.21.15.47:0/4210181563 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fef1806c8f0 0x7fef1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:55.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.911+0000 7fef33e00640 1 -- 172.21.15.47:0/4210181563 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fef2c0aca70 con 0x7fef3c06da80 2024-05-27T10:52:55.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.911+0000 7fef32a00640 1 --2- 172.21.15.47:0/4210181563 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fef1806c8f0 0x7fef1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:55.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.912+0000 7fef32a00640 1 --2- 172.21.15.47:0/4210181563 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fef1806c8f0 0x7fef1806edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fef3c099ad0 tx=0x7fef24007cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:55.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:55.914+0000 7fef33e00640 1 -- 172.21.15.47:0/4210181563 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fef2c07ae90 con 0x7fef3c06da80 2024-05-27T10:52:56.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.118+0000 7fef41200640 1 -- 172.21.15.47:0/4210181563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fef3c0ce430 con 0x7fef3c06da80 2024-05-27T10:52:56.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.118+0000 7fef33e00640 1 -- 172.21.15.47:0/4210181563 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fef2c07a790 con 0x7fef3c06da80 2024-05-27T10:52:56.116 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-27T10:52:56.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.121+0000 7fef41200640 1 -- 172.21.15.47:0/4210181563 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fef1806c8f0 msgr2=0x7fef1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:56.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.121+0000 7fef41200640 1 --2- 172.21.15.47:0/4210181563 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fef1806c8f0 0x7fef1806edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fef3c099ad0 tx=0x7fef24007cc0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.121+0000 7fef41200640 1 -- 172.21.15.47:0/4210181563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef3c06da80 msgr2=0x7fef3c156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.121+0000 7fef41200640 1 --2- 172.21.15.47:0/4210181563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef3c06da80 0x7fef3c156bb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fef2c02a2b0 tx=0x7fef2c0046c0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.121+0000 7fef41200640 1 -- 172.21.15.47:0/4210181563 shutdown_connections 2024-05-27T10:52:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.121+0000 7fef41200640 1 --2- 172.21.15.47:0/4210181563 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fef1806c8f0 0x7fef1806edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.121+0000 7fef41200640 1 --2- 172.21.15.47:0/4210181563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef3c15c510 0x7fef3c1e6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.121+0000 7fef41200640 1 --2- 172.21.15.47:0/4210181563 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fef3c0d0a30 0x7fef3c1e5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.121+0000 7fef41200640 1 --2- 172.21.15.47:0/4210181563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef3c06da80 0x7fef3c156bb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.121+0000 7fef41200640 1 -- 172.21.15.47:0/4210181563 >> 172.21.15.47:0/4210181563 conn(0x7fef3c06bb20 msgr2=0x7fef3c0cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.122+0000 7fef41200640 1 -- 172.21.15.47:0/4210181563 shutdown_connections 2024-05-27T10:52:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.122+0000 7fef41200640 1 -- 172.21.15.47:0/4210181563 wait complete. 2024-05-27T10:52:56.140 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T10:52:56.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.358+0000 7fd8a3000640 1 Processor -- start 2024-05-27T10:52:56.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.358+0000 7fd8a3000640 1 -- start start 2024-05-27T10:52:56.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.360+0000 7fd8a3000640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd89c15ea60 0x7fd89c1625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:56.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.360+0000 7fd8a3000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c0d1040 0x7fd89c0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:56.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.360+0000 7fd8a3000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd89c06ea50 con 0x7fd89c0b3870 2024-05-27T10:52:56.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.360+0000 7fd8a3000640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fd89c0d1a10 con 0x7fd89c15ea60 2024-05-27T10:52:56.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.360+0000 7fd8a3000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd89c162cd0 con 0x7fd89c0d1040 2024-05-27T10:52:56.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.360+0000 7fd89b400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd89c0b3870 0x7fd89c0cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49166/0 (socket says 172.21.15.47:49166) 2024-05-27T10:52:56.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.360+0000 7fd89b400640 1 -- 172.21.15.47:0/2789587522 learned_addr learned my addr 172.21.15.47:0/2789587522 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:56.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.361+0000 7fd89be00640 1 --2- 172.21.15.47:0/2789587522 >> v2:172.21.15.53:3300/0 conn(0x7fd89c15ea60 0x7fd89c1625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:56.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.361+0000 7fd8a1000640 1 --2- 172.21.15.47:0/2789587522 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c0d1040 0x7fd89c0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:56.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.361+0000 7fd89aa00640 1 -- 172.21.15.47:0/2789587522 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 239514118 0 0) 0x7fd888001110 con 0x7fd89c0b3870 2024-05-27T10:52:56.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.361+0000 7fd89aa00640 1 -- 172.21.15.47:0/2789587522 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd880003520 con 0x7fd89c0b3870 2024-05-27T10:52:56.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.361+0000 7fd89aa00640 1 -- 172.21.15.47:0/2789587522 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2163861345 0 0) 0x7fd880003520 con 0x7fd89c0b3870 2024-05-27T10:52:56.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.361+0000 7fd89aa00640 1 -- 172.21.15.47:0/2789587522 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c0d1040 msgr2=0x7fd89c0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:56.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.361+0000 7fd89aa00640 1 --2- 172.21.15.47:0/2789587522 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c0d1040 0x7fd89c0d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.361+0000 7fd89aa00640 1 -- 172.21.15.47:0/2789587522 >> v2:172.21.15.53:3300/0 conn(0x7fd89c15ea60 msgr2=0x7fd89c1625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:56.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.361+0000 7fd89aa00640 1 --2- 172.21.15.47:0/2789587522 >> v2:172.21.15.53:3300/0 conn(0x7fd89c15ea60 0x7fd89c1625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.361+0000 7fd89aa00640 1 -- 172.21.15.47:0/2789587522 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89c162fb0 con 0x7fd89c0b3870 2024-05-27T10:52:56.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.361+0000 7fd89aa00640 1 -- 172.21.15.47:0/2789587522 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7fd888001840 con 0x7fd89c0b3870 2024-05-27T10:52:56.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.361+0000 7fd89aa00640 1 -- 172.21.15.47:0/2789587522 >> v1:172.21.15.47:6789/0 conn(0x7fd89c0b3870 legacy=0x7fd89c0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:56.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.361+0000 7fd89aa00640 1 --2- 172.21.15.47:0/2789587522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8800039b0 0x7fd880003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:56.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.361+0000 7fd89aa00640 1 --2- 172.21.15.47:0/2789587522 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c0d1040 0x7fd880004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:56.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.361+0000 7fd89aa00640 1 --2- 172.21.15.47:0/2789587522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd880004d40 0x7fd8800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:56.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.361+0000 7fd89aa00640 1 -- 172.21.15.47:0/2789587522 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c0d1a10 con 0x7fd880004d40 2024-05-27T10:52:56.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.361+0000 7fd89aa00640 1 -- 172.21.15.47:0/2789587522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c162cd0 con 0x7fd8800039b0 2024-05-27T10:52:56.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.361+0000 7fd89aa00640 1 -- 172.21.15.47:0/2789587522 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd88000b9c0 con 0x7fd89c0d1040 2024-05-27T10:52:56.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.362+0000 7fd8a1000640 1 --2- 172.21.15.47:0/2789587522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd880004d40 0x7fd8800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:56.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.362+0000 7fd89be00640 1 --2- 172.21.15.47:0/2789587522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8800039b0 0x7fd880003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:56.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.362+0000 7fd89b400640 1 --2- 172.21.15.47:0/2789587522 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c0d1040 0x7fd880004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:56.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.362+0000 7fd8a1000640 1 -- 172.21.15.47:0/2789587522 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c0d1040 msgr2=0x7fd880004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:56.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.362+0000 7fd8a1000640 1 --2- 172.21.15.47:0/2789587522 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c0d1040 0x7fd880004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.362+0000 7fd8a1000640 1 -- 172.21.15.47:0/2789587522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8800039b0 msgr2=0x7fd880003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:56.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.362+0000 7fd8a1000640 1 --2- 172.21.15.47:0/2789587522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8800039b0 0x7fd880003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.362+0000 7fd8a1000640 1 -- 172.21.15.47:0/2789587522 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd880003520 con 0x7fd880004d40 2024-05-27T10:52:56.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.362+0000 7fd89be00640 1 --2- 172.21.15.47:0/2789587522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8800039b0 0x7fd880003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:52:56.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.363+0000 7fd8a1000640 1 --2- 172.21.15.47:0/2789587522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd880004d40 0x7fd8800051c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd894009ac0 tx=0x7fd880005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ad2006c57046f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:56.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.364+0000 7fd89aa00640 1 -- 172.21.15.47:0/2789587522 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd894036070 con 0x7fd880004d40 2024-05-27T10:52:56.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.364+0000 7fd89aa00640 1 -- 172.21.15.47:0/2789587522 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd894031400 con 0x7fd880004d40 2024-05-27T10:52:56.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.364+0000 7fd89aa00640 1 -- 172.21.15.47:0/2789587522 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd894009690 con 0x7fd880004d40 2024-05-27T10:52:56.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.364+0000 7fd8a3000640 1 -- 172.21.15.47:0/2789587522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd880004d40 msgr2=0x7fd8800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:56.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.364+0000 7fd8a3000640 1 --2- 172.21.15.47:0/2789587522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd880004d40 0x7fd8800051c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd894009ac0 tx=0x7fd880005830 comp rx=0 tx=0).stop 2024-05-27T10:52:56.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.364+0000 7fd8a1000640 1 -- 172.21.15.47:0/2789587522 reap_dead start 2024-05-27T10:52:56.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.364+0000 7fd8a3000640 1 -- 172.21.15.47:0/2789587522 shutdown_connections 2024-05-27T10:52:56.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.364+0000 7fd8a3000640 1 -- 172.21.15.47:0/2789587522 >> 172.21.15.47:0/2789587522 conn(0x7fd89c09da30 msgr2=0x7fd89c08bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:56.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.364+0000 7fd8a3000640 1 -- 172.21.15.47:0/2789587522 shutdown_connections 2024-05-27T10:52:56.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.364+0000 7fd8a3000640 1 -- 172.21.15.47:0/2789587522 wait complete. 2024-05-27T10:52:56.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.366+0000 7fd8a3000640 1 Processor -- start 2024-05-27T10:52:56.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.366+0000 7fd8a3000640 1 -- start start 2024-05-27T10:52:56.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.367+0000 7fd8a3000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c15a080 0x7fd89c0b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:56.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.367+0000 7fd8a3000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd89c15a460 0x7fd89c0b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:56.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.367+0000 7fd8a3000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd89c0b9030 0x7fd89c0b94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:56.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.367+0000 7fd8a3000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c15ee40 con 0x7fd89c15a460 2024-05-27T10:52:56.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.367+0000 7fd8a3000640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c06d330 con 0x7fd89c0b9030 2024-05-27T10:52:56.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.367+0000 7fd8a3000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd89c0d14d0 con 0x7fd89c15a080 2024-05-27T10:52:56.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.368+0000 7fd89b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd89c15a460 0x7fd89c0b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:56.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.368+0000 7fd89b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd89c15a460 0x7fd89c0b4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44996/0 (socket says 172.21.15.47:44996) 2024-05-27T10:52:56.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.368+0000 7fd89b400640 1 -- 172.21.15.47:0/183048029 learned_addr learned my addr 172.21.15.47:0/183048029 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:56.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.368+0000 7fd8a1000640 1 --2- 172.21.15.47:0/183048029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd89c0b9030 0x7fd89c0b94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:56.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.368+0000 7fd89be00640 1 --2- 172.21.15.47:0/183048029 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c15a080 0x7fd89c0b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:56.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.368+0000 7fd89b400640 1 -- 172.21.15.47:0/183048029 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c15a080 msgr2=0x7fd89c0b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:56.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.368+0000 7fd89b400640 1 --2- 172.21.15.47:0/183048029 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c15a080 0x7fd89c0b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.368+0000 7fd89b400640 1 -- 172.21.15.47:0/183048029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd89c0b9030 msgr2=0x7fd89c0b94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:56.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.368+0000 7fd89b400640 1 --2- 172.21.15.47:0/183048029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd89c0b9030 0x7fd89c0b94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.368+0000 7fd89b400640 1 -- 172.21.15.47:0/183048029 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89c0b5430 con 0x7fd89c15a460 2024-05-27T10:52:56.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.369+0000 7fd89b400640 1 --2- 172.21.15.47:0/183048029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd89c15a460 0x7fd89c0b4b70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd888007380 tx=0x7fd888005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:56.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.369+0000 7fd893e00640 1 -- 172.21.15.47:0/183048029 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8880017f0 con 0x7fd89c15a460 2024-05-27T10:52:56.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.369+0000 7fd893e00640 1 -- 172.21.15.47:0/183048029 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd888018070 con 0x7fd89c15a460 2024-05-27T10:52:56.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.369+0000 7fd893e00640 1 -- 172.21.15.47:0/183048029 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88800eb90 con 0x7fd89c15a460 2024-05-27T10:52:56.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.369+0000 7fd8a3000640 1 -- 172.21.15.47:0/183048029 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd89c15f660 con 0x7fd89c15a460 2024-05-27T10:52:56.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.369+0000 7fd8a3000640 1 -- 172.21.15.47:0/183048029 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd89c15fc20 con 0x7fd89c15a460 2024-05-27T10:52:56.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.370+0000 7fd8a3000640 1 -- 172.21.15.47:0/183048029 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd89c0a2710 con 0x7fd89c15a460 2024-05-27T10:52:56.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.371+0000 7fd893e00640 1 -- 172.21.15.47:0/183048029 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd88801d460 con 0x7fd89c15a460 2024-05-27T10:52:56.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.372+0000 7fd893e00640 1 --2- 172.21.15.47:0/183048029 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd87c06c8f0 0x7fd87c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:56.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.372+0000 7fd893e00640 1 -- 172.21.15.47:0/183048029 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fd88808bd80 con 0x7fd89c15a460 2024-05-27T10:52:56.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.372+0000 7fd89be00640 1 --2- 172.21.15.47:0/183048029 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd87c06c8f0 0x7fd87c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:56.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.373+0000 7fd89be00640 1 --2- 172.21.15.47:0/183048029 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd87c06c8f0 0x7fd87c06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd88c009fd0 tx=0x7fd88c00b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:56.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.377+0000 7fd893e00640 1 -- 172.21.15.47:0/183048029 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd89c06ea50 con 0x7fd89c15a460 2024-05-27T10:52:56.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.582+0000 7fd8a3000640 1 -- 172.21.15.47:0/183048029 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd89c04fdc0 con 0x7fd89c15a460 2024-05-27T10:52:56.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.583+0000 7fd893e00640 1 -- 172.21.15.47:0/183048029 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fd888059a40 con 0x7fd89c15a460 2024-05-27T10:52:56.581 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-27T10:52:56.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.585+0000 7fd8a3000640 1 -- 172.21.15.47:0/183048029 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd87c06c8f0 msgr2=0x7fd87c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:56.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.585+0000 7fd8a3000640 1 --2- 172.21.15.47:0/183048029 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd87c06c8f0 0x7fd87c06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd88c009fd0 tx=0x7fd88c00b040 comp rx=0 tx=0).stop 2024-05-27T10:52:56.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.585+0000 7fd8a3000640 1 -- 172.21.15.47:0/183048029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd89c15a460 msgr2=0x7fd89c0b4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:56.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.585+0000 7fd8a3000640 1 --2- 172.21.15.47:0/183048029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd89c15a460 0x7fd89c0b4b70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd888007380 tx=0x7fd888005f90 comp rx=0 tx=0).stop 2024-05-27T10:52:56.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.585+0000 7fd8a3000640 1 -- 172.21.15.47:0/183048029 shutdown_connections 2024-05-27T10:52:56.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.585+0000 7fd8a3000640 1 --2- 172.21.15.47:0/183048029 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd87c06c8f0 0x7fd87c06edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.585+0000 7fd8a3000640 1 --2- 172.21.15.47:0/183048029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd89c0b9030 0x7fd89c0b94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.585+0000 7fd8a3000640 1 --2- 172.21.15.47:0/183048029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd89c15a460 0x7fd89c0b4b70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.585+0000 7fd8a3000640 1 --2- 172.21.15.47:0/183048029 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd89c15a080 0x7fd89c0b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.585+0000 7fd8a3000640 1 -- 172.21.15.47:0/183048029 >> 172.21.15.47:0/183048029 conn(0x7fd89c09da30 msgr2=0x7fd89c0b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:56.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.586+0000 7fd8a3000640 1 -- 172.21.15.47:0/183048029 shutdown_connections 2024-05-27T10:52:56.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.586+0000 7fd8a3000640 1 -- 172.21.15.47:0/183048029 wait complete. 2024-05-27T10:52:56.607 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T10:52:56.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.816+0000 7f5bd0e00640 1 Processor -- start 2024-05-27T10:52:56.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.816+0000 7f5bd0e00640 1 -- start start 2024-05-27T10:52:56.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.818+0000 7f5bd0e00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5bcc15c510 0x7f5bcc0b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:56.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.818+0000 7f5bd0e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5bcc06da80 0x7f5bcc0d0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:56.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.818+0000 7f5bd0e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bcc0d0c70 con 0x7f5bcc0d0860 2024-05-27T10:52:56.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.818+0000 7f5bd0e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f5bcc0b4620 con 0x7f5bcc06da80 2024-05-27T10:52:56.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.818+0000 7f5bd0e00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f5bcc0b4900 con 0x7f5bcc15c510 2024-05-27T10:52:56.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.818+0000 7f5bc2a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5bcc06da80 0x7f5bcc0d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:56.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.818+0000 7f5bc2a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5bcc06da80 0x7f5bcc0d0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45008/0 (socket says 172.21.15.47:45008) 2024-05-27T10:52:56.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.818+0000 7f5bc2a00640 1 -- 172.21.15.47:0/2790841446 learned_addr learned my addr 172.21.15.47:0/2790841446 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:56.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.819+0000 7f5bcb400640 1 --2- 172.21.15.47:0/2790841446 >> v2:172.21.15.53:3300/0 conn(0x7f5bcc15c510 0x7f5bcc0b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:56.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.819+0000 7f5bc2a00640 1 -- 172.21.15.47:0/2790841446 >> v2:172.21.15.53:3300/0 conn(0x7f5bcc15c510 msgr2=0x7f5bcc0b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:56.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.819+0000 7f5bc2a00640 1 --2- 172.21.15.47:0/2790841446 >> v2:172.21.15.53:3300/0 conn(0x7f5bcc15c510 0x7f5bcc0b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.819+0000 7f5bc2a00640 1 -- 172.21.15.47:0/2790841446 >> v1:172.21.15.47:6789/0 conn(0x7f5bcc0d0860 legacy=0x7f5bcc1600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:56.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.819+0000 7f5bc2a00640 1 -- 172.21.15.47:0/2790841446 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bcc0b4be0 con 0x7f5bcc06da80 2024-05-27T10:52:56.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.820+0000 7f5bc2a00640 1 --2- 172.21.15.47:0/2790841446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bcc06da80 0x7f5bcc0d0320 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc073e60 tx=0x7f5bb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a63002349df3d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:56.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.820+0000 7f5bcaa00640 1 -- 172.21.15.47:0/2790841446 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4037070 con 0x7f5bcc06da80 2024-05-27T10:52:56.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.820+0000 7f5bcaa00640 1 -- 172.21.15.47:0/2790841446 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb4032440 con 0x7f5bcc06da80 2024-05-27T10:52:56.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.820+0000 7f5bcaa00640 1 -- 172.21.15.47:0/2790841446 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4032810 con 0x7f5bcc06da80 2024-05-27T10:52:56.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.821+0000 7f5bd0e00640 1 -- 172.21.15.47:0/2790841446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bcc06da80 msgr2=0x7f5bcc0d0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:56.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.821+0000 7f5bd0e00640 1 --2- 172.21.15.47:0/2790841446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bcc06da80 0x7f5bcc0d0320 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc073e60 tx=0x7f5bb402a270 comp rx=0 tx=0).stop 2024-05-27T10:52:56.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.821+0000 7f5bd0e00640 1 -- 172.21.15.47:0/2790841446 shutdown_connections 2024-05-27T10:52:56.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.821+0000 7f5bd0e00640 1 --2- 172.21.15.47:0/2790841446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bcc06da80 0x7f5bcc0d0320 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.821+0000 7f5bd0e00640 1 --2- 172.21.15.47:0/2790841446 >> v2:172.21.15.53:3300/0 conn(0x7f5bcc15c510 0x7f5bcc0b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.821+0000 7f5bd0e00640 1 -- 172.21.15.47:0/2790841446 >> 172.21.15.47:0/2790841446 conn(0x7f5bcc06bb20 msgr2=0x7f5bcc06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:56.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.821+0000 7f5bd0e00640 1 -- 172.21.15.47:0/2790841446 shutdown_connections 2024-05-27T10:52:56.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.821+0000 7f5bd0e00640 1 -- 172.21.15.47:0/2790841446 wait complete. 2024-05-27T10:52:56.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.823+0000 7f5bd0e00640 1 Processor -- start 2024-05-27T10:52:56.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.823+0000 7f5bd0e00640 1 -- start start 2024-05-27T10:52:56.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.824+0000 7f5bd0e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bcc06da80 0x7f5bcc157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:56.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.824+0000 7f5bd0e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5bcc0d0860 0x7f5bcc155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:56.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.824+0000 7f5bd0e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bcc15c510 0x7f5bcc15aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:56.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.824+0000 7f5bd0e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc0b4210 con 0x7f5bcc15c510 2024-05-27T10:52:56.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.824+0000 7f5bd0e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc15c8f0 con 0x7f5bcc06da80 2024-05-27T10:52:56.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.824+0000 7f5bd0e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5bcc0b4390 con 0x7f5bcc0d0860 2024-05-27T10:52:56.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.824+0000 7f5bcbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bcc15c510 0x7f5bcc15aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:56.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.824+0000 7f5bcbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bcc15c510 0x7f5bcc15aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45014/0 (socket says 172.21.15.47:45014) 2024-05-27T10:52:56.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.824+0000 7f5bcbe00640 1 -- 172.21.15.47:0/3625862686 learned_addr learned my addr 172.21.15.47:0/3625862686 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:56.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.825+0000 7f5bcb400640 1 --2- 172.21.15.47:0/3625862686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bcc06da80 0x7f5bcc157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:56.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.825+0000 7f5bc2a00640 1 --2- 172.21.15.47:0/3625862686 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5bcc0d0860 0x7f5bcc155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:56.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.825+0000 7f5bcbe00640 1 -- 172.21.15.47:0/3625862686 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5bcc0d0860 msgr2=0x7f5bcc155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:56.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.825+0000 7f5bcbe00640 1 --2- 172.21.15.47:0/3625862686 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5bcc0d0860 0x7f5bcc155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.825+0000 7f5bcbe00640 1 -- 172.21.15.47:0/3625862686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bcc06da80 msgr2=0x7f5bcc157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:56.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.825+0000 7f5bcbe00640 1 --2- 172.21.15.47:0/3625862686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bcc06da80 0x7f5bcc157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:56.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.825+0000 7f5bcbe00640 1 -- 172.21.15.47:0/3625862686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bcc158e20 con 0x7f5bcc15c510 2024-05-27T10:52:56.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.825+0000 7f5bc2a00640 1 --2- 172.21.15.47:0/3625862686 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5bcc0d0860 0x7f5bcc155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:56.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.825+0000 7f5bcbe00640 1 --2- 172.21.15.47:0/3625862686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bcc15c510 0x7f5bcc15aad0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5bc400c7d0 tx=0x7f5bc400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:56.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.826+0000 7f5bc3e00640 1 -- 172.21.15.47:0/3625862686 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4003b70 con 0x7f5bcc15c510 2024-05-27T10:52:56.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.826+0000 7f5bc3e00640 1 -- 172.21.15.47:0/3625862686 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc4003d30 con 0x7f5bcc15c510 2024-05-27T10:52:56.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.826+0000 7f5bc3e00640 1 -- 172.21.15.47:0/3625862686 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc400aa90 con 0x7f5bcc15c510 2024-05-27T10:52:56.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.826+0000 7f5bd0e00640 1 -- 172.21.15.47:0/3625862686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bcc159100 con 0x7f5bcc15c510 2024-05-27T10:52:56.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.826+0000 7f5bd0e00640 1 -- 172.21.15.47:0/3625862686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bcc1596c0 con 0x7f5bcc15c510 2024-05-27T10:52:56.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.827+0000 7f5bd0e00640 1 -- 172.21.15.47:0/3625862686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bcc04fce0 con 0x7f5bcc15c510 2024-05-27T10:52:56.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.828+0000 7f5bc3e00640 1 -- 172.21.15.47:0/3625862686 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5bc400ac30 con 0x7f5bcc15c510 2024-05-27T10:52:56.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.829+0000 7f5bc3e00640 1 --2- 172.21.15.47:0/3625862686 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5ba806c920 0x7f5ba806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:56.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.829+0000 7f5bc3e00640 1 -- 172.21.15.47:0/3625862686 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f5bc408bbd0 con 0x7f5bcc15c510 2024-05-27T10:52:56.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.829+0000 7f5bcb400640 1 --2- 172.21.15.47:0/3625862686 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5ba806c920 0x7f5ba806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:56.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.830+0000 7f5bcb400640 1 --2- 172.21.15.47:0/3625862686 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5ba806c920 0x7f5ba806ede0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc006fd0 tx=0x7f5bbc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:56.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:56.833+0000 7f5bc3e00640 1 -- 172.21.15.47:0/3625862686 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5bcc0d0c70 con 0x7f5bcc15c510 2024-05-27T10:52:57.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.046+0000 7f5bd0e00640 1 -- 172.21.15.47:0/3625862686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5bcc0ce430 con 0x7f5bcc15c510 2024-05-27T10:52:57.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.047+0000 7f5bc3e00640 1 -- 172.21.15.47:0/3625862686 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f5bc4059ee0 con 0x7f5bcc15c510 2024-05-27T10:52:57.045 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-27T10:52:57.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.050+0000 7f5bd0e00640 1 -- 172.21.15.47:0/3625862686 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5ba806c920 msgr2=0x7f5ba806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:57.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.050+0000 7f5bd0e00640 1 --2- 172.21.15.47:0/3625862686 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5ba806c920 0x7f5ba806ede0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc006fd0 tx=0x7f5bbc008040 comp rx=0 tx=0).stop 2024-05-27T10:52:57.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.050+0000 7f5bd0e00640 1 -- 172.21.15.47:0/3625862686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bcc15c510 msgr2=0x7f5bcc15aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:57.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.050+0000 7f5bd0e00640 1 --2- 172.21.15.47:0/3625862686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bcc15c510 0x7f5bcc15aad0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5bc400c7d0 tx=0x7f5bc400cc90 comp rx=0 tx=0).stop 2024-05-27T10:52:57.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.050+0000 7f5bd0e00640 1 -- 172.21.15.47:0/3625862686 shutdown_connections 2024-05-27T10:52:57.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.050+0000 7f5bd0e00640 1 --2- 172.21.15.47:0/3625862686 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5ba806c920 0x7f5ba806ede0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.050+0000 7f5bd0e00640 1 --2- 172.21.15.47:0/3625862686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bcc15c510 0x7f5bcc15aad0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.050+0000 7f5bd0e00640 1 --2- 172.21.15.47:0/3625862686 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5bcc0d0860 0x7f5bcc155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.050+0000 7f5bd0e00640 1 --2- 172.21.15.47:0/3625862686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bcc06da80 0x7f5bcc157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.050+0000 7f5bd0e00640 1 -- 172.21.15.47:0/3625862686 >> 172.21.15.47:0/3625862686 conn(0x7f5bcc06bb20 msgr2=0x7f5bcc0ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:57.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.050+0000 7f5bd0e00640 1 -- 172.21.15.47:0/3625862686 shutdown_connections 2024-05-27T10:52:57.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.050+0000 7f5bd0e00640 1 -- 172.21.15.47:0/3625862686 wait complete. 2024-05-27T10:52:57.068 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T10:52:57.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.282+0000 7f4097000640 1 Processor -- start 2024-05-27T10:52:57.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.282+0000 7f4097000640 1 -- start start 2024-05-27T10:52:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.283+0000 7f4097000640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f409015c420 0x7f4090071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.283+0000 7f4097000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f40900b4ab0 0x7f40900d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.284+0000 7f4097000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4090073c50 0x7f40900d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.284+0000 7f4097000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f40900afc90 con 0x7f4090073c50 2024-05-27T10:52:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.284+0000 7f4097000640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f409015c800 con 0x7f409015c420 2024-05-27T10:52:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.284+0000 7f4097000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f40900ad2e0 con 0x7f40900b4ab0 2024-05-27T10:52:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.284+0000 7f4096600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4090073c50 0x7f40900d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.284+0000 7f4096600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4090073c50 0x7f40900d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45024/0 (socket says 172.21.15.47:45024) 2024-05-27T10:52:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.284+0000 7f4096600640 1 -- 172.21.15.47:0/2330676279 learned_addr learned my addr 172.21.15.47:0/2330676279 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.284+0000 7f4095c00640 1 --2- 172.21.15.47:0/2330676279 >> v2:172.21.15.53:3300/0 conn(0x7f409015c420 0x7f4090071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.284+0000 7f4095200640 1 --2- 172.21.15.47:0/2330676279 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f40900b4ab0 0x7f40900d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.284+0000 7f4096600640 1 -- 172.21.15.47:0/2330676279 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f40900b4ab0 msgr2=0x7f40900d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.284+0000 7f4096600640 1 --2- 172.21.15.47:0/2330676279 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f40900b4ab0 0x7f40900d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.284+0000 7f4096600640 1 -- 172.21.15.47:0/2330676279 >> v2:172.21.15.53:3300/0 conn(0x7f409015c420 msgr2=0x7f4090071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.284+0000 7f4096600640 1 --2- 172.21.15.47:0/2330676279 >> v2:172.21.15.53:3300/0 conn(0x7f409015c420 0x7f4090071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.284+0000 7f4096600640 1 -- 172.21.15.47:0/2330676279 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40900ad5c0 con 0x7f4090073c50 2024-05-27T10:52:57.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.285+0000 7f4096600640 1 --2- 172.21.15.47:0/2330676279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4090073c50 0x7f40900d08a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f40900b4600 tx=0x7f408802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723e89f906b00a68 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:57.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.286+0000 7f408fe00640 1 -- 172.21.15.47:0/2330676279 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4088036070 con 0x7f4090073c50 2024-05-27T10:52:57.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.286+0000 7f408fe00640 1 -- 172.21.15.47:0/2330676279 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4088031600 con 0x7f4090073c50 2024-05-27T10:52:57.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.286+0000 7f408fe00640 1 -- 172.21.15.47:0/2330676279 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40880319d0 con 0x7f4090073c50 2024-05-27T10:52:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.286+0000 7f4097000640 1 -- 172.21.15.47:0/2330676279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4090073c50 msgr2=0x7f40900d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.286+0000 7f4097000640 1 --2- 172.21.15.47:0/2330676279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4090073c50 0x7f40900d08a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f40900b4600 tx=0x7f408802a610 comp rx=0 tx=0).stop 2024-05-27T10:52:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.287+0000 7f4097000640 1 -- 172.21.15.47:0/2330676279 shutdown_connections 2024-05-27T10:52:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.287+0000 7f4097000640 1 --2- 172.21.15.47:0/2330676279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4090073c50 0x7f40900d08a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.287+0000 7f4097000640 1 --2- 172.21.15.47:0/2330676279 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f40900b4ab0 0x7f40900d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.287+0000 7f4097000640 1 --2- 172.21.15.47:0/2330676279 >> v2:172.21.15.53:3300/0 conn(0x7f409015c420 0x7f4090071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.287+0000 7f4097000640 1 -- 172.21.15.47:0/2330676279 >> 172.21.15.47:0/2330676279 conn(0x7f409006bb20 msgr2=0x7f409006bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.287+0000 7f4097000640 1 -- 172.21.15.47:0/2330676279 shutdown_connections 2024-05-27T10:52:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.287+0000 7f4097000640 1 -- 172.21.15.47:0/2330676279 wait complete. 2024-05-27T10:52:57.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.289+0000 7f4097000640 1 Processor -- start 2024-05-27T10:52:57.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.289+0000 7f4097000640 1 -- start start 2024-05-27T10:52:57.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.290+0000 7f4097000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4090073c50 0x7f40900b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:57.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.290+0000 7f4097000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40900b4ab0 0x7f409014e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:57.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.290+0000 7f4097000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f409015c420 0x7f409015afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:57.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.290+0000 7f4097000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f40900af8f0 con 0x7f4090073c50 2024-05-27T10:52:57.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.290+0000 7f4097000640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f40900ad8a0 con 0x7f40900b4ab0 2024-05-27T10:52:57.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.290+0000 7f4097000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f40900afa70 con 0x7f409015c420 2024-05-27T10:52:57.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.290+0000 7f4095c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4090073c50 0x7f40900b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:57.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.290+0000 7f4095c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4090073c50 0x7f40900b2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45030/0 (socket says 172.21.15.47:45030) 2024-05-27T10:52:57.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.290+0000 7f4095c00640 1 -- 172.21.15.47:0/3133823304 learned_addr learned my addr 172.21.15.47:0/3133823304 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:57.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.290+0000 7f4095c00640 1 -- 172.21.15.47:0/3133823304 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f409015c420 msgr2=0x7f409015afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:57.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.290+0000 7f4095c00640 1 --2- 172.21.15.47:0/3133823304 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f409015c420 0x7f409015afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.290+0000 7f4095200640 1 --2- 172.21.15.47:0/3133823304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40900b4ab0 0x7f409014e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:57.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.290+0000 7f4095c00640 1 -- 172.21.15.47:0/3133823304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40900b4ab0 msgr2=0x7f409014e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:57.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.291+0000 7f4095c00640 1 --2- 172.21.15.47:0/3133823304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40900b4ab0 0x7f409014e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.291+0000 7f4095c00640 1 -- 172.21.15.47:0/3133823304 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40900b19d0 con 0x7f4090073c50 2024-05-27T10:52:57.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.291+0000 7f4095c00640 1 --2- 172.21.15.47:0/3133823304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4090073c50 0x7f40900b2790 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f407c00d780 tx=0x7f407c00dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:57.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.291+0000 7f408d600640 1 -- 172.21.15.47:0/3133823304 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c00b6c0 con 0x7f4090073c50 2024-05-27T10:52:57.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.291+0000 7f408d600640 1 -- 172.21.15.47:0/3133823304 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f407c019070 con 0x7f4090073c50 2024-05-27T10:52:57.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.291+0000 7f408d600640 1 -- 172.21.15.47:0/3133823304 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c00ba80 con 0x7f4090073c50 2024-05-27T10:52:57.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.291+0000 7f4097000640 1 -- 172.21.15.47:0/3133823304 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40900b1cb0 con 0x7f4090073c50 2024-05-27T10:52:57.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.291+0000 7f4097000640 1 -- 172.21.15.47:0/3133823304 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f409015b4e0 con 0x7f4090073c50 2024-05-27T10:52:57.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.293+0000 7f4097000640 1 -- 172.21.15.47:0/3133823304 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f409004fce0 con 0x7f4090073c50 2024-05-27T10:52:57.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.294+0000 7f408d600640 1 -- 172.21.15.47:0/3133823304 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f407c00bc20 con 0x7f4090073c50 2024-05-27T10:52:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.295+0000 7f408d600640 1 --2- 172.21.15.47:0/3133823304 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f407006c920 0x7f407006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.295+0000 7f408d600640 1 -- 172.21.15.47:0/3133823304 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f407c08bfa0 con 0x7f4090073c50 2024-05-27T10:52:57.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.295+0000 7f4095200640 1 --2- 172.21.15.47:0/3133823304 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f407006c920 0x7f407006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:57.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.296+0000 7f4095200640 1 --2- 172.21.15.47:0/3133823304 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f407006c920 0x7f407006ede0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4084006fd0 tx=0x7f4084008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:57.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.300+0000 7f408d600640 1 -- 172.21.15.47:0/3133823304 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f407c05a340 con 0x7f4090073c50 2024-05-27T10:52:57.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.516+0000 7f4097000640 1 -- 172.21.15.47:0/3133823304 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f40900b2d00 con 0x7f4090073c50 2024-05-27T10:52:57.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.517+0000 7f408d600640 1 -- 172.21.15.47:0/3133823304 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f407c059c40 con 0x7f4090073c50 2024-05-27T10:52:57.515 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-05-27T10:52:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.520+0000 7f4097000640 1 -- 172.21.15.47:0/3133823304 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f407006c920 msgr2=0x7f407006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.520+0000 7f4097000640 1 --2- 172.21.15.47:0/3133823304 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f407006c920 0x7f407006ede0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4084006fd0 tx=0x7f4084008040 comp rx=0 tx=0).stop 2024-05-27T10:52:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.520+0000 7f4097000640 1 -- 172.21.15.47:0/3133823304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4090073c50 msgr2=0x7f40900b2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.520+0000 7f4097000640 1 --2- 172.21.15.47:0/3133823304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4090073c50 0x7f40900b2790 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f407c00d780 tx=0x7f407c00dc40 comp rx=0 tx=0).stop 2024-05-27T10:52:57.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.520+0000 7f4097000640 1 -- 172.21.15.47:0/3133823304 shutdown_connections 2024-05-27T10:52:57.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.520+0000 7f4097000640 1 --2- 172.21.15.47:0/3133823304 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f407006c920 0x7f407006ede0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.520+0000 7f4097000640 1 --2- 172.21.15.47:0/3133823304 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f409015c420 0x7f409015afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.520+0000 7f4097000640 1 --2- 172.21.15.47:0/3133823304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40900b4ab0 0x7f409014e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.520+0000 7f4097000640 1 --2- 172.21.15.47:0/3133823304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4090073c50 0x7f40900b2790 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.520+0000 7f4097000640 1 -- 172.21.15.47:0/3133823304 >> 172.21.15.47:0/3133823304 conn(0x7f409006bb20 msgr2=0x7f4090071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:57.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.520+0000 7f4097000640 1 -- 172.21.15.47:0/3133823304 shutdown_connections 2024-05-27T10:52:57.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.520+0000 7f4097000640 1 -- 172.21.15.47:0/3133823304 wait complete. 2024-05-27T10:52:57.536 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:52:57.536 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:52:57.585 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:52:57.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.840+0000 7f5c4fe00640 1 Processor -- start 2024-05-27T10:52:57.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.840+0000 7f5c4fe00640 1 -- start start 2024-05-27T10:52:57.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.842+0000 7f5c4fe00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5c500d0a70 0x7f5c500b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:57.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.842+0000 7f5c4fe00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c5015c800 con 0x7f5c5015c420 2024-05-27T10:52:57.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.842+0000 7f5c4fe00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c500726d0 con 0x7f5c500b4ab0 2024-05-27T10:52:57.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.842+0000 7f5c4fe00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f5c500afc90 con 0x7f5c500d0a70 2024-05-27T10:52:57.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.842+0000 7f5c4ea00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f5c5015c420 0x7f5c50071fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49194/0 (socket says 172.21.15.47:49194) 2024-05-27T10:52:57.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.842+0000 7f5c4ea00640 1 -- 172.21.15.47:0/660687454 learned_addr learned my addr 172.21.15.47:0/660687454 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.843+0000 7f5c4d600640 1 -- 172.21.15.47:0/660687454 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3709878232 0 0) 0x7f5c5015c800 con 0x7f5c5015c420 2024-05-27T10:52:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.843+0000 7f5c4d600640 1 -- 172.21.15.47:0/660687454 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c34003520 con 0x7f5c5015c420 2024-05-27T10:52:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.843+0000 7f5c4f400640 1 --2- 172.21.15.47:0/660687454 >> v2:172.21.15.53:3300/0 conn(0x7f5c500d0a70 0x7f5c500b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.843+0000 7f5c4d600640 1 -- 172.21.15.47:0/660687454 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4201875960 0 0) 0x7f5c34003520 con 0x7f5c5015c420 2024-05-27T10:52:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.843+0000 7f5c4d600640 1 -- 172.21.15.47:0/660687454 >> v2:172.21.15.53:3300/0 conn(0x7f5c500d0a70 msgr2=0x7f5c500b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.843+0000 7f5c4d600640 1 --2- 172.21.15.47:0/660687454 >> v2:172.21.15.53:3300/0 conn(0x7f5c500d0a70 0x7f5c500b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.843+0000 7f5c4d600640 1 -- 172.21.15.47:0/660687454 >> v1:172.21.15.53:6789/0 conn(0x7f5c500b4ab0 legacy=0x7f5c500d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.843+0000 7f5c4d600640 1 -- 172.21.15.47:0/660687454 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c500ad2e0 con 0x7f5c5015c420 2024-05-27T10:52:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.843+0000 7f5c4d600640 1 -- 172.21.15.47:0/660687454 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f5c40001670 con 0x7f5c5015c420 2024-05-27T10:52:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.843+0000 7f5c4d600640 1 -- 172.21.15.47:0/660687454 >> v1:172.21.15.47:6789/0 conn(0x7f5c5015c420 legacy=0x7f5c50071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.843+0000 7f5c4d600640 1 --2- 172.21.15.47:0/660687454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c34003a00 0x7f5c34003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.843+0000 7f5c4d600640 1 --2- 172.21.15.47:0/660687454 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c34004800 0x7f5c34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.843+0000 7f5c4d600640 1 --2- 172.21.15.47:0/660687454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c340052e0 0x7f5c3400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.843+0000 7f5c4d600640 1 -- 172.21.15.47:0/660687454 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5c500afc90 con 0x7f5c340052e0 2024-05-27T10:52:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.843+0000 7f5c4d600640 1 -- 172.21.15.47:0/660687454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3400c200 con 0x7f5c34003a00 2024-05-27T10:52:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.843+0000 7f5c4d600640 1 -- 172.21.15.47:0/660687454 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5c3400c400 con 0x7f5c34004800 2024-05-27T10:52:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.844+0000 7f5c4f400640 1 --2- 172.21.15.47:0/660687454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c340052e0 0x7f5c3400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.844+0000 7f5c4ea00640 1 --2- 172.21.15.47:0/660687454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c34003a00 0x7f5c34003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.844+0000 7f5c4e000640 1 --2- 172.21.15.47:0/660687454 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c34004800 0x7f5c34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.844+0000 7f5c4f400640 1 -- 172.21.15.47:0/660687454 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c34004800 msgr2=0x7f5c34004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.844+0000 7f5c4f400640 1 --2- 172.21.15.47:0/660687454 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c34004800 0x7f5c34004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.844+0000 7f5c4f400640 1 -- 172.21.15.47:0/660687454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c34003a00 msgr2=0x7f5c34003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.844+0000 7f5c4f400640 1 --2- 172.21.15.47:0/660687454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c34003a00 0x7f5c34003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.844+0000 7f5c4f400640 1 -- 172.21.15.47:0/660687454 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c34003520 con 0x7f5c340052e0 2024-05-27T10:52:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.845+0000 7f5c4f400640 1 -- 172.21.15.47:0/660687454 reap_dead start 2024-05-27T10:52:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.845+0000 7f5c4f400640 1 --2- 172.21.15.47:0/660687454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c340052e0 0x7f5c3400b9c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5c500cf490 tx=0x7f5c34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9608102f7eda5cd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:57.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.845+0000 7f5c4d600640 1 -- 172.21.15.47:0/660687454 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c48033070 con 0x7f5c340052e0 2024-05-27T10:52:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.845+0000 7f5c4d600640 1 -- 172.21.15.47:0/660687454 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c4802f650 con 0x7f5c340052e0 2024-05-27T10:52:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.845+0000 7f5c4d600640 1 -- 172.21.15.47:0/660687454 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c48009be0 con 0x7f5c340052e0 2024-05-27T10:52:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.846+0000 7f5c4fe00640 1 -- 172.21.15.47:0/660687454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c340052e0 msgr2=0x7f5c3400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.846+0000 7f5c4fe00640 1 --2- 172.21.15.47:0/660687454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c340052e0 0x7f5c3400b9c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5c500cf490 tx=0x7f5c34005830 comp rx=0 tx=0).stop 2024-05-27T10:52:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.846+0000 7f5c4fe00640 1 -- 172.21.15.47:0/660687454 shutdown_connections 2024-05-27T10:52:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.846+0000 7f5c4fe00640 1 --2- 172.21.15.47:0/660687454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c340052e0 0x7f5c3400b9c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.846+0000 7f5c4fe00640 1 -- 172.21.15.47:0/660687454 >> 172.21.15.47:0/660687454 conn(0x7f5c5006bb20 msgr2=0x7f5c5006bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.846+0000 7f5c4fe00640 1 -- 172.21.15.47:0/660687454 shutdown_connections 2024-05-27T10:52:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.846+0000 7f5c4fe00640 1 -- 172.21.15.47:0/660687454 wait complete. 2024-05-27T10:52:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.848+0000 7f5c4fe00640 1 Processor -- start 2024-05-27T10:52:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.848+0000 7f5c4fe00640 1 -- start start 2024-05-27T10:52:57.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.849+0000 7f5c4fe00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c340052e0 0x7f5c501f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:57.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.849+0000 7f5c4fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c5015f580 0x7f5c500b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:57.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.849+0000 7f5c4fe00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c5015e1b0 0x7f5c5006e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:57.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.849+0000 7f5c4fe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5c500ad8a0 con 0x7f5c5015f580 2024-05-27T10:52:57.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.849+0000 7f5c4fe00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5c500b3270 con 0x7f5c5015e1b0 2024-05-27T10:52:57.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.849+0000 7f5c4fe00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5c500af8f0 con 0x7f5c340052e0 2024-05-27T10:52:57.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.849+0000 7f5c4e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c5015f580 0x7f5c500b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:57.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.849+0000 7f5c4e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c5015f580 0x7f5c500b0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45044/0 (socket says 172.21.15.47:45044) 2024-05-27T10:52:57.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.849+0000 7f5c4e000640 1 -- 172.21.15.47:0/2134240066 learned_addr learned my addr 172.21.15.47:0/2134240066 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:57.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.850+0000 7f5c4ea00640 1 --2- 172.21.15.47:0/2134240066 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c340052e0 0x7f5c501f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:57.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.850+0000 7f5c4e000640 1 -- 172.21.15.47:0/2134240066 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c340052e0 msgr2=0x7f5c501f3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:57.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.850+0000 7f5c4e000640 1 --2- 172.21.15.47:0/2134240066 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c340052e0 0x7f5c501f3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.850+0000 7f5c4e000640 1 -- 172.21.15.47:0/2134240066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c5015e1b0 msgr2=0x7f5c5006e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:57.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.850+0000 7f5c4e000640 1 --2- 172.21.15.47:0/2134240066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c5015e1b0 0x7f5c5006e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:57.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.850+0000 7f5c4e000640 1 -- 172.21.15.47:0/2134240066 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c501f4370 con 0x7f5c5015f580 2024-05-27T10:52:57.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.850+0000 7f5c4e000640 1 --2- 172.21.15.47:0/2134240066 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c5015f580 0x7f5c500b0f70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00e410 tx=0x7f5c3c00e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:57.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.850+0000 7f5c46a00640 1 -- 172.21.15.47:0/2134240066 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c019070 con 0x7f5c5015f580 2024-05-27T10:52:57.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.851+0000 7f5c46a00640 1 -- 172.21.15.47:0/2134240066 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c3c0052e0 con 0x7f5c5015f580 2024-05-27T10:52:57.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.851+0000 7f5c46a00640 1 -- 172.21.15.47:0/2134240066 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c003810 con 0x7f5c5015f580 2024-05-27T10:52:57.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.851+0000 7f5c4fe00640 1 -- 172.21.15.47:0/2134240066 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c500b14b0 con 0x7f5c5015f580 2024-05-27T10:52:57.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.851+0000 7f5c4fe00640 1 -- 172.21.15.47:0/2134240066 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c501f48f0 con 0x7f5c5015f580 2024-05-27T10:52:57.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.852+0000 7f5c4fe00640 1 -- 172.21.15.47:0/2134240066 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c5004fce0 con 0x7f5c5015f580 2024-05-27T10:52:57.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.853+0000 7f5c46a00640 1 -- 172.21.15.47:0/2134240066 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5c3c01c070 con 0x7f5c5015f580 2024-05-27T10:52:57.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.853+0000 7f5c46a00640 1 --2- 172.21.15.47:0/2134240066 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5c3006c920 0x7f5c3006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:57.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.854+0000 7f5c46a00640 1 -- 172.21.15.47:0/2134240066 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f5c3c08b120 con 0x7f5c5015f580 2024-05-27T10:52:57.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.854+0000 7f5c4ea00640 1 --2- 172.21.15.47:0/2134240066 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5c3006c920 0x7f5c3006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:57.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.855+0000 7f5c4ea00640 1 --2- 172.21.15.47:0/2134240066 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5c3006c920 0x7f5c3006ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5c50152e80 tx=0x7f5c40000ef0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:57.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:57.858+0000 7f5c46a00640 1 -- 172.21.15.47:0/2134240066 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5c3c058e70 con 0x7f5c5015f580 2024-05-27T10:52:58.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.063+0000 7f5c4fe00640 1 -- 172.21.15.47:0/2134240066 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5c50073a30 con 0x7f5c5015f580 2024-05-27T10:52:58.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.066+0000 7f5c46a00640 1 -- 172.21.15.47:0/2134240066 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16770 (secure 0 0 0) 0x7f5c3c05d170 con 0x7f5c5015f580 2024-05-27T10:52:58.065 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:52:58.065 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":22,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:48.545555+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:52:58.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.069+0000 7f5c4fe00640 1 -- 172.21.15.47:0/2134240066 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5c3006c920 msgr2=0x7f5c3006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:58.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.069+0000 7f5c4fe00640 1 --2- 172.21.15.47:0/2134240066 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5c3006c920 0x7f5c3006ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5c50152e80 tx=0x7f5c40000ef0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.069+0000 7f5c4fe00640 1 -- 172.21.15.47:0/2134240066 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c5015f580 msgr2=0x7f5c500b0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:58.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.069+0000 7f5c4fe00640 1 --2- 172.21.15.47:0/2134240066 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c5015f580 0x7f5c500b0f70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00e410 tx=0x7f5c3c00e8d0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.069+0000 7f5c4fe00640 1 -- 172.21.15.47:0/2134240066 shutdown_connections 2024-05-27T10:52:58.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.069+0000 7f5c4fe00640 1 --2- 172.21.15.47:0/2134240066 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5c3006c920 0x7f5c3006ede0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.069+0000 7f5c4fe00640 1 --2- 172.21.15.47:0/2134240066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c5015e1b0 0x7f5c5006e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.069+0000 7f5c4fe00640 1 --2- 172.21.15.47:0/2134240066 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c5015f580 0x7f5c500b0f70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.069+0000 7f5c4fe00640 1 --2- 172.21.15.47:0/2134240066 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c340052e0 0x7f5c501f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.069+0000 7f5c4fe00640 1 -- 172.21.15.47:0/2134240066 >> 172.21.15.47:0/2134240066 conn(0x7f5c5006bb20 msgr2=0x7f5c500728a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:58.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.070+0000 7f5c4fe00640 1 -- 172.21.15.47:0/2134240066 shutdown_connections 2024-05-27T10:52:58.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.070+0000 7f5c4fe00640 1 -- 172.21.15.47:0/2134240066 wait complete. 2024-05-27T10:52:58.086 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T10:51:55.073251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T10:51:59.202702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T10:52:00.664039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T10:52:58.087 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T10:52:58.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.304+0000 7fcb88c00640 1 Processor -- start 2024-05-27T10:52:58.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.305+0000 7fcb88c00640 1 -- start start 2024-05-27T10:52:58.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.306+0000 7fcb88c00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcb840d1070 0x7fcb8415f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:58.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.306+0000 7fcb88c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb840cf8e0 con 0x7fcb840cf340 2024-05-27T10:52:58.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.306+0000 7fcb88c00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb840cfbc0 con 0x7fcb840d22c0 2024-05-27T10:52:58.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.306+0000 7fcb88c00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fcb8415feb0 con 0x7fcb840d1070 2024-05-27T10:52:58.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.306+0000 7fcb81400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fcb840cf340 0x7fcb840d1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49208/0 (socket says 172.21.15.47:49208) 2024-05-27T10:52:58.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.306+0000 7fcb81400640 1 -- 172.21.15.47:0/1306196586 learned_addr learned my addr 172.21.15.47:0/1306196586 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:58.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.307+0000 7fcb80a00640 1 -- 172.21.15.47:0/1306196586 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3685429064 0 0) 0x7fcb840cf8e0 con 0x7fcb840cf340 2024-05-27T10:52:58.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.307+0000 7fcb81e00640 1 --2- 172.21.15.47:0/1306196586 >> v2:172.21.15.53:3300/0 conn(0x7fcb840d1070 0x7fcb8415f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:58.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.307+0000 7fcb80a00640 1 -- 172.21.15.47:0/1306196586 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb68003520 con 0x7fcb840cf340 2024-05-27T10:52:58.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.307+0000 7fcb80a00640 1 -- 172.21.15.47:0/1306196586 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2861191260 0 0) 0x7fcb68003520 con 0x7fcb840cf340 2024-05-27T10:52:58.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.307+0000 7fcb80a00640 1 -- 172.21.15.47:0/1306196586 >> v2:172.21.15.53:3300/0 conn(0x7fcb840d1070 msgr2=0x7fcb8415f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:58.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.307+0000 7fcb80a00640 1 --2- 172.21.15.47:0/1306196586 >> v2:172.21.15.53:3300/0 conn(0x7fcb840d1070 0x7fcb8415f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.307+0000 7fcb80a00640 1 -- 172.21.15.47:0/1306196586 >> v1:172.21.15.53:6789/0 conn(0x7fcb840d22c0 legacy=0x7fcb840d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:58.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.307+0000 7fcb80a00640 1 -- 172.21.15.47:0/1306196586 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb840cfea0 con 0x7fcb840cf340 2024-05-27T10:52:58.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.307+0000 7fcb80a00640 1 -- 172.21.15.47:0/1306196586 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7fcb700019f0 con 0x7fcb840cf340 2024-05-27T10:52:58.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.307+0000 7fcb80a00640 1 -- 172.21.15.47:0/1306196586 >> v1:172.21.15.47:6789/0 conn(0x7fcb840cf340 legacy=0x7fcb840d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:58.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.307+0000 7fcb80a00640 1 --2- 172.21.15.47:0/1306196586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb68003a00 0x7fcb68003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:58.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.307+0000 7fcb80a00640 1 --2- 172.21.15.47:0/1306196586 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb68004800 0x7fcb68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:58.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.307+0000 7fcb80a00640 1 --2- 172.21.15.47:0/1306196586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb680051c0 0x7fcb6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:58.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.307+0000 7fcb80a00640 1 -- 172.21.15.47:0/1306196586 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8415feb0 con 0x7fcb680051c0 2024-05-27T10:52:58.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.307+0000 7fcb80a00640 1 -- 172.21.15.47:0/1306196586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6800c0a0 con 0x7fcb68003a00 2024-05-27T10:52:58.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.307+0000 7fcb80a00640 1 -- 172.21.15.47:0/1306196586 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fcb6800c2a0 con 0x7fcb68004800 2024-05-27T10:52:58.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.308+0000 7fcb82800640 1 --2- 172.21.15.47:0/1306196586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb680051c0 0x7fcb6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:58.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.308+0000 7fcb82800640 1 -- 172.21.15.47:0/1306196586 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb68004800 msgr2=0x7fcb68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:58.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.308+0000 7fcb81400640 1 --2- 172.21.15.47:0/1306196586 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb68004800 0x7fcb68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:58.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.308+0000 7fcb82800640 1 --2- 172.21.15.47:0/1306196586 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb68004800 0x7fcb68004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.308+0000 7fcb82800640 1 -- 172.21.15.47:0/1306196586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb68003a00 msgr2=0x7fcb68003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:58.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.308+0000 7fcb81e00640 1 --2- 172.21.15.47:0/1306196586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb68003a00 0x7fcb68003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:58.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.308+0000 7fcb82800640 1 --2- 172.21.15.47:0/1306196586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb68003a00 0x7fcb68003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.308+0000 7fcb82800640 1 -- 172.21.15.47:0/1306196586 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb68003520 con 0x7fcb680051c0 2024-05-27T10:52:58.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.309+0000 7fcb82800640 1 -- 172.21.15.47:0/1306196586 reap_dead start 2024-05-27T10:52:58.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.309+0000 7fcb82800640 1 --2- 172.21.15.47:0/1306196586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb680051c0 0x7fcb6800b9c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c001750 tx=0x7fcb68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7b3ca1b7a8d6d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:58.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.309+0000 7fcb80a00640 1 -- 172.21.15.47:0/1306196586 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c001370 con 0x7fcb680051c0 2024-05-27T10:52:58.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.310+0000 7fcb80a00640 1 -- 172.21.15.47:0/1306196586 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb7c0052f0 con 0x7fcb680051c0 2024-05-27T10:52:58.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.310+0000 7fcb80a00640 1 -- 172.21.15.47:0/1306196586 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c02abe0 con 0x7fcb680051c0 2024-05-27T10:52:58.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.310+0000 7fcb88c00640 1 -- 172.21.15.47:0/1306196586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb680051c0 msgr2=0x7fcb6800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:58.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.310+0000 7fcb88c00640 1 --2- 172.21.15.47:0/1306196586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb680051c0 0x7fcb6800b9c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c001750 tx=0x7fcb68005830 comp rx=0 tx=0).stop 2024-05-27T10:52:58.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.310+0000 7fcb88c00640 1 -- 172.21.15.47:0/1306196586 shutdown_connections 2024-05-27T10:52:58.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.310+0000 7fcb88c00640 1 --2- 172.21.15.47:0/1306196586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb680051c0 0x7fcb6800b9c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.310+0000 7fcb88c00640 1 -- 172.21.15.47:0/1306196586 >> 172.21.15.47:0/1306196586 conn(0x7fcb8408bfd0 msgr2=0x7fcb840d4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:58.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.310+0000 7fcb88c00640 1 -- 172.21.15.47:0/1306196586 shutdown_connections 2024-05-27T10:52:58.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.310+0000 7fcb88c00640 1 -- 172.21.15.47:0/1306196586 wait complete. 2024-05-27T10:52:58.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.312+0000 7fcb88c00640 1 Processor -- start 2024-05-27T10:52:58.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.312+0000 7fcb88c00640 1 -- start start 2024-05-27T10:52:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.313+0000 7fcb88c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb680051c0 0x7fcb840cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.313+0000 7fcb88c00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb841f4ae0 0x7fcb840b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.313+0000 7fcb88c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb841f8830 0x7fcb840d2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.313+0000 7fcb88c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcb840d0460 con 0x7fcb841f8830 2024-05-27T10:52:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.313+0000 7fcb88c00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcb840d54d0 con 0x7fcb841f4ae0 2024-05-27T10:52:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.313+0000 7fcb88c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fcb8415ebc0 con 0x7fcb680051c0 2024-05-27T10:52:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.313+0000 7fcb82800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb841f8830 0x7fcb840d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.313+0000 7fcb82800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb841f8830 0x7fcb840d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45058/0 (socket says 172.21.15.47:45058) 2024-05-27T10:52:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.313+0000 7fcb82800640 1 -- 172.21.15.47:0/1414180702 learned_addr learned my addr 172.21.15.47:0/1414180702 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.314+0000 7fcb81400640 1 --2- 172.21.15.47:0/1414180702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb841f4ae0 0x7fcb840b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.314+0000 7fcb81e00640 1 --2- 172.21.15.47:0/1414180702 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb680051c0 0x7fcb840cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.314+0000 7fcb82800640 1 -- 172.21.15.47:0/1414180702 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb680051c0 msgr2=0x7fcb840cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:58.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.314+0000 7fcb82800640 1 --2- 172.21.15.47:0/1414180702 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb680051c0 0x7fcb840cc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.314+0000 7fcb82800640 1 -- 172.21.15.47:0/1414180702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb841f4ae0 msgr2=0x7fcb840b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:58.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.314+0000 7fcb82800640 1 --2- 172.21.15.47:0/1414180702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb841f4ae0 0x7fcb840b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.314+0000 7fcb82800640 1 -- 172.21.15.47:0/1414180702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb841f8070 con 0x7fcb841f8830 2024-05-27T10:52:58.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.314+0000 7fcb82800640 1 --2- 172.21.15.47:0/1414180702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb841f8830 0x7fcb840d2710 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c02a590 tx=0x7fcb7c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:58.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.314+0000 7fcb7a000640 1 -- 172.21.15.47:0/1414180702 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c0054a0 con 0x7fcb841f8830 2024-05-27T10:52:58.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.314+0000 7fcb7a000640 1 -- 172.21.15.47:0/1414180702 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb7c000ed0 con 0x7fcb841f8830 2024-05-27T10:52:58.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.314+0000 7fcb7a000640 1 -- 172.21.15.47:0/1414180702 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c004e00 con 0x7fcb841f8830 2024-05-27T10:52:58.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.314+0000 7fcb88c00640 1 -- 172.21.15.47:0/1414180702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb841f4860 con 0x7fcb841f8830 2024-05-27T10:52:58.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.315+0000 7fcb88c00640 1 -- 172.21.15.47:0/1414180702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb840cd310 con 0x7fcb841f8830 2024-05-27T10:52:58.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.316+0000 7fcb88c00640 1 -- 172.21.15.47:0/1414180702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb8404fdc0 con 0x7fcb841f8830 2024-05-27T10:52:58.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.317+0000 7fcb7a000640 1 -- 172.21.15.47:0/1414180702 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb7c007030 con 0x7fcb841f8830 2024-05-27T10:52:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.318+0000 7fcb7a000640 1 --2- 172.21.15.47:0/1414180702 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fcb6406ca90 0x7fcb6406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.318+0000 7fcb7a000640 1 -- 172.21.15.47:0/1414180702 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fcb7c0aad00 con 0x7fcb841f8830 2024-05-27T10:52:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.318+0000 7fcb81e00640 1 --2- 172.21.15.47:0/1414180702 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fcb6406ca90 0x7fcb6406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:58.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.319+0000 7fcb81e00640 1 --2- 172.21.15.47:0/1414180702 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fcb6406ca90 0x7fcb6406ef50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009910 tx=0x7fcb74008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:58.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.323+0000 7fcb7a000640 1 -- 172.21.15.47:0/1414180702 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcb7c044030 con 0x7fcb841f8830 2024-05-27T10:52:58.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.525+0000 7fcb88c00640 1 -- 172.21.15.47:0/1414180702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcb8406e1e0 con 0x7fcb841f8830 2024-05-27T10:52:58.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.526+0000 7fcb7a000640 1 -- 172.21.15.47:0/1414180702 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fcb7c02ae20 con 0x7fcb841f8830 2024-05-27T10:52:58.524 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-27T10:52:58.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.529+0000 7fcb88c00640 1 -- 172.21.15.47:0/1414180702 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fcb6406ca90 msgr2=0x7fcb6406ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:58.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.529+0000 7fcb88c00640 1 --2- 172.21.15.47:0/1414180702 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fcb6406ca90 0x7fcb6406ef50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009910 tx=0x7fcb74008040 comp rx=0 tx=0).stop 2024-05-27T10:52:58.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.529+0000 7fcb88c00640 1 -- 172.21.15.47:0/1414180702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb841f8830 msgr2=0x7fcb840d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:58.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.529+0000 7fcb88c00640 1 --2- 172.21.15.47:0/1414180702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb841f8830 0x7fcb840d2710 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c02a590 tx=0x7fcb7c001120 comp rx=0 tx=0).stop 2024-05-27T10:52:58.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.529+0000 7fcb88c00640 1 -- 172.21.15.47:0/1414180702 shutdown_connections 2024-05-27T10:52:58.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.529+0000 7fcb88c00640 1 --2- 172.21.15.47:0/1414180702 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fcb6406ca90 0x7fcb6406ef50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.529+0000 7fcb88c00640 1 --2- 172.21.15.47:0/1414180702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb841f8830 0x7fcb840d2710 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.529+0000 7fcb88c00640 1 --2- 172.21.15.47:0/1414180702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb841f4ae0 0x7fcb840b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.529+0000 7fcb88c00640 1 --2- 172.21.15.47:0/1414180702 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb680051c0 0x7fcb840cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.529+0000 7fcb88c00640 1 -- 172.21.15.47:0/1414180702 >> 172.21.15.47:0/1414180702 conn(0x7fcb8408bfd0 msgr2=0x7fcb84156ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:58.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.529+0000 7fcb88c00640 1 -- 172.21.15.47:0/1414180702 shutdown_connections 2024-05-27T10:52:58.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.529+0000 7fcb88c00640 1 -- 172.21.15.47:0/1414180702 wait complete. 2024-05-27T10:52:58.545 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T10:52:58.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.747+0000 7fe1ad600640 1 Processor -- start 2024-05-27T10:52:58.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.747+0000 7fe1ad600640 1 -- start start 2024-05-27T10:52:58.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.748+0000 7fe1ad600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1a806f480 0x7fe1a80cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:58.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.749+0000 7fe1ad600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe1a80cd680 0x7fe1a80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:58.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.749+0000 7fe1ad600640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1a815fef0 con 0x7fe1a815c370 2024-05-27T10:52:58.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.749+0000 7fe1ad600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe1a80cdd90 con 0x7fe1a80cd680 2024-05-27T10:52:58.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.749+0000 7fe1ad600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a80cdb10 con 0x7fe1a806f480 2024-05-27T10:52:58.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.749+0000 7fe1a7400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe1a80cd680 0x7fe1a80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:58.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.749+0000 7fe1a7400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe1a80cd680 0x7fe1a80cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45066/0 (socket says 172.21.15.47:45066) 2024-05-27T10:52:58.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.749+0000 7fe1a7400640 1 -- 172.21.15.47:0/2039811033 learned_addr learned my addr 172.21.15.47:0/2039811033 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:58.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.749+0000 7fe1a6000640 1 --2- 172.21.15.47:0/2039811033 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1a806f480 0x7fe1a80cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:58.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.749+0000 7fe1a7400640 1 -- 172.21.15.47:0/2039811033 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1a806f480 msgr2=0x7fe1a80cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:58.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.749+0000 7fe1a7400640 1 --2- 172.21.15.47:0/2039811033 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1a806f480 0x7fe1a80cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.749+0000 7fe1a7400640 1 -- 172.21.15.47:0/2039811033 >> v1:172.21.15.53:6789/0 conn(0x7fe1a815c370 legacy=0x7fe1a806ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:58.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.750+0000 7fe1a7400640 1 -- 172.21.15.47:0/2039811033 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a815f130 con 0x7fe1a80cd680 2024-05-27T10:52:58.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.750+0000 7fe1a7400640 1 --2- 172.21.15.47:0/2039811033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1a80cd680 0x7fe1a80cf290 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009870 tx=0x7fe1a002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b704636aa62746da server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:58.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.751+0000 7fe1a5600640 1 -- 172.21.15.47:0/2039811033 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0037070 con 0x7fe1a80cd680 2024-05-27T10:52:58.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.751+0000 7fe1a5600640 1 -- 172.21.15.47:0/2039811033 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a0032440 con 0x7fe1a80cd680 2024-05-27T10:52:58.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.751+0000 7fe1a5600640 1 -- 172.21.15.47:0/2039811033 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0032810 con 0x7fe1a80cd680 2024-05-27T10:52:58.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.751+0000 7fe1ad600640 1 -- 172.21.15.47:0/2039811033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1a80cd680 msgr2=0x7fe1a80cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:58.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.751+0000 7fe1ad600640 1 --2- 172.21.15.47:0/2039811033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1a80cd680 0x7fe1a80cf290 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009870 tx=0x7fe1a002a1c0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.751+0000 7fe1ad600640 1 -- 172.21.15.47:0/2039811033 shutdown_connections 2024-05-27T10:52:58.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.751+0000 7fe1ad600640 1 --2- 172.21.15.47:0/2039811033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1a80cd680 0x7fe1a80cf290 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.751+0000 7fe1ad600640 1 --2- 172.21.15.47:0/2039811033 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1a806f480 0x7fe1a80cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.751+0000 7fe1ad600640 1 -- 172.21.15.47:0/2039811033 >> 172.21.15.47:0/2039811033 conn(0x7fe1a80b21e0 msgr2=0x7fe1a80b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:58.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.752+0000 7fe1ad600640 1 -- 172.21.15.47:0/2039811033 shutdown_connections 2024-05-27T10:52:58.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.752+0000 7fe1ad600640 1 -- 172.21.15.47:0/2039811033 wait complete. 2024-05-27T10:52:58.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.753+0000 7fe1ad600640 1 Processor -- start 2024-05-27T10:52:58.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.753+0000 7fe1ad600640 1 -- start start 2024-05-27T10:52:58.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.754+0000 7fe1ad600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1a806f480 0x7fe1a815d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:58.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.754+0000 7fe1ad600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1a80cd680 0x7fe1a815de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:58.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.754+0000 7fe1ad600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1a815c370 0x7fe1a814e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:58.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.754+0000 7fe1ad600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a815f9d0 con 0x7fe1a80cd680 2024-05-27T10:52:58.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.754+0000 7fe1ad600640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a815f6f0 con 0x7fe1a815c370 2024-05-27T10:52:58.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.754+0000 7fe1ad600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a80b3ba0 con 0x7fe1a806f480 2024-05-27T10:52:58.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.755+0000 7fe1a6000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1a80cd680 0x7fe1a815de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:58.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.755+0000 7fe1a6000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1a80cd680 0x7fe1a815de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45080/0 (socket says 172.21.15.47:45080) 2024-05-27T10:52:58.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.755+0000 7fe1a6000640 1 -- 172.21.15.47:0/3211110847 learned_addr learned my addr 172.21.15.47:0/3211110847 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:58.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.755+0000 7fe1a6000640 1 -- 172.21.15.47:0/3211110847 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1a806f480 msgr2=0x7fe1a815d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:58.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.755+0000 7fe1a7400640 1 --2- 172.21.15.47:0/3211110847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1a815c370 0x7fe1a814e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:58.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.755+0000 7fe1a6a00640 1 --2- 172.21.15.47:0/3211110847 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1a806f480 0x7fe1a815d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:58.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.755+0000 7fe1a6000640 1 --2- 172.21.15.47:0/3211110847 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1a806f480 0x7fe1a815d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.755+0000 7fe1a6000640 1 -- 172.21.15.47:0/3211110847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1a815c370 msgr2=0x7fe1a814e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:58.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.755+0000 7fe1a6000640 1 --2- 172.21.15.47:0/3211110847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1a815c370 0x7fe1a814e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.755+0000 7fe1a6000640 1 -- 172.21.15.47:0/3211110847 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a814d950 con 0x7fe1a80cd680 2024-05-27T10:52:58.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.755+0000 7fe1a7400640 1 --2- 172.21.15.47:0/3211110847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1a815c370 0x7fe1a814e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:58.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.755+0000 7fe1a6000640 1 --2- 172.21.15.47:0/3211110847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1a80cd680 0x7fe1a815de10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe19000d800 tx=0x7fe19000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:58.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.756+0000 7fe19ea00640 1 -- 172.21.15.47:0/3211110847 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19000b6c0 con 0x7fe1a80cd680 2024-05-27T10:52:58.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.756+0000 7fe19ea00640 1 -- 172.21.15.47:0/3211110847 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe190019070 con 0x7fe1a80cd680 2024-05-27T10:52:58.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.756+0000 7fe19ea00640 1 -- 172.21.15.47:0/3211110847 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19000ba80 con 0x7fe1a80cd680 2024-05-27T10:52:58.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.756+0000 7fe1ad600640 1 -- 172.21.15.47:0/3211110847 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a814f120 con 0x7fe1a80cd680 2024-05-27T10:52:58.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.756+0000 7fe1ad600640 1 -- 172.21.15.47:0/3211110847 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a8151cd0 con 0x7fe1a80cd680 2024-05-27T10:52:58.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.757+0000 7fe1ad600640 1 -- 172.21.15.47:0/3211110847 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a8073800 con 0x7fe1a80cd680 2024-05-27T10:52:58.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.758+0000 7fe19ea00640 1 -- 172.21.15.47:0/3211110847 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe19000bc20 con 0x7fe1a80cd680 2024-05-27T10:52:58.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.759+0000 7fe19ea00640 1 --2- 172.21.15.47:0/3211110847 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe18406c8f0 0x7fe18406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:58.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.759+0000 7fe19ea00640 1 -- 172.21.15.47:0/3211110847 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fe19008c160 con 0x7fe1a80cd680 2024-05-27T10:52:58.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.759+0000 7fe1a6a00640 1 --2- 172.21.15.47:0/3211110847 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe18406c8f0 0x7fe18406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:58.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.760+0000 7fe1a6a00640 1 --2- 172.21.15.47:0/3211110847 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe18406c8f0 0x7fe18406edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe198007fd0 tx=0x7fe198009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:58.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.763+0000 7fe19ea00640 1 -- 172.21.15.47:0/3211110847 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe1a814d950 con 0x7fe1a80cd680 2024-05-27T10:52:58.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.956+0000 7fe1ad600640 1 -- 172.21.15.47:0/3211110847 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe1a804fdc0 con 0x7fe1a80cd680 2024-05-27T10:52:58.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.957+0000 7fe19ea00640 1 -- 172.21.15.47:0/3211110847 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fe19001c360 con 0x7fe1a80cd680 2024-05-27T10:52:58.955 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-27T10:52:58.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.959+0000 7fe1ad600640 1 -- 172.21.15.47:0/3211110847 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe18406c8f0 msgr2=0x7fe18406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:58.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.959+0000 7fe1ad600640 1 --2- 172.21.15.47:0/3211110847 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe18406c8f0 0x7fe18406edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe198007fd0 tx=0x7fe198009040 comp rx=0 tx=0).stop 2024-05-27T10:52:58.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.959+0000 7fe1ad600640 1 -- 172.21.15.47:0/3211110847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1a80cd680 msgr2=0x7fe1a815de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:58.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.959+0000 7fe1ad600640 1 --2- 172.21.15.47:0/3211110847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1a80cd680 0x7fe1a815de10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe19000d800 tx=0x7fe19000dcc0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.959+0000 7fe1ad600640 1 -- 172.21.15.47:0/3211110847 shutdown_connections 2024-05-27T10:52:58.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.959+0000 7fe1ad600640 1 --2- 172.21.15.47:0/3211110847 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe18406c8f0 0x7fe18406edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.959+0000 7fe1ad600640 1 --2- 172.21.15.47:0/3211110847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1a815c370 0x7fe1a814e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.959+0000 7fe1ad600640 1 --2- 172.21.15.47:0/3211110847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1a80cd680 0x7fe1a815de10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.959+0000 7fe1ad600640 1 --2- 172.21.15.47:0/3211110847 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1a806f480 0x7fe1a815d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:58.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.959+0000 7fe1ad600640 1 -- 172.21.15.47:0/3211110847 >> 172.21.15.47:0/3211110847 conn(0x7fe1a80b21e0 msgr2=0x7fe1a806dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:58.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.959+0000 7fe1ad600640 1 -- 172.21.15.47:0/3211110847 shutdown_connections 2024-05-27T10:52:58.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:58.959+0000 7fe1ad600640 1 -- 172.21.15.47:0/3211110847 wait complete. 2024-05-27T10:52:58.976 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T10:52:59.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.190+0000 7f2e7ce00640 1 Processor -- start 2024-05-27T10:52:59.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.191+0000 7f2e7ce00640 1 -- start start 2024-05-27T10:52:59.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.192+0000 7f2e7ce00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2e7815e630 0x7f2e780d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:59.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.192+0000 7f2e7ce00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e780b6670 0x7f2e780d3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:59.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.192+0000 7f2e7ce00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e780ced40 con 0x7f2e780cfde0 2024-05-27T10:52:59.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.192+0000 7f2e7ce00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f2e780cf950 con 0x7f2e780b6670 2024-05-27T10:52:59.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.192+0000 7f2e7ce00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f2e780cf020 con 0x7f2e7815e630 2024-05-27T10:52:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.193+0000 7f2e6fe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f2e780cfde0 0x7f2e780b5f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49216/0 (socket says 172.21.15.47:49216) 2024-05-27T10:52:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.193+0000 7f2e6fe00640 1 -- 172.21.15.47:0/3160974671 learned_addr learned my addr 172.21.15.47:0/3160974671 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:52:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.193+0000 7f2e77e00640 1 --2- 172.21.15.47:0/3160974671 >> v2:172.21.15.53:3300/0 conn(0x7f2e780b6670 0x7f2e780d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.193+0000 7f2e77400640 1 --2- 172.21.15.47:0/3160974671 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2e7815e630 0x7f2e780d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:59.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.194+0000 7f2e76a00640 1 -- 172.21.15.47:0/3160974671 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 487485040 0 0) 0x7f2e780ced40 con 0x7f2e780cfde0 2024-05-27T10:52:59.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.194+0000 7f2e76a00640 1 -- 172.21.15.47:0/3160974671 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e5c003520 con 0x7f2e780cfde0 2024-05-27T10:52:59.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.194+0000 7f2e77e00640 1 -- 172.21.15.47:0/3160974671 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2e7815e630 msgr2=0x7f2e780d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:59.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.194+0000 7f2e77e00640 1 --2- 172.21.15.47:0/3160974671 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2e7815e630 0x7f2e780d3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:59.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.194+0000 7f2e77e00640 1 -- 172.21.15.47:0/3160974671 >> v1:172.21.15.47:6789/0 conn(0x7f2e780cfde0 legacy=0x7f2e780b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:59.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.194+0000 7f2e77e00640 1 -- 172.21.15.47:0/3160974671 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e780cf300 con 0x7f2e780b6670 2024-05-27T10:52:59.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.196+0000 7f2e77e00640 1 --2- 172.21.15.47:0/3160974671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e780b6670 0x7f2e780d3770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2e70009d90 tx=0x7f2e7002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b7297ce92d139d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:59.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.196+0000 7f2e76a00640 1 -- 172.21.15.47:0/3160974671 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e70007740 con 0x7f2e780b6670 2024-05-27T10:52:59.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.196+0000 7f2e76a00640 1 -- 172.21.15.47:0/3160974671 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e700078e0 con 0x7f2e780b6670 2024-05-27T10:52:59.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.196+0000 7f2e76a00640 1 -- 172.21.15.47:0/3160974671 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e70007cb0 con 0x7f2e780b6670 2024-05-27T10:52:59.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.197+0000 7f2e7ce00640 1 -- 172.21.15.47:0/3160974671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e780b6670 msgr2=0x7f2e780d3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:59.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.197+0000 7f2e7ce00640 1 --2- 172.21.15.47:0/3160974671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e780b6670 0x7f2e780d3770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2e70009d90 tx=0x7f2e7002a660 comp rx=0 tx=0).stop 2024-05-27T10:52:59.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.197+0000 7f2e7ce00640 1 -- 172.21.15.47:0/3160974671 shutdown_connections 2024-05-27T10:52:59.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.197+0000 7f2e7ce00640 1 --2- 172.21.15.47:0/3160974671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e780b6670 0x7f2e780d3770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:59.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.197+0000 7f2e7ce00640 1 --2- 172.21.15.47:0/3160974671 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2e7815e630 0x7f2e780d3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:59.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.197+0000 7f2e7ce00640 1 -- 172.21.15.47:0/3160974671 >> 172.21.15.47:0/3160974671 conn(0x7f2e7808bfd0 msgr2=0x7f2e780d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:59.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.197+0000 7f2e7ce00640 1 -- 172.21.15.47:0/3160974671 shutdown_connections 2024-05-27T10:52:59.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.197+0000 7f2e7ce00640 1 -- 172.21.15.47:0/3160974671 wait complete. 2024-05-27T10:52:59.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.200+0000 7f2e7ce00640 1 Processor -- start 2024-05-27T10:52:59.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.200+0000 7f2e7ce00640 1 -- start start 2024-05-27T10:52:59.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.201+0000 7f2e7ce00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2e780b6670 0x7f2e78161810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:59.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.202+0000 7f2e7ce00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e780cfde0 0x7f2e7815b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:59.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.202+0000 7f2e7ce00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e7815e630 0x7f2e780b9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:59.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.202+0000 7f2e7ce00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7815eb90 con 0x7f2e780cfde0 2024-05-27T10:52:59.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.202+0000 7f2e7ce00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7815ea10 con 0x7f2e7815e630 2024-05-27T10:52:59.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.202+0000 7f2e7ce00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f2e781685f0 con 0x7f2e780b6670 2024-05-27T10:52:59.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.202+0000 7f2e6fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e780cfde0 0x7f2e7815b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:59.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.202+0000 7f2e6fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e780cfde0 0x7f2e7815b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45088/0 (socket says 172.21.15.47:45088) 2024-05-27T10:52:59.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.202+0000 7f2e6fe00640 1 -- 172.21.15.47:0/949309969 learned_addr learned my addr 172.21.15.47:0/949309969 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:59.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.202+0000 7f2e77400640 1 --2- 172.21.15.47:0/949309969 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2e780b6670 0x7f2e78161810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:59.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.202+0000 7f2e77e00640 1 --2- 172.21.15.47:0/949309969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e7815e630 0x7f2e780b9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:59.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.202+0000 7f2e6fe00640 1 -- 172.21.15.47:0/949309969 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2e780b6670 msgr2=0x7f2e78161810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:59.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.202+0000 7f2e6fe00640 1 --2- 172.21.15.47:0/949309969 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2e780b6670 0x7f2e78161810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:59.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.202+0000 7f2e6fe00640 1 -- 172.21.15.47:0/949309969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e7815e630 msgr2=0x7f2e780b9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:59.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.202+0000 7f2e6fe00640 1 --2- 172.21.15.47:0/949309969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e7815e630 0x7f2e780b9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:59.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.202+0000 7f2e6fe00640 1 -- 172.21.15.47:0/949309969 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e7815c0b0 con 0x7f2e780cfde0 2024-05-27T10:52:59.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.203+0000 7f2e6fe00640 1 --2- 172.21.15.47:0/949309969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e780cfde0 0x7f2e7815b630 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000c430 tx=0x7f2e6000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:59.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.203+0000 7f2e6f400640 1 -- 172.21.15.47:0/949309969 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e60017070 con 0x7f2e780cfde0 2024-05-27T10:52:59.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.203+0000 7f2e6f400640 1 -- 172.21.15.47:0/949309969 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e60005ce0 con 0x7f2e780cfde0 2024-05-27T10:52:59.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.203+0000 7f2e6f400640 1 -- 172.21.15.47:0/949309969 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e600072f0 con 0x7f2e780cfde0 2024-05-27T10:52:59.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.203+0000 7f2e7ce00640 1 -- 172.21.15.47:0/949309969 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e7815c390 con 0x7f2e780cfde0 2024-05-27T10:52:59.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.203+0000 7f2e7ce00640 1 -- 172.21.15.47:0/949309969 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e7815c950 con 0x7f2e780cfde0 2024-05-27T10:52:59.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.204+0000 7f2e7ce00640 1 -- 172.21.15.47:0/949309969 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e7804fce0 con 0x7f2e780cfde0 2024-05-27T10:52:59.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.206+0000 7f2e6f400640 1 -- 172.21.15.47:0/949309969 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e6001a070 con 0x7f2e780cfde0 2024-05-27T10:52:59.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.207+0000 7f2e6f400640 1 --2- 172.21.15.47:0/949309969 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2e5406c8f0 0x7f2e5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:59.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.207+0000 7f2e6f400640 1 -- 172.21.15.47:0/949309969 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f2e6008b0c0 con 0x7f2e780cfde0 2024-05-27T10:52:59.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.207+0000 7f2e77400640 1 --2- 172.21.15.47:0/949309969 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2e5406c8f0 0x7f2e5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:59.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.208+0000 7f2e77400640 1 --2- 172.21.15.47:0/949309969 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2e5406c8f0 0x7f2e5406edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2e68009a30 tx=0x7f2e68008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:59.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.211+0000 7f2e6f400640 1 -- 172.21.15.47:0/949309969 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2e60059460 con 0x7f2e780cfde0 2024-05-27T10:52:59.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.415+0000 7f2e7ce00640 1 -- 172.21.15.47:0/949309969 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2e78157ce0 con 0x7f2e780cfde0 2024-05-27T10:52:59.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.416+0000 7f2e6f400640 1 -- 172.21.15.47:0/949309969 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f2e60058d60 con 0x7f2e780cfde0 2024-05-27T10:52:59.414 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-27T10:52:59.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.420+0000 7f2e7ce00640 1 -- 172.21.15.47:0/949309969 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2e5406c8f0 msgr2=0x7f2e5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:59.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.420+0000 7f2e7ce00640 1 --2- 172.21.15.47:0/949309969 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2e5406c8f0 0x7f2e5406edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2e68009a30 tx=0x7f2e68008040 comp rx=0 tx=0).stop 2024-05-27T10:52:59.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.420+0000 7f2e7ce00640 1 -- 172.21.15.47:0/949309969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e780cfde0 msgr2=0x7f2e7815b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:59.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.420+0000 7f2e7ce00640 1 --2- 172.21.15.47:0/949309969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e780cfde0 0x7f2e7815b630 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000c430 tx=0x7f2e6000c8f0 comp rx=0 tx=0).stop 2024-05-27T10:52:59.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.420+0000 7f2e7ce00640 1 -- 172.21.15.47:0/949309969 shutdown_connections 2024-05-27T10:52:59.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.420+0000 7f2e7ce00640 1 --2- 172.21.15.47:0/949309969 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2e5406c8f0 0x7f2e5406edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:59.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.420+0000 7f2e7ce00640 1 --2- 172.21.15.47:0/949309969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e7815e630 0x7f2e780b9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:59.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.420+0000 7f2e7ce00640 1 --2- 172.21.15.47:0/949309969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e780cfde0 0x7f2e7815b630 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:59.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.420+0000 7f2e7ce00640 1 --2- 172.21.15.47:0/949309969 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2e780b6670 0x7f2e78161810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:59.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.420+0000 7f2e7ce00640 1 -- 172.21.15.47:0/949309969 >> 172.21.15.47:0/949309969 conn(0x7f2e7808bfd0 msgr2=0x7f2e780d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:59.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.420+0000 7f2e7ce00640 1 -- 172.21.15.47:0/949309969 shutdown_connections 2024-05-27T10:52:59.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.420+0000 7f2e7ce00640 1 -- 172.21.15.47:0/949309969 wait complete. 2024-05-27T10:52:59.437 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T10:52:59.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.654+0000 7f4937e00640 1 Processor -- start 2024-05-27T10:52:59.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.654+0000 7f4937e00640 1 -- start start 2024-05-27T10:52:59.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.656+0000 7f4937e00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4930160020 0x7f4930071d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:59.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.656+0000 7f4937e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f493015fae0 0x7f4930072250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:59.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.656+0000 7f4937e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49300af3f0 con 0x7f4930144dd0 2024-05-27T10:52:59.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.656+0000 7f4937e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f49300af1b0 con 0x7f493015fae0 2024-05-27T10:52:59.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.656+0000 7f4937e00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f49300af6d0 con 0x7f4930160020 2024-05-27T10:52:59.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.656+0000 7f4935e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f493015fae0 0x7f4930072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:59.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.656+0000 7f4935e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f493015fae0 0x7f4930072250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45094/0 (socket says 172.21.15.47:45094) 2024-05-27T10:52:59.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.656+0000 7f4935e00640 1 -- 172.21.15.47:0/3997076612 learned_addr learned my addr 172.21.15.47:0/3997076612 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:59.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.656+0000 7f4935400640 1 --1- 172.21.15.47:0/3997076612 >> v1:172.21.15.47:6789/0 conn(0x7f4930144dd0 0x7f49300aeaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49218/0 (socket says 172.21.15.47:49218) 2024-05-27T10:52:59.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.657+0000 7f4935e00640 1 -- 172.21.15.47:0/3997076612 >> v2:172.21.15.53:3300/0 conn(0x7f4930160020 msgr2=0x7f4930071d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:52:59.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.657+0000 7f4934a00640 1 --2- 172.21.15.47:0/3997076612 >> v2:172.21.15.53:3300/0 conn(0x7f4930160020 0x7f4930071d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:59.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.657+0000 7f4935e00640 1 --2- 172.21.15.47:0/3997076612 >> v2:172.21.15.53:3300/0 conn(0x7f4930160020 0x7f4930071d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:59.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.657+0000 7f4935e00640 1 -- 172.21.15.47:0/3997076612 >> v1:172.21.15.47:6789/0 conn(0x7f4930144dd0 legacy=0x7f49300aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:59.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.657+0000 7f4935e00640 1 -- 172.21.15.47:0/3997076612 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49300af9b0 con 0x7f493015fae0 2024-05-27T10:52:59.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.657+0000 7f4934a00640 1 --2- 172.21.15.47:0/3997076612 >> v2:172.21.15.53:3300/0 conn(0x7f4930160020 0x7f4930071d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:59.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.658+0000 7f4935e00640 1 --2- 172.21.15.47:0/3997076612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f493015fae0 0x7f4930072250 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4930072a50 tx=0x7f492802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bd6b7ae4c26c62 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:59.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.658+0000 7f492fe00640 1 -- 172.21.15.47:0/3997076612 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4928037070 con 0x7f493015fae0 2024-05-27T10:52:59.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.658+0000 7f492fe00640 1 -- 172.21.15.47:0/3997076612 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4928032440 con 0x7f493015fae0 2024-05-27T10:52:59.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.658+0000 7f492fe00640 1 -- 172.21.15.47:0/3997076612 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4928032810 con 0x7f493015fae0 2024-05-27T10:52:59.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.659+0000 7f4937e00640 1 -- 172.21.15.47:0/3997076612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f493015fae0 msgr2=0x7f4930072250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:59.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.659+0000 7f4937e00640 1 --2- 172.21.15.47:0/3997076612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f493015fae0 0x7f4930072250 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4930072a50 tx=0x7f492802a270 comp rx=0 tx=0).stop 2024-05-27T10:52:59.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.659+0000 7f4937e00640 1 -- 172.21.15.47:0/3997076612 shutdown_connections 2024-05-27T10:52:59.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.659+0000 7f4937e00640 1 --2- 172.21.15.47:0/3997076612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f493015fae0 0x7f4930072250 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:59.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.659+0000 7f4937e00640 1 --2- 172.21.15.47:0/3997076612 >> v2:172.21.15.53:3300/0 conn(0x7f4930160020 0x7f4930071d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:59.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.659+0000 7f4937e00640 1 -- 172.21.15.47:0/3997076612 >> 172.21.15.47:0/3997076612 conn(0x7f493006b940 msgr2=0x7f493006bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:59.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.659+0000 7f4937e00640 1 -- 172.21.15.47:0/3997076612 shutdown_connections 2024-05-27T10:52:59.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.659+0000 7f4937e00640 1 -- 172.21.15.47:0/3997076612 wait complete. 2024-05-27T10:52:59.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.661+0000 7f4937e00640 1 Processor -- start 2024-05-27T10:52:59.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.661+0000 7f4937e00640 1 -- start start 2024-05-27T10:52:59.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.662+0000 7f4937e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4930144dd0 0x7f49301f17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:59.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.662+0000 7f4937e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f493015fae0 0x7f4930142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:59.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.662+0000 7f4937e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4930160020 0x7f49301430e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:59.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.662+0000 7f4937e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f493006dee0 con 0x7f4930160020 2024-05-27T10:52:59.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.662+0000 7f4937e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f49301451b0 con 0x7f493015fae0 2024-05-27T10:52:59.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.662+0000 7f4937e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f493006e060 con 0x7f4930144dd0 2024-05-27T10:52:59.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.662+0000 7f4935e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4930160020 0x7f49301430e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:59.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.662+0000 7f4935e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4930160020 0x7f49301430e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45102/0 (socket says 172.21.15.47:45102) 2024-05-27T10:52:59.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.662+0000 7f4935e00640 1 -- 172.21.15.47:0/2488518367 learned_addr learned my addr 172.21.15.47:0/2488518367 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:52:59.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.663+0000 7f4935400640 1 --2- 172.21.15.47:0/2488518367 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4930144dd0 0x7f49301f17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:59.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.663+0000 7f4935e00640 1 -- 172.21.15.47:0/2488518367 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4930144dd0 msgr2=0x7f49301f17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:59.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.663+0000 7f4935e00640 1 --2- 172.21.15.47:0/2488518367 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4930144dd0 0x7f49301f17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:59.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.663+0000 7f4935e00640 1 -- 172.21.15.47:0/2488518367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f493015fae0 msgr2=0x7f4930142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:59.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.663+0000 7f4935e00640 1 --2- 172.21.15.47:0/2488518367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f493015fae0 0x7f4930142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:59.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.663+0000 7f4935e00640 1 -- 172.21.15.47:0/2488518367 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49301f5230 con 0x7f4930160020 2024-05-27T10:52:59.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.663+0000 7f4935400640 1 --2- 172.21.15.47:0/2488518367 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4930144dd0 0x7f49301f17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:52:59.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.663+0000 7f4935e00640 1 --2- 172.21.15.47:0/2488518367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4930160020 0x7f49301430e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f49280090b0 tx=0x7f49280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:59.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.663+0000 7f492d600640 1 -- 172.21.15.47:0/2488518367 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4928037040 con 0x7f4930160020 2024-05-27T10:52:59.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.663+0000 7f492d600640 1 -- 172.21.15.47:0/2488518367 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4928042070 con 0x7f4930160020 2024-05-27T10:52:59.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.663+0000 7f492d600640 1 -- 172.21.15.47:0/2488518367 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4928030bd0 con 0x7f4930160020 2024-05-27T10:52:59.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.663+0000 7f4937e00640 1 -- 172.21.15.47:0/2488518367 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49300cd090 con 0x7f4930160020 2024-05-27T10:52:59.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.663+0000 7f4937e00640 1 -- 172.21.15.47:0/2488518367 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49301f1d00 con 0x7f4930160020 2024-05-27T10:52:59.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.665+0000 7f4937e00640 1 -- 172.21.15.47:0/2488518367 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49300cce80 con 0x7f4930160020 2024-05-27T10:52:59.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.665+0000 7f492d600640 1 -- 172.21.15.47:0/2488518367 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4928047460 con 0x7f4930160020 2024-05-27T10:52:59.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.666+0000 7f492d600640 1 --2- 172.21.15.47:0/2488518367 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f491006c8f0 0x7f491006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:52:59.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.667+0000 7f492d600640 1 -- 172.21.15.47:0/2488518367 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f49280ac8a0 con 0x7f4930160020 2024-05-27T10:52:59.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.667+0000 7f4935400640 1 --2- 172.21.15.47:0/2488518367 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f491006c8f0 0x7f491006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:52:59.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.667+0000 7f4935400640 1 --2- 172.21.15.47:0/2488518367 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f491006c8f0 0x7f491006edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f49300b00d0 tx=0x7f4924009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:52:59.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.671+0000 7f492d600640 1 -- 172.21.15.47:0/2488518367 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f492807ac40 con 0x7f4930160020 2024-05-27T10:52:59.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.889+0000 7f4937e00640 1 -- 172.21.15.47:0/2488518367 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4930072570 con 0x7f4930160020 2024-05-27T10:52:59.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.889+0000 7f492d600640 1 -- 172.21.15.47:0/2488518367 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f492807a540 con 0x7f4930160020 2024-05-27T10:52:59.887 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-05-27T10:52:59.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.892+0000 7f4937e00640 1 -- 172.21.15.47:0/2488518367 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f491006c8f0 msgr2=0x7f491006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:59.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.892+0000 7f4937e00640 1 --2- 172.21.15.47:0/2488518367 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f491006c8f0 0x7f491006edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f49300b00d0 tx=0x7f4924009040 comp rx=0 tx=0).stop 2024-05-27T10:52:59.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.892+0000 7f4937e00640 1 -- 172.21.15.47:0/2488518367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4930160020 msgr2=0x7f49301430e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:52:59.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.892+0000 7f4937e00640 1 --2- 172.21.15.47:0/2488518367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4930160020 0x7f49301430e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f49280090b0 tx=0x7f49280046c0 comp rx=0 tx=0).stop 2024-05-27T10:52:59.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.892+0000 7f4937e00640 1 -- 172.21.15.47:0/2488518367 shutdown_connections 2024-05-27T10:52:59.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.892+0000 7f4937e00640 1 --2- 172.21.15.47:0/2488518367 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f491006c8f0 0x7f491006edb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:59.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.892+0000 7f4937e00640 1 --2- 172.21.15.47:0/2488518367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4930160020 0x7f49301430e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:59.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.892+0000 7f4937e00640 1 --2- 172.21.15.47:0/2488518367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f493015fae0 0x7f4930142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:59.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.892+0000 7f4937e00640 1 --2- 172.21.15.47:0/2488518367 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4930144dd0 0x7f49301f17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:52:59.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.892+0000 7f4937e00640 1 -- 172.21.15.47:0/2488518367 >> 172.21.15.47:0/2488518367 conn(0x7f493006b940 msgr2=0x7f49300aea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:52:59.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.893+0000 7f4937e00640 1 -- 172.21.15.47:0/2488518367 shutdown_connections 2024-05-27T10:52:59.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:52:59.893+0000 7f4937e00640 1 -- 172.21.15.47:0/2488518367 wait complete. 2024-05-27T10:52:59.910 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi047.front.sepia.ceph.com... 2024-05-27T10:52:59.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:59.910 DEBUG:teuthology.orchestra.run.smithi047:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-05-27T10:52:59.998 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T10:52:59.999 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-05-27T10:52:59.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:52:59.999 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-27T10:53:00.054 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:53:00.054 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:53:00.116 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:53:00.116 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:53:00.173 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:53:00.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.395+0000 7fb09a600640 1 Processor -- start 2024-05-27T10:53:00.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.395+0000 7fb09a600640 1 -- start start 2024-05-27T10:53:00.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.396+0000 7fb09a600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb09415c460 0x7fb0940ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:00.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.397+0000 7fb09a600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb094160140 con 0x7fb0940d0e10 2024-05-27T10:53:00.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.397+0000 7fb09a600640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb094160420 con 0x7fb09415c840 2024-05-27T10:53:00.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.397+0000 7fb09a600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb094160700 con 0x7fb09415c460 2024-05-27T10:53:00.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.397+0000 7fb093400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb09415c460 0x7fb0940ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:00.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.397+0000 7fb093400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb09415c460 0x7fb0940ad300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45112/0 (socket says 172.21.15.47:45112) 2024-05-27T10:53:00.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.397+0000 7fb093400640 1 -- 172.21.15.47:0/2213407093 learned_addr learned my addr 172.21.15.47:0/2213407093 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:00.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.397+0000 7fb093e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb0940d0e10 0x7fb09406def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49222/0 (socket says 172.21.15.47:49222) 2024-05-27T10:53:00.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.397+0000 7fb093400640 1 -- 172.21.15.47:0/2213407093 >> v1:172.21.15.53:6789/0 conn(0x7fb09415c840 legacy=0x7fb0940d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:00.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.398+0000 7fb093400640 1 -- 172.21.15.47:0/2213407093 >> v1:172.21.15.47:6789/0 conn(0x7fb0940d0e10 legacy=0x7fb09406def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:00.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.398+0000 7fb093400640 1 -- 172.21.15.47:0/2213407093 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0941609e0 con 0x7fb09415c460 2024-05-27T10:53:00.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.399+0000 7fb093400640 1 --2- 172.21.15.47:0/2213407093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb09415c460 0x7fb0940ad300 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb084009870 tx=0x7fb08402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4b3f54db2b99da server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:00.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.399+0000 7fb092000640 1 -- 172.21.15.47:0/2213407093 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb084037070 con 0x7fb09415c460 2024-05-27T10:53:00.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.399+0000 7fb092000640 1 -- 172.21.15.47:0/2213407093 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb084032440 con 0x7fb09415c460 2024-05-27T10:53:00.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.399+0000 7fb092000640 1 -- 172.21.15.47:0/2213407093 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb084032810 con 0x7fb09415c460 2024-05-27T10:53:00.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.399+0000 7fb09a600640 1 -- 172.21.15.47:0/2213407093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb09415c460 msgr2=0x7fb0940ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:00.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.399+0000 7fb09a600640 1 --2- 172.21.15.47:0/2213407093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb09415c460 0x7fb0940ad300 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb084009870 tx=0x7fb08402a210 comp rx=0 tx=0).stop 2024-05-27T10:53:00.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.400+0000 7fb09a600640 1 -- 172.21.15.47:0/2213407093 shutdown_connections 2024-05-27T10:53:00.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.400+0000 7fb09a600640 1 --2- 172.21.15.47:0/2213407093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb09415c460 0x7fb0940ad300 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:00.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.400+0000 7fb09a600640 1 -- 172.21.15.47:0/2213407093 >> 172.21.15.47:0/2213407093 conn(0x7fb09406bd60 msgr2=0x7fb09406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:00.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.400+0000 7fb09a600640 1 -- 172.21.15.47:0/2213407093 shutdown_connections 2024-05-27T10:53:00.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.400+0000 7fb09a600640 1 -- 172.21.15.47:0/2213407093 wait complete. 2024-05-27T10:53:00.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.401+0000 7fb09a600640 1 Processor -- start 2024-05-27T10:53:00.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.402+0000 7fb09a600640 1 -- start start 2024-05-27T10:53:00.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.402+0000 7fb09a600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0940d0e10 0x7fb0941575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:00.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.402+0000 7fb09a600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb09415c460 0x7fb0941f4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:00.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.402+0000 7fb09a600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb09415c840 0x7fb0941f4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:00.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.402+0000 7fb09a600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb0940ad840 con 0x7fb0940d0e10 2024-05-27T10:53:00.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.402+0000 7fb09a600640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb094160fa0 con 0x7fb09415c460 2024-05-27T10:53:00.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.403+0000 7fb09a600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb0940ad9c0 con 0x7fb09415c840 2024-05-27T10:53:00.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.403+0000 7fb093400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0940d0e10 0x7fb0941575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:00.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.403+0000 7fb093400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0940d0e10 0x7fb0941575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45126/0 (socket says 172.21.15.47:45126) 2024-05-27T10:53:00.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.403+0000 7fb093400640 1 -- 172.21.15.47:0/164416426 learned_addr learned my addr 172.21.15.47:0/164416426 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:00.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.403+0000 7fb093400640 1 -- 172.21.15.47:0/164416426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb09415c840 msgr2=0x7fb0941f4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:00.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.403+0000 7fb093400640 1 --2- 172.21.15.47:0/164416426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb09415c840 0x7fb0941f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:00.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.403+0000 7fb093400640 1 -- 172.21.15.47:0/164416426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb09415c460 msgr2=0x7fb0941f4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:00.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.403+0000 7fb093400640 1 --2- 172.21.15.47:0/164416426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb09415c460 0x7fb0941f4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:00.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.403+0000 7fb093400640 1 -- 172.21.15.47:0/164416426 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb094072d40 con 0x7fb0940d0e10 2024-05-27T10:53:00.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.404+0000 7fb093400640 1 --2- 172.21.15.47:0/164416426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0940d0e10 0x7fb0941575d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb084009870 tx=0x7fb0840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:00.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.404+0000 7fb08b400640 1 -- 172.21.15.47:0/164416426 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb084041070 con 0x7fb0940d0e10 2024-05-27T10:53:00.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.404+0000 7fb08b400640 1 -- 172.21.15.47:0/164416426 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb08403c870 con 0x7fb0940d0e10 2024-05-27T10:53:00.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.404+0000 7fb08b400640 1 -- 172.21.15.47:0/164416426 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb084037040 con 0x7fb0940d0e10 2024-05-27T10:53:00.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.404+0000 7fb09a600640 1 -- 172.21.15.47:0/164416426 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb094073020 con 0x7fb0940d0e10 2024-05-27T10:53:00.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.404+0000 7fb09a600640 1 -- 172.21.15.47:0/164416426 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0940735e0 con 0x7fb0940d0e10 2024-05-27T10:53:00.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.406+0000 7fb09a600640 1 -- 172.21.15.47:0/164416426 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0940689e0 con 0x7fb0940d0e10 2024-05-27T10:53:00.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.406+0000 7fb08b400640 1 -- 172.21.15.47:0/164416426 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb084044070 con 0x7fb0940d0e10 2024-05-27T10:53:00.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.407+0000 7fb08b400640 1 --2- 172.21.15.47:0/164416426 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb07406c940 0x7fb07406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:00.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.407+0000 7fb08b400640 1 -- 172.21.15.47:0/164416426 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fb0840ac6f0 con 0x7fb0940d0e10 2024-05-27T10:53:00.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.408+0000 7fb092a00640 1 --2- 172.21.15.47:0/164416426 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb07406c940 0x7fb07406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:00.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.408+0000 7fb092a00640 1 --2- 172.21.15.47:0/164416426 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb07406c940 0x7fb07406ee00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb080006fd0 tx=0x7fb080006bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:00.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.412+0000 7fb08b400640 1 -- 172.21.15.47:0/164416426 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb08407aca0 con 0x7fb0940d0e10 2024-05-27T10:53:00.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.615+0000 7fb09a600640 1 -- 172.21.15.47:0/164416426 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0940af500 con 0x7fb0940d0e10 2024-05-27T10:53:00.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.618+0000 7fb08b400640 1 -- 172.21.15.47:0/164416426 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16770 (secure 0 0 0) 0x7fb08407a5a0 con 0x7fb0940d0e10 2024-05-27T10:53:00.616 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:53:00.616 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":22,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:48.545555+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:53:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.621+0000 7fb09a600640 1 -- 172.21.15.47:0/164416426 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb07406c940 msgr2=0x7fb07406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.621+0000 7fb09a600640 1 --2- 172.21.15.47:0/164416426 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb07406c940 0x7fb07406ee00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb080006fd0 tx=0x7fb080006bc0 comp rx=0 tx=0).stop 2024-05-27T10:53:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.621+0000 7fb09a600640 1 -- 172.21.15.47:0/164416426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0940d0e10 msgr2=0x7fb0941575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.621+0000 7fb09a600640 1 --2- 172.21.15.47:0/164416426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0940d0e10 0x7fb0941575d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb084009870 tx=0x7fb0840046c0 comp rx=0 tx=0).stop 2024-05-27T10:53:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.621+0000 7fb09a600640 1 -- 172.21.15.47:0/164416426 shutdown_connections 2024-05-27T10:53:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.621+0000 7fb09a600640 1 --2- 172.21.15.47:0/164416426 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb07406c940 0x7fb07406ee00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.621+0000 7fb09a600640 1 --2- 172.21.15.47:0/164416426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb09415c840 0x7fb0941f4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.621+0000 7fb09a600640 1 --2- 172.21.15.47:0/164416426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb09415c460 0x7fb0941f4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.621+0000 7fb09a600640 1 --2- 172.21.15.47:0/164416426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0940d0e10 0x7fb0941575d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:00.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.621+0000 7fb09a600640 1 -- 172.21.15.47:0/164416426 >> 172.21.15.47:0/164416426 conn(0x7fb09406bd60 msgr2=0x7fb09415f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:00.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.621+0000 7fb09a600640 1 -- 172.21.15.47:0/164416426 shutdown_connections 2024-05-27T10:53:00.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.621+0000 7fb09a600640 1 -- 172.21.15.47:0/164416426 wait complete. 2024-05-27T10:53:00.640 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T10:51:55.073251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T10:51:59.202702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T10:52:00.664039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T10:53:00.640 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T10:53:00.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.855+0000 7f8023e00640 1 Processor -- start 2024-05-27T10:53:00.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.856+0000 7f8023e00640 1 -- start start 2024-05-27T10:53:00.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.857+0000 7f8023e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f802415e660 0x7f802406e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:00.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.857+0000 7f8023e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f80240d0a30 0x7f80240cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:00.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.857+0000 7f8023e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f802406f460 con 0x7f802406ee30 2024-05-27T10:53:00.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.857+0000 7f8023e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f80240b4440 con 0x7f80240d0a30 2024-05-27T10:53:00.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.857+0000 7f8023e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f80240b4720 con 0x7f802415e660 2024-05-27T10:53:00.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.858+0000 7f801be00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f802406ee30 0x7f80240d0320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51618/0 (socket says 172.21.15.47:51618) 2024-05-27T10:53:00.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.858+0000 7f801be00640 1 -- 172.21.15.47:0/3723894577 learned_addr learned my addr 172.21.15.47:0/3723894577 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:00.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.858+0000 7f8023400640 1 --2- 172.21.15.47:0/3723894577 >> v2:172.21.15.47:3300/0 conn(0x7f80240d0a30 0x7f80240cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:00.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.858+0000 7f8022a00640 1 --2- 172.21.15.47:0/3723894577 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f802415e660 0x7f802406e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:00.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.858+0000 7f8023400640 1 -- 172.21.15.47:0/3723894577 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f802415e660 msgr2=0x7f802406e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:00.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.858+0000 7f8023400640 1 --2- 172.21.15.47:0/3723894577 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f802415e660 0x7f802406e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:00.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.858+0000 7f8023400640 1 -- 172.21.15.47:0/3723894577 >> v1:172.21.15.47:6789/0 conn(0x7f802406ee30 legacy=0x7f80240d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:00.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.858+0000 7f8023400640 1 -- 172.21.15.47:0/3723894577 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80240b4a00 con 0x7f80240d0a30 2024-05-27T10:53:00.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.859+0000 7f8023400640 1 --2- 172.21.15.47:0/3723894577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80240d0a30 0x7f80240cec80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f801c009d90 tx=0x7f801c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86db504d35b6159 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:00.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.860+0000 7f8022000640 1 -- 172.21.15.47:0/3723894577 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c007740 con 0x7f80240d0a30 2024-05-27T10:53:00.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.860+0000 7f8022000640 1 -- 172.21.15.47:0/3723894577 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f801c0078e0 con 0x7f80240d0a30 2024-05-27T10:53:00.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.860+0000 7f8022000640 1 -- 172.21.15.47:0/3723894577 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c007cb0 con 0x7f80240d0a30 2024-05-27T10:53:00.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.860+0000 7f8023e00640 1 -- 172.21.15.47:0/3723894577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80240d0a30 msgr2=0x7f80240cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:00.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.860+0000 7f8023e00640 1 --2- 172.21.15.47:0/3723894577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80240d0a30 0x7f80240cec80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f801c009d90 tx=0x7f801c02a660 comp rx=0 tx=0).stop 2024-05-27T10:53:00.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.860+0000 7f8023e00640 1 -- 172.21.15.47:0/3723894577 shutdown_connections 2024-05-27T10:53:00.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.860+0000 7f8023e00640 1 --2- 172.21.15.47:0/3723894577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80240d0a30 0x7f80240cec80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:00.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.860+0000 7f8023e00640 1 --2- 172.21.15.47:0/3723894577 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f802415e660 0x7f802406e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:00.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.861+0000 7f8023e00640 1 -- 172.21.15.47:0/3723894577 >> 172.21.15.47:0/3723894577 conn(0x7f802406bb20 msgr2=0x7f802406bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:00.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.861+0000 7f8023e00640 1 -- 172.21.15.47:0/3723894577 shutdown_connections 2024-05-27T10:53:00.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.861+0000 7f8023e00640 1 -- 172.21.15.47:0/3723894577 wait complete. 2024-05-27T10:53:00.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.862+0000 7f8023e00640 1 Processor -- start 2024-05-27T10:53:00.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.863+0000 7f8023e00640 1 -- start start 2024-05-27T10:53:00.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.863+0000 7f8023e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f802406ee30 0x7f80241e8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:00.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.863+0000 7f8023e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80240d0a30 0x7f80240afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:00.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.863+0000 7f8023e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f802415e660 0x7f80240c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:00.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.863+0000 7f8023e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f80240b4f20 con 0x7f802415e660 2024-05-27T10:53:00.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.863+0000 7f8023e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f80240b4060 con 0x7f80240d0a30 2024-05-27T10:53:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.863+0000 7f8023e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f80240c9470 con 0x7f802406ee30 2024-05-27T10:53:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.864+0000 7f8023400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f802415e660 0x7f80240c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.864+0000 7f8023400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f802415e660 0x7f80240c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54928/0 (socket says 172.21.15.47:54928) 2024-05-27T10:53:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.864+0000 7f8023400640 1 -- 172.21.15.47:0/2974661535 learned_addr learned my addr 172.21.15.47:0/2974661535 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.864+0000 7f8022a00640 1 --2- 172.21.15.47:0/2974661535 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f802406ee30 0x7f80241e8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.864+0000 7f801be00640 1 --2- 172.21.15.47:0/2974661535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80240d0a30 0x7f80240afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.864+0000 7f8023400640 1 -- 172.21.15.47:0/2974661535 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f802406ee30 msgr2=0x7f80241e8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.864+0000 7f8023400640 1 --2- 172.21.15.47:0/2974661535 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f802406ee30 0x7f80241e8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.864+0000 7f8023400640 1 -- 172.21.15.47:0/2974661535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80240d0a30 msgr2=0x7f80240afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.864+0000 7f8023400640 1 --2- 172.21.15.47:0/2974661535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80240d0a30 0x7f80240afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.864+0000 7f8023400640 1 -- 172.21.15.47:0/2974661535 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80240c9710 con 0x7f802415e660 2024-05-27T10:53:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.865+0000 7f8023400640 1 --2- 172.21.15.47:0/2974661535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f802415e660 0x7f80240c9dc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f801c02ac50 tx=0x7f801c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:00.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.865+0000 7f801aa00640 1 -- 172.21.15.47:0/2974661535 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c040070 con 0x7f802415e660 2024-05-27T10:53:00.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.865+0000 7f801aa00640 1 -- 172.21.15.47:0/2974661535 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f801c031bc0 con 0x7f802415e660 2024-05-27T10:53:00.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.865+0000 7f801aa00640 1 -- 172.21.15.47:0/2974661535 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c009450 con 0x7f802415e660 2024-05-27T10:53:00.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.865+0000 7f8023e00640 1 -- 172.21.15.47:0/2974661535 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80240c99f0 con 0x7f802415e660 2024-05-27T10:53:00.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.865+0000 7f8023e00640 1 -- 172.21.15.47:0/2974661535 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80240affa0 con 0x7f802415e660 2024-05-27T10:53:00.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.866+0000 7f8023e00640 1 -- 172.21.15.47:0/2974661535 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80240b6320 con 0x7f802415e660 2024-05-27T10:53:00.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.867+0000 7f801aa00640 1 -- 172.21.15.47:0/2974661535 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f801c039040 con 0x7f802415e660 2024-05-27T10:53:00.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.868+0000 7f801aa00640 1 --2- 172.21.15.47:0/2974661535 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f800006c8f0 0x7f800006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:00.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.869+0000 7f801aa00640 1 -- 172.21.15.47:0/2974661535 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f801c0ad450 con 0x7f802415e660 2024-05-27T10:53:00.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.869+0000 7f8022a00640 1 --2- 172.21.15.47:0/2974661535 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f800006c8f0 0x7f800006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:00.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.869+0000 7f8022a00640 1 --2- 172.21.15.47:0/2974661535 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f800006c8f0 0x7f800006edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8014009a30 tx=0x7f8014008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:00.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:00.873+0000 7f801aa00640 1 -- 172.21.15.47:0/2974661535 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f80240b6320 con 0x7f802415e660 2024-05-27T10:53:01.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.077+0000 7f8023e00640 1 -- 172.21.15.47:0/2974661535 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f80240c9bc0 con 0x7f802415e660 2024-05-27T10:53:01.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.078+0000 7f801aa00640 1 -- 172.21.15.47:0/2974661535 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f80240c9bc0 con 0x7f802415e660 2024-05-27T10:53:01.076 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-27T10:53:01.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.081+0000 7f8023e00640 1 -- 172.21.15.47:0/2974661535 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f800006c8f0 msgr2=0x7f800006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:01.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.081+0000 7f8023e00640 1 --2- 172.21.15.47:0/2974661535 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f800006c8f0 0x7f800006edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8014009a30 tx=0x7f8014008040 comp rx=0 tx=0).stop 2024-05-27T10:53:01.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.081+0000 7f8023e00640 1 -- 172.21.15.47:0/2974661535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f802415e660 msgr2=0x7f80240c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:01.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.081+0000 7f8023e00640 1 --2- 172.21.15.47:0/2974661535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f802415e660 0x7f80240c9dc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f801c02ac50 tx=0x7f801c004a40 comp rx=0 tx=0).stop 2024-05-27T10:53:01.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.082+0000 7f8023e00640 1 -- 172.21.15.47:0/2974661535 shutdown_connections 2024-05-27T10:53:01.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.082+0000 7f8023e00640 1 --2- 172.21.15.47:0/2974661535 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f800006c8f0 0x7f800006edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.082+0000 7f8023e00640 1 --2- 172.21.15.47:0/2974661535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f802415e660 0x7f80240c9dc0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.082+0000 7f8023e00640 1 --2- 172.21.15.47:0/2974661535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80240d0a30 0x7f80240afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.082+0000 7f8023e00640 1 --2- 172.21.15.47:0/2974661535 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f802406ee30 0x7f80241e8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.082+0000 7f8023e00640 1 -- 172.21.15.47:0/2974661535 >> 172.21.15.47:0/2974661535 conn(0x7f802406bb20 msgr2=0x7f8024071ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:01.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.082+0000 7f8023e00640 1 -- 172.21.15.47:0/2974661535 shutdown_connections 2024-05-27T10:53:01.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.082+0000 7f8023e00640 1 -- 172.21.15.47:0/2974661535 wait complete. 2024-05-27T10:53:01.103 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T10:53:01.305 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T10:53:01.313 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T10:53:01.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.320+0000 7f072d000640 1 Processor -- start 2024-05-27T10:53:01.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.320+0000 7f072d000640 1 -- start start 2024-05-27T10:53:01.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.322+0000 7f072d000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0728067a80 0x7f07280d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:01.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.322+0000 7f072d000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0728162450 0x7f0728162900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:01.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.322+0000 7f072d000640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07280cfc40 con 0x7f072815e9e0 2024-05-27T10:53:01.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.322+0000 7f072d000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f072815edc0 con 0x7f0728067a80 2024-05-27T10:53:01.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.322+0000 7f072d000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f07280b3ae0 con 0x7f0728162450 2024-05-27T10:53:01.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.322+0000 7f071fe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0728067a80 0x7f07280d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:01.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.322+0000 7f071fe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0728067a80 0x7f07280d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54942/0 (socket says 172.21.15.47:54942) 2024-05-27T10:53:01.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.322+0000 7f071fe00640 1 -- 172.21.15.47:0/1965494277 learned_addr learned my addr 172.21.15.47:0/1965494277 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:01.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.323+0000 7f071fe00640 1 -- 172.21.15.47:0/1965494277 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0728162450 msgr2=0x7f0728162900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:01.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.323+0000 7f071fe00640 1 --2- 172.21.15.47:0/1965494277 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0728162450 0x7f0728162900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.323+0000 7f071fe00640 1 -- 172.21.15.47:0/1965494277 >> v1:172.21.15.53:6789/0 conn(0x7f072815e9e0 legacy=0x7f07280b5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:01.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.323+0000 7f071fe00640 1 -- 172.21.15.47:0/1965494277 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07280cff20 con 0x7f0728067a80 2024-05-27T10:53:01.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.324+0000 7f071fe00640 1 --2- 172.21.15.47:0/1965494277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0728067a80 0x7f07280d0400 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0710009870 tx=0x7f071002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23d12c306449d82 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:01.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.324+0000 7f0726a00640 1 -- 172.21.15.47:0/1965494277 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0710037070 con 0x7f0728067a80 2024-05-27T10:53:01.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.324+0000 7f0726a00640 1 -- 172.21.15.47:0/1965494277 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0710032440 con 0x7f0728067a80 2024-05-27T10:53:01.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.324+0000 7f0726a00640 1 -- 172.21.15.47:0/1965494277 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0710032810 con 0x7f0728067a80 2024-05-27T10:53:01.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.325+0000 7f072d000640 1 -- 172.21.15.47:0/1965494277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0728067a80 msgr2=0x7f07280d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:01.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.325+0000 7f072d000640 1 --2- 172.21.15.47:0/1965494277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0728067a80 0x7f07280d0400 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0710009870 tx=0x7f071002a180 comp rx=0 tx=0).stop 2024-05-27T10:53:01.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.325+0000 7f072d000640 1 -- 172.21.15.47:0/1965494277 shutdown_connections 2024-05-27T10:53:01.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.325+0000 7f072d000640 1 --2- 172.21.15.47:0/1965494277 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0728162450 0x7f0728162900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.325+0000 7f072d000640 1 --2- 172.21.15.47:0/1965494277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0728067a80 0x7f07280d0400 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.325+0000 7f072d000640 1 -- 172.21.15.47:0/1965494277 >> 172.21.15.47:0/1965494277 conn(0x7f07280cd530 msgr2=0x7f07280cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:01.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.325+0000 7f072d000640 1 -- 172.21.15.47:0/1965494277 shutdown_connections 2024-05-27T10:53:01.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.325+0000 7f072d000640 1 -- 172.21.15.47:0/1965494277 wait complete. 2024-05-27T10:53:01.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.327+0000 7f072d000640 1 Processor -- start 2024-05-27T10:53:01.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.327+0000 7f072d000640 1 -- start start 2024-05-27T10:53:01.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.328+0000 7f072d000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0728067a80 0x7f07281473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:01.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.328+0000 7f072d000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f072815e9e0 0x7f0728159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:01.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.328+0000 7f072d000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0728162450 0x7f072815ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:01.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.328+0000 7f072d000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f07280b4010 con 0x7f0728067a80 2024-05-27T10:53:01.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.328+0000 7f072d000640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f07280b6050 con 0x7f072815e9e0 2024-05-27T10:53:01.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.328+0000 7f072d000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f07280cf960 con 0x7f0728162450 2024-05-27T10:53:01.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.328+0000 7f0727400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0728067a80 0x7f07281473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:01.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.328+0000 7f0727400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0728067a80 0x7f07281473b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54958/0 (socket says 172.21.15.47:54958) 2024-05-27T10:53:01.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.328+0000 7f0727400640 1 -- 172.21.15.47:0/4152950428 learned_addr learned my addr 172.21.15.47:0/4152950428 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:01.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.329+0000 7f0727e00640 1 --2- 172.21.15.47:0/4152950428 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0728162450 0x7f072815ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:01.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.329+0000 7f0727400640 1 -- 172.21.15.47:0/4152950428 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0728162450 msgr2=0x7f072815ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:01.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.329+0000 7f0727400640 1 --2- 172.21.15.47:0/4152950428 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0728162450 0x7f072815ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.329+0000 7f0727400640 1 -- 172.21.15.47:0/4152950428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f072815e9e0 msgr2=0x7f0728159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:01.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.329+0000 7f0727400640 1 --2- 172.21.15.47:0/4152950428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f072815e9e0 0x7f0728159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.329+0000 7f0727400640 1 -- 172.21.15.47:0/4152950428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0728070800 con 0x7f0728067a80 2024-05-27T10:53:01.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.329+0000 7f0727e00640 1 --2- 172.21.15.47:0/4152950428 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0728162450 0x7f072815ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:01.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.329+0000 7f0727400640 1 --2- 172.21.15.47:0/4152950428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0728067a80 0x7f07281473b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f071800c460 tx=0x7f071800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:01.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.330+0000 7f071f400640 1 -- 172.21.15.47:0/4152950428 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0718016020 con 0x7f0728067a80 2024-05-27T10:53:01.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.330+0000 7f071f400640 1 -- 172.21.15.47:0/4152950428 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0718012870 con 0x7f0728067a80 2024-05-27T10:53:01.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.330+0000 7f071f400640 1 -- 172.21.15.47:0/4152950428 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0718012c60 con 0x7f0728067a80 2024-05-27T10:53:01.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.330+0000 7f072d000640 1 -- 172.21.15.47:0/4152950428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072806ecb0 con 0x7f0728067a80 2024-05-27T10:53:01.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.330+0000 7f072d000640 1 -- 172.21.15.47:0/4152950428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f072806ef50 con 0x7f0728067a80 2024-05-27T10:53:01.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.331+0000 7f072d000640 1 -- 172.21.15.47:0/4152950428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f072804fce0 con 0x7f0728067a80 2024-05-27T10:53:01.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.332+0000 7f071f400640 1 -- 172.21.15.47:0/4152950428 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0718019020 con 0x7f0728067a80 2024-05-27T10:53:01.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.333+0000 7f071f400640 1 --2- 172.21.15.47:0/4152950428 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f070406c940 0x7f070406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:01.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.333+0000 7f071f400640 1 -- 172.21.15.47:0/4152950428 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f071808b5c0 con 0x7f0728067a80 2024-05-27T10:53:01.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.334+0000 7f071fe00640 1 --2- 172.21.15.47:0/4152950428 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f070406c940 0x7f070406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:01.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.335+0000 7f071fe00640 1 --2- 172.21.15.47:0/4152950428 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f070406c940 0x7f070406ee00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0710034000 tx=0x7f071002c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:01.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.338+0000 7f071f400640 1 -- 172.21.15.47:0/4152950428 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0718020070 con 0x7f0728067a80 2024-05-27T10:53:01.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.541+0000 7f072d000640 1 -- 172.21.15.47:0/4152950428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f07280b0380 con 0x7f0728067a80 2024-05-27T10:53:01.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.542+0000 7f071f400640 1 -- 172.21.15.47:0/4152950428 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f0728070800 con 0x7f0728067a80 2024-05-27T10:53:01.540 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-27T10:53:01.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.545+0000 7f072d000640 1 -- 172.21.15.47:0/4152950428 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f070406c940 msgr2=0x7f070406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:01.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.545+0000 7f072d000640 1 --2- 172.21.15.47:0/4152950428 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f070406c940 0x7f070406ee00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0710034000 tx=0x7f071002c000 comp rx=0 tx=0).stop 2024-05-27T10:53:01.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.545+0000 7f072d000640 1 -- 172.21.15.47:0/4152950428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0728067a80 msgr2=0x7f07281473b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:01.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.545+0000 7f072d000640 1 --2- 172.21.15.47:0/4152950428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0728067a80 0x7f07281473b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f071800c460 tx=0x7f071800c920 comp rx=0 tx=0).stop 2024-05-27T10:53:01.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.545+0000 7f072d000640 1 -- 172.21.15.47:0/4152950428 shutdown_connections 2024-05-27T10:53:01.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.545+0000 7f072d000640 1 --2- 172.21.15.47:0/4152950428 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f070406c940 0x7f070406ee00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.545+0000 7f072d000640 1 --2- 172.21.15.47:0/4152950428 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0728162450 0x7f072815ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.545+0000 7f072d000640 1 --2- 172.21.15.47:0/4152950428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f072815e9e0 0x7f0728159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.545+0000 7f072d000640 1 --2- 172.21.15.47:0/4152950428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0728067a80 0x7f07281473b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.545+0000 7f072d000640 1 -- 172.21.15.47:0/4152950428 >> 172.21.15.47:0/4152950428 conn(0x7f07280cd530 msgr2=0x7f07280cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:01.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.546+0000 7f072d000640 1 -- 172.21.15.47:0/4152950428 shutdown_connections 2024-05-27T10:53:01.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.546+0000 7f072d000640 1 -- 172.21.15.47:0/4152950428 wait complete. 2024-05-27T10:53:01.561 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T10:53:01.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.766+0000 7fd2b9800640 1 Processor -- start 2024-05-27T10:53:01.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.767+0000 7fd2b9800640 1 -- start start 2024-05-27T10:53:01.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.768+0000 7fd2b9800640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd2b413f690 0x7fd2b40ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:01.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.768+0000 7fd2b9800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd2b40cec90 0x7fd2b4071d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:01.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.768+0000 7fd2b9800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2b415cd60 con 0x7fd2b4072270 2024-05-27T10:53:01.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.768+0000 7fd2b9800640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fd2b415d040 con 0x7fd2b413f690 2024-05-27T10:53:01.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.768+0000 7fd2b9800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd2b415d320 con 0x7fd2b40cec90 2024-05-27T10:53:01.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.769+0000 7fd2b3400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd2b4072270 0x7fd2b4141d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51626/0 (socket says 172.21.15.47:51626) 2024-05-27T10:53:01.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.769+0000 7fd2b3400640 1 -- 172.21.15.47:0/4130650406 learned_addr learned my addr 172.21.15.47:0/4130650406 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:01.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.769+0000 7fd2b2000640 1 --2- 172.21.15.47:0/4130650406 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd2b40cec90 0x7fd2b4071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:01.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.769+0000 7fd2b2a00640 1 --2- 172.21.15.47:0/4130650406 >> v2:172.21.15.53:3300/0 conn(0x7fd2b413f690 0x7fd2b40ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:01.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.769+0000 7fd2b1600640 1 -- 172.21.15.47:0/4130650406 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1282567697 0 0) 0x7fd2b415cd60 con 0x7fd2b4072270 2024-05-27T10:53:01.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.769+0000 7fd2b1600640 1 -- 172.21.15.47:0/4130650406 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd298003520 con 0x7fd2b4072270 2024-05-27T10:53:01.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.770+0000 7fd2b1600640 1 -- 172.21.15.47:0/4130650406 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2367163738 0 0) 0x7fd298003520 con 0x7fd2b4072270 2024-05-27T10:53:01.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.770+0000 7fd2b1600640 1 -- 172.21.15.47:0/4130650406 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd2b40cec90 msgr2=0x7fd2b4071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:01.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.770+0000 7fd2b1600640 1 --2- 172.21.15.47:0/4130650406 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd2b40cec90 0x7fd2b4071d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.770+0000 7fd2b1600640 1 -- 172.21.15.47:0/4130650406 >> v2:172.21.15.53:3300/0 conn(0x7fd2b413f690 msgr2=0x7fd2b40ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:01.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.770+0000 7fd2b1600640 1 --2- 172.21.15.47:0/4130650406 >> v2:172.21.15.53:3300/0 conn(0x7fd2b413f690 0x7fd2b40ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.770+0000 7fd2b1600640 1 -- 172.21.15.47:0/4130650406 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b415d600 con 0x7fd2b4072270 2024-05-27T10:53:01.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.770+0000 7fd2b1600640 1 -- 172.21.15.47:0/4130650406 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7fd2ac001670 con 0x7fd2b4072270 2024-05-27T10:53:01.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.770+0000 7fd2b2a00640 1 --2- 172.21.15.47:0/4130650406 >> v2:172.21.15.53:3300/0 conn(0x7fd2b413f690 0x7fd2b40ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:53:01.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.770+0000 7fd2b1600640 1 -- 172.21.15.47:0/4130650406 >> v1:172.21.15.47:6789/0 conn(0x7fd2b4072270 legacy=0x7fd2b4141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:01.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.770+0000 7fd2b1600640 1 --2- 172.21.15.47:0/4130650406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2980039b0 0x7fd298003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:01.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.770+0000 7fd2b1600640 1 --2- 172.21.15.47:0/4130650406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd298004800 0x7fd298004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:01.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.770+0000 7fd2b1600640 1 --2- 172.21.15.47:0/4130650406 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd2b40cec90 0x7fd2980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:01.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.770+0000 7fd2b1600640 1 -- 172.21.15.47:0/4130650406 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b415d040 con 0x7fd2980039b0 2024-05-27T10:53:01.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.770+0000 7fd2b1600640 1 -- 172.21.15.47:0/4130650406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b415d320 con 0x7fd298004800 2024-05-27T10:53:01.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.770+0000 7fd2b1600640 1 -- 172.21.15.47:0/4130650406 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd29800ba70 con 0x7fd2b40cec90 2024-05-27T10:53:01.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.770+0000 7fd2b2a00640 1 --2- 172.21.15.47:0/4130650406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2980039b0 0x7fd298003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:01.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.771+0000 7fd2b2a00640 1 -- 172.21.15.47:0/4130650406 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd2b40cec90 msgr2=0x7fd2980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:01.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.771+0000 7fd2b2000640 1 --2- 172.21.15.47:0/4130650406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd298004800 0x7fd298004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:01.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.771+0000 7fd2b2a00640 1 --2- 172.21.15.47:0/4130650406 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd2b40cec90 0x7fd2980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.771+0000 7fd2b2a00640 1 -- 172.21.15.47:0/4130650406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd298004800 msgr2=0x7fd298004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:01.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.771+0000 7fd2b2a00640 1 --2- 172.21.15.47:0/4130650406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd298004800 0x7fd298004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.771+0000 7fd2b2a00640 1 -- 172.21.15.47:0/4130650406 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd298003520 con 0x7fd2980039b0 2024-05-27T10:53:01.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.772+0000 7fd2b2a00640 1 --2- 172.21.15.47:0/4130650406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2980039b0 0x7fd298003dd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40073b0 tx=0x7fd298005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f064e4fc9e5b2f35 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.772+0000 7fd2b1600640 1 -- 172.21.15.47:0/4130650406 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4033070 con 0x7fd2980039b0 2024-05-27T10:53:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.772+0000 7fd2b1600640 1 -- 172.21.15.47:0/4130650406 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a402f670 con 0x7fd2980039b0 2024-05-27T10:53:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.772+0000 7fd2b1600640 1 -- 172.21.15.47:0/4130650406 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4009c80 con 0x7fd2980039b0 2024-05-27T10:53:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.773+0000 7fd2b9800640 1 -- 172.21.15.47:0/4130650406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2980039b0 msgr2=0x7fd298003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.773+0000 7fd2b9800640 1 --2- 172.21.15.47:0/4130650406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2980039b0 0x7fd298003dd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40073b0 tx=0x7fd298005830 comp rx=0 tx=0).stop 2024-05-27T10:53:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.773+0000 7fd2b3400640 1 -- 172.21.15.47:0/4130650406 reap_dead start 2024-05-27T10:53:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.773+0000 7fd2b9800640 1 -- 172.21.15.47:0/4130650406 shutdown_connections 2024-05-27T10:53:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.773+0000 7fd2b9800640 1 -- 172.21.15.47:0/4130650406 >> 172.21.15.47:0/4130650406 conn(0x7fd2b40b21e0 msgr2=0x7fd2b40b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.773+0000 7fd2b9800640 1 -- 172.21.15.47:0/4130650406 shutdown_connections 2024-05-27T10:53:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.773+0000 7fd2b9800640 1 -- 172.21.15.47:0/4130650406 wait complete. 2024-05-27T10:53:01.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.775+0000 7fd2b9800640 1 Processor -- start 2024-05-27T10:53:01.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.775+0000 7fd2b9800640 1 -- start start 2024-05-27T10:53:01.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.776+0000 7fd2b9800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd2980039b0 0x7fd2b41f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:01.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.776+0000 7fd2b9800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2b413ab40 0x7fd2b40aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:01.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.776+0000 7fd2b9800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2b40aefb0 0x7fd2b413c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:01.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.776+0000 7fd2b9800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b40ce480 con 0x7fd2b413ab40 2024-05-27T10:53:01.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.776+0000 7fd2b9800640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b40ce300 con 0x7fd2b40aefb0 2024-05-27T10:53:01.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.776+0000 7fd2b9800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd2b4140d80 con 0x7fd2980039b0 2024-05-27T10:53:01.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.776+0000 7fd2b2000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2b413ab40 0x7fd2b40aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:01.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.776+0000 7fd2b2000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2b413ab40 0x7fd2b40aea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54966/0 (socket says 172.21.15.47:54966) 2024-05-27T10:53:01.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.776+0000 7fd2b2000640 1 -- 172.21.15.47:0/3845508678 learned_addr learned my addr 172.21.15.47:0/3845508678 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:01.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.777+0000 7fd2b2a00640 1 --2- 172.21.15.47:0/3845508678 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd2980039b0 0x7fd2b41f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:01.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.777+0000 7fd2b2000640 1 -- 172.21.15.47:0/3845508678 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd2980039b0 msgr2=0x7fd2b41f6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:01.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.777+0000 7fd2b3400640 1 --2- 172.21.15.47:0/3845508678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2b40aefb0 0x7fd2b413c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:01.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.777+0000 7fd2b2000640 1 --2- 172.21.15.47:0/3845508678 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd2980039b0 0x7fd2b41f6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.777+0000 7fd2b2000640 1 -- 172.21.15.47:0/3845508678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2b40aefb0 msgr2=0x7fd2b413c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:01.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.777+0000 7fd2b2000640 1 --2- 172.21.15.47:0/3845508678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2b40aefb0 0x7fd2b413c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.777+0000 7fd2b2000640 1 -- 172.21.15.47:0/3845508678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b413b3c0 con 0x7fd2b413ab40 2024-05-27T10:53:01.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.777+0000 7fd2b2a00640 1 --2- 172.21.15.47:0/3845508678 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd2980039b0 0x7fd2b41f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:01.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.777+0000 7fd2b3400640 1 --2- 172.21.15.47:0/3845508678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2b40aefb0 0x7fd2b413c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:01.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.777+0000 7fd2b2000640 1 --2- 172.21.15.47:0/3845508678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2b413ab40 0x7fd2b40aea70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd29c010890 tx=0x7fd29c010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:01.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.777+0000 7fd2aaa00640 1 -- 172.21.15.47:0/3845508678 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c00f040 con 0x7fd2b413ab40 2024-05-27T10:53:01.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.778+0000 7fd2aaa00640 1 -- 172.21.15.47:0/3845508678 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd29c00eb60 con 0x7fd2b413ab40 2024-05-27T10:53:01.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.778+0000 7fd2aaa00640 1 -- 172.21.15.47:0/3845508678 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c01c400 con 0x7fd2b413ab40 2024-05-27T10:53:01.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.778+0000 7fd2b9800640 1 -- 172.21.15.47:0/3845508678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b41389a0 con 0x7fd2b413ab40 2024-05-27T10:53:01.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.778+0000 7fd2b9800640 1 -- 172.21.15.47:0/3845508678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b4138f60 con 0x7fd2b413ab40 2024-05-27T10:53:01.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.779+0000 7fd2b9800640 1 -- 172.21.15.47:0/3845508678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b40af390 con 0x7fd2b413ab40 2024-05-27T10:53:01.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.780+0000 7fd2aaa00640 1 -- 172.21.15.47:0/3845508678 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd29c01c5a0 con 0x7fd2b413ab40 2024-05-27T10:53:01.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.781+0000 7fd2aaa00640 1 --2- 172.21.15.47:0/3845508678 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd29006c8f0 0x7fd29006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:01.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.781+0000 7fd2aaa00640 1 -- 172.21.15.47:0/3845508678 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fd29c08c1b0 con 0x7fd2b413ab40 2024-05-27T10:53:01.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.781+0000 7fd2b2a00640 1 --2- 172.21.15.47:0/3845508678 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd29006c8f0 0x7fd29006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:01.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.782+0000 7fd2b2a00640 1 --2- 172.21.15.47:0/3845508678 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd29006c8f0 0x7fd29006edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4035000 tx=0x7fd2a400b030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:01.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.785+0000 7fd2aaa00640 1 -- 172.21.15.47:0/3845508678 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd29c018030 con 0x7fd2b413ab40 2024-05-27T10:53:01.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.994+0000 7fd2b9800640 1 -- 172.21.15.47:0/3845508678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd2b40b55d0 con 0x7fd2b413ab40 2024-05-27T10:53:01.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.995+0000 7fd2aaa00640 1 -- 172.21.15.47:0/3845508678 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fd29c05a5f0 con 0x7fd2b413ab40 2024-05-27T10:53:01.993 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-27T10:53:01.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.998+0000 7fd2b9800640 1 -- 172.21.15.47:0/3845508678 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd29006c8f0 msgr2=0x7fd29006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:01.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.998+0000 7fd2b9800640 1 --2- 172.21.15.47:0/3845508678 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd29006c8f0 0x7fd29006edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4035000 tx=0x7fd2a400b030 comp rx=0 tx=0).stop 2024-05-27T10:53:01.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.998+0000 7fd2b9800640 1 -- 172.21.15.47:0/3845508678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2b413ab40 msgr2=0x7fd2b40aea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:01.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.998+0000 7fd2b9800640 1 --2- 172.21.15.47:0/3845508678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2b413ab40 0x7fd2b40aea70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd29c010890 tx=0x7fd29c010d50 comp rx=0 tx=0).stop 2024-05-27T10:53:01.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.998+0000 7fd2b9800640 1 -- 172.21.15.47:0/3845508678 shutdown_connections 2024-05-27T10:53:01.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.998+0000 7fd2b9800640 1 --2- 172.21.15.47:0/3845508678 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd29006c8f0 0x7fd29006edb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.998+0000 7fd2b9800640 1 --2- 172.21.15.47:0/3845508678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2b40aefb0 0x7fd2b413c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.998+0000 7fd2b9800640 1 --2- 172.21.15.47:0/3845508678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2b413ab40 0x7fd2b40aea70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.998+0000 7fd2b9800640 1 --2- 172.21.15.47:0/3845508678 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd2980039b0 0x7fd2b41f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:01.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.998+0000 7fd2b9800640 1 -- 172.21.15.47:0/3845508678 >> 172.21.15.47:0/3845508678 conn(0x7fd2b40b21e0 msgr2=0x7fd2b40cd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:01.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.998+0000 7fd2b9800640 1 -- 172.21.15.47:0/3845508678 shutdown_connections 2024-05-27T10:53:01.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:01.999+0000 7fd2b9800640 1 -- 172.21.15.47:0/3845508678 wait complete. 2024-05-27T10:53:02.016 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T10:53:02.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.231+0000 7fa5b5400640 1 Processor -- start 2024-05-27T10:53:02.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.231+0000 7fa5b5400640 1 -- start start 2024-05-27T10:53:02.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.233+0000 7fa5b5400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5b015c420 0x7fa5b0071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:02.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.233+0000 7fa5b5400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5b015c800 con 0x7fa5b00d0a70 2024-05-27T10:53:02.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.233+0000 7fa5b5400640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5b00ad2e0 con 0x7fa5b00b4ab0 2024-05-27T10:53:02.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.233+0000 7fa5b5400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fa5b00afc90 con 0x7fa5b015c420 2024-05-27T10:53:02.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.234+0000 7fa5b4a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa5b00d0a70 0x7fa5b00b3790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51642/0 (socket says 172.21.15.47:51642) 2024-05-27T10:53:02.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.234+0000 7fa5b4a00640 1 -- 172.21.15.47:0/3070683415 learned_addr learned my addr 172.21.15.47:0/3070683415 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:02.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.234+0000 7fa5afe00640 1 --2- 172.21.15.47:0/3070683415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5b015c420 0x7fa5b0071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:02.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.235+0000 7fa5af400640 1 -- 172.21.15.47:0/3070683415 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2495266603 0 0) 0x7fa5b015c800 con 0x7fa5b00d0a70 2024-05-27T10:53:02.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.235+0000 7fa5af400640 1 -- 172.21.15.47:0/3070683415 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa594003520 con 0x7fa5b00d0a70 2024-05-27T10:53:02.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.235+0000 7fa5afe00640 1 -- 172.21.15.47:0/3070683415 >> v1:172.21.15.53:6789/0 conn(0x7fa5b00b4ab0 legacy=0x7fa5b00d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:02.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.235+0000 7fa5afe00640 1 -- 172.21.15.47:0/3070683415 >> v1:172.21.15.47:6789/0 conn(0x7fa5b00d0a70 legacy=0x7fa5b00b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:02.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.235+0000 7fa5afe00640 1 -- 172.21.15.47:0/3070683415 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b00ad5c0 con 0x7fa5b015c420 2024-05-27T10:53:02.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.236+0000 7fa5afe00640 1 --2- 172.21.15.47:0/3070683415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5b015c420 0x7fa5b0071fc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa5a00097d0 tx=0x7fa5a002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=545365c58d30d8af server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:02.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.237+0000 7fa5af400640 1 -- 172.21.15.47:0/3070683415 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0037070 con 0x7fa5b015c420 2024-05-27T10:53:02.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.237+0000 7fa5af400640 1 -- 172.21.15.47:0/3070683415 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5a0032440 con 0x7fa5b015c420 2024-05-27T10:53:02.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.237+0000 7fa5af400640 1 -- 172.21.15.47:0/3070683415 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0032810 con 0x7fa5b015c420 2024-05-27T10:53:02.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.238+0000 7fa5b5400640 1 -- 172.21.15.47:0/3070683415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5b015c420 msgr2=0x7fa5b0071fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:02.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.238+0000 7fa5b5400640 1 --2- 172.21.15.47:0/3070683415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5b015c420 0x7fa5b0071fc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa5a00097d0 tx=0x7fa5a002a180 comp rx=0 tx=0).stop 2024-05-27T10:53:02.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.238+0000 7fa5b5400640 1 -- 172.21.15.47:0/3070683415 shutdown_connections 2024-05-27T10:53:02.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.238+0000 7fa5b5400640 1 --2- 172.21.15.47:0/3070683415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5b015c420 0x7fa5b0071fc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:02.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.238+0000 7fa5b5400640 1 -- 172.21.15.47:0/3070683415 >> 172.21.15.47:0/3070683415 conn(0x7fa5b006bb20 msgr2=0x7fa5b006bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:02.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.238+0000 7fa5b5400640 1 -- 172.21.15.47:0/3070683415 shutdown_connections 2024-05-27T10:53:02.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.238+0000 7fa5b5400640 1 -- 172.21.15.47:0/3070683415 wait complete. 2024-05-27T10:53:02.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.240+0000 7fa5b5400640 1 Processor -- start 2024-05-27T10:53:02.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.240+0000 7fa5b5400640 1 -- start start 2024-05-27T10:53:02.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.241+0000 7fa5b5400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5b00b4ab0 0x7fa5b01e8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:02.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.241+0000 7fa5b5400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5b00d0a70 0x7fa5b015d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:02.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.241+0000 7fa5b5400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5b015c420 0x7fa5b01391d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:02.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.241+0000 7fa5b5400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b00af8f0 con 0x7fa5b015c420 2024-05-27T10:53:02.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.241+0000 7fa5b5400640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b00ad8a0 con 0x7fa5b00d0a70 2024-05-27T10:53:02.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.241+0000 7fa5b5400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fa5b00afa70 con 0x7fa5b00b4ab0 2024-05-27T10:53:02.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.241+0000 7fa5b4a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5b015c420 0x7fa5b01391d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:02.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.242+0000 7fa5b4a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5b015c420 0x7fa5b01391d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54974/0 (socket says 172.21.15.47:54974) 2024-05-27T10:53:02.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.242+0000 7fa5b4a00640 1 -- 172.21.15.47:0/1675707532 learned_addr learned my addr 172.21.15.47:0/1675707532 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.242+0000 7fa5afe00640 1 --2- 172.21.15.47:0/1675707532 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5b00b4ab0 0x7fa5b01e8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.242+0000 7fa5a7e00640 1 --2- 172.21.15.47:0/1675707532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5b00d0a70 0x7fa5b015d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.242+0000 7fa5b4a00640 1 -- 172.21.15.47:0/1675707532 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5b00b4ab0 msgr2=0x7fa5b01e8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.242+0000 7fa5b4a00640 1 --2- 172.21.15.47:0/1675707532 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5b00b4ab0 0x7fa5b01e8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.242+0000 7fa5b4a00640 1 -- 172.21.15.47:0/1675707532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5b00d0a70 msgr2=0x7fa5b015d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.242+0000 7fa5b4a00640 1 --2- 172.21.15.47:0/1675707532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5b00d0a70 0x7fa5b015d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.242+0000 7fa5b4a00640 1 -- 172.21.15.47:0/1675707532 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b01e8090 con 0x7fa5b015c420 2024-05-27T10:53:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.242+0000 7fa5b4a00640 1 --2- 172.21.15.47:0/1675707532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5b015c420 0x7fa5b01391d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800cb40 tx=0x7fa5a800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.243+0000 7fa5acc00640 1 -- 172.21.15.47:0/1675707532 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8017070 con 0x7fa5b015c420 2024-05-27T10:53:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.243+0000 7fa5acc00640 1 -- 172.21.15.47:0/1675707532 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5a800aca0 con 0x7fa5b015c420 2024-05-27T10:53:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.243+0000 7fa5acc00640 1 -- 172.21.15.47:0/1675707532 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8012620 con 0x7fa5b015c420 2024-05-27T10:53:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.243+0000 7fa5b5400640 1 -- 172.21.15.47:0/1675707532 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5b0138130 con 0x7fa5b015c420 2024-05-27T10:53:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.243+0000 7fa5b5400640 1 -- 172.21.15.47:0/1675707532 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5b01386f0 con 0x7fa5b015c420 2024-05-27T10:53:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.244+0000 7fa5b5400640 1 -- 172.21.15.47:0/1675707532 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5b0072b00 con 0x7fa5b015c420 2024-05-27T10:53:02.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.245+0000 7fa5acc00640 1 -- 172.21.15.47:0/1675707532 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa5a801a070 con 0x7fa5b015c420 2024-05-27T10:53:02.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.246+0000 7fa5acc00640 1 --2- 172.21.15.47:0/1675707532 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa58c06c8f0 0x7fa58c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:02.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.246+0000 7fa5acc00640 1 -- 172.21.15.47:0/1675707532 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fa5a808bad0 con 0x7fa5b015c420 2024-05-27T10:53:02.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.246+0000 7fa5afe00640 1 --2- 172.21.15.47:0/1675707532 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa58c06c8f0 0x7fa58c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:02.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.247+0000 7fa5afe00640 1 --2- 172.21.15.47:0/1675707532 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa58c06c8f0 0x7fa58c06edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0034000 tx=0x7fa5a002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:02.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.251+0000 7fa5acc00640 1 -- 172.21.15.47:0/1675707532 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa5b0072b00 con 0x7fa5b015c420 2024-05-27T10:53:02.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.467+0000 7fa5b5400640 1 -- 172.21.15.47:0/1675707532 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa5b0073a30 con 0x7fa5b015c420 2024-05-27T10:53:02.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.468+0000 7fa5acc00640 1 -- 172.21.15.47:0/1675707532 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fa5a8059de0 con 0x7fa5b015c420 2024-05-27T10:53:02.466 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-05-27T10:53:02.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.471+0000 7fa5b5400640 1 -- 172.21.15.47:0/1675707532 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa58c06c8f0 msgr2=0x7fa58c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:02.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.471+0000 7fa5b5400640 1 --2- 172.21.15.47:0/1675707532 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa58c06c8f0 0x7fa58c06edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0034000 tx=0x7fa5a002e000 comp rx=0 tx=0).stop 2024-05-27T10:53:02.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.471+0000 7fa5b5400640 1 -- 172.21.15.47:0/1675707532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5b015c420 msgr2=0x7fa5b01391d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:02.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.471+0000 7fa5b5400640 1 --2- 172.21.15.47:0/1675707532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5b015c420 0x7fa5b01391d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800cb40 tx=0x7fa5a800a060 comp rx=0 tx=0).stop 2024-05-27T10:53:02.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.471+0000 7fa5b5400640 1 -- 172.21.15.47:0/1675707532 shutdown_connections 2024-05-27T10:53:02.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.471+0000 7fa5b5400640 1 --2- 172.21.15.47:0/1675707532 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa58c06c8f0 0x7fa58c06edb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:02.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.471+0000 7fa5b5400640 1 --2- 172.21.15.47:0/1675707532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5b015c420 0x7fa5b01391d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:02.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.471+0000 7fa5b5400640 1 --2- 172.21.15.47:0/1675707532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5b00d0a70 0x7fa5b015d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:02.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.471+0000 7fa5b5400640 1 --2- 172.21.15.47:0/1675707532 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5b00b4ab0 0x7fa5b01e8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:02.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.471+0000 7fa5b5400640 1 -- 172.21.15.47:0/1675707532 >> 172.21.15.47:0/1675707532 conn(0x7fa5b006bb20 msgr2=0x7fa5b0072fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:02.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.471+0000 7fa5b5400640 1 -- 172.21.15.47:0/1675707532 shutdown_connections 2024-05-27T10:53:02.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.471+0000 7fa5b5400640 1 -- 172.21.15.47:0/1675707532 wait complete. 2024-05-27T10:53:02.490 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-27T10:53:02.490 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:53:02.551 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:53:02.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.770+0000 7f1f8a800640 1 Processor -- start 2024-05-27T10:53:02.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.771+0000 7f1f8a800640 1 -- start start 2024-05-27T10:53:02.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.772+0000 7f1f8a800640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1f8406d240 0x7f1f8406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:02.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.772+0000 7f1f8a800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1f8415eaa0 0x7f1f840cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:02.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.772+0000 7f1f8a800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f840cebc0 con 0x7f1f8406ca40 2024-05-27T10:53:02.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.772+0000 7f1f8a800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f1f840cf4b0 con 0x7f1f8415eaa0 2024-05-27T10:53:02.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.772+0000 7f1f8a800640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f1f8406db60 con 0x7f1f8406d240 2024-05-27T10:53:02.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.772+0000 7f1f88a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1f8415eaa0 0x7f1f840cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:02.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.772+0000 7f1f88a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1f8415eaa0 0x7f1f840cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54982/0 (socket says 172.21.15.47:54982) 2024-05-27T10:53:02.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.772+0000 7f1f88a00640 1 -- 172.21.15.47:0/1775687534 learned_addr learned my addr 172.21.15.47:0/1775687534 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:02.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.773+0000 7f1f88a00640 1 -- 172.21.15.47:0/1775687534 >> v2:172.21.15.53:3300/0 conn(0x7f1f8406d240 msgr2=0x7f1f8406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:02.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.773+0000 7f1f89400640 1 --2- 172.21.15.47:0/1775687534 >> v2:172.21.15.53:3300/0 conn(0x7f1f8406d240 0x7f1f8406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:02.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.773+0000 7f1f88a00640 1 --2- 172.21.15.47:0/1775687534 >> v2:172.21.15.53:3300/0 conn(0x7f1f8406d240 0x7f1f8406d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:02.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.773+0000 7f1f88a00640 1 -- 172.21.15.47:0/1775687534 >> v1:172.21.15.47:6789/0 conn(0x7f1f8406ca40 legacy=0x7f1f840cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:02.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.773+0000 7f1f88a00640 1 -- 172.21.15.47:0/1775687534 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f840cee60 con 0x7f1f8415eaa0 2024-05-27T10:53:02.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.773+0000 7f1f89400640 1 --2- 172.21.15.47:0/1775687534 >> v2:172.21.15.53:3300/0 conn(0x7f1f8406d240 0x7f1f8406d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:02.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.774+0000 7f1f88a00640 1 --2- 172.21.15.47:0/1775687534 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f8415eaa0 0x7f1f840cf940 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1f8408c570 tx=0x7f1f7002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac041d59d44ed8c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:02.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.774+0000 7f1f83e00640 1 -- 172.21.15.47:0/1775687534 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f70004030 con 0x7f1f8415eaa0 2024-05-27T10:53:02.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.774+0000 7f1f83e00640 1 -- 172.21.15.47:0/1775687534 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f700041d0 con 0x7f1f8415eaa0 2024-05-27T10:53:02.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.774+0000 7f1f83e00640 1 -- 172.21.15.47:0/1775687534 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f70003610 con 0x7f1f8415eaa0 2024-05-27T10:53:02.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.775+0000 7f1f8a800640 1 -- 172.21.15.47:0/1775687534 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f8415eaa0 msgr2=0x7f1f840cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:02.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.775+0000 7f1f8a800640 1 --2- 172.21.15.47:0/1775687534 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f8415eaa0 0x7f1f840cf940 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1f8408c570 tx=0x7f1f7002a250 comp rx=0 tx=0).stop 2024-05-27T10:53:02.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.775+0000 7f1f8a800640 1 -- 172.21.15.47:0/1775687534 shutdown_connections 2024-05-27T10:53:02.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.775+0000 7f1f8a800640 1 --2- 172.21.15.47:0/1775687534 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f8415eaa0 0x7f1f840cf940 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:02.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.775+0000 7f1f8a800640 1 --2- 172.21.15.47:0/1775687534 >> v2:172.21.15.53:3300/0 conn(0x7f1f8406d240 0x7f1f8406d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:02.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.775+0000 7f1f8a800640 1 -- 172.21.15.47:0/1775687534 >> 172.21.15.47:0/1775687534 conn(0x7f1f8408bfd0 msgr2=0x7f1f840d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:02.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.775+0000 7f1f8a800640 1 -- 172.21.15.47:0/1775687534 shutdown_connections 2024-05-27T10:53:02.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.775+0000 7f1f8a800640 1 -- 172.21.15.47:0/1775687534 wait complete. 2024-05-27T10:53:02.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.777+0000 7f1f8a800640 1 Processor -- start 2024-05-27T10:53:02.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.777+0000 7f1f8a800640 1 -- start start 2024-05-27T10:53:02.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.778+0000 7f1f8a800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f8406ca40 0x7f1f840cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:02.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.778+0000 7f1f8a800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1f8406d240 0x7f1f8415fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:02.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.778+0000 7f1f8a800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f8415eaa0 0x7f1f841f42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:02.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.778+0000 7f1f8a800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1f840b10a0 con 0x7f1f8415eaa0 2024-05-27T10:53:02.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.778+0000 7f1f8a800640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8406cf40 con 0x7f1f8406ca40 2024-05-27T10:53:02.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.778+0000 7f1f8a800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f1f840b1220 con 0x7f1f8406d240 2024-05-27T10:53:02.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.778+0000 7f1f89e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f8415eaa0 0x7f1f841f42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:02.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.778+0000 7f1f89e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f8415eaa0 0x7f1f841f42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54984/0 (socket says 172.21.15.47:54984) 2024-05-27T10:53:02.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.778+0000 7f1f89e00640 1 -- 172.21.15.47:0/1529313488 learned_addr learned my addr 172.21.15.47:0/1529313488 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:02.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.779+0000 7f1f89e00640 1 -- 172.21.15.47:0/1529313488 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1f8406d240 msgr2=0x7f1f8415fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:02.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.779+0000 7f1f89e00640 1 --2- 172.21.15.47:0/1529313488 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1f8406d240 0x7f1f8415fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:02.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.779+0000 7f1f89e00640 1 -- 172.21.15.47:0/1529313488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f8406ca40 msgr2=0x7f1f840cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:02.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.779+0000 7f1f89e00640 1 --2- 172.21.15.47:0/1529313488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f8406ca40 0x7f1f840cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:02.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.779+0000 7f1f89e00640 1 -- 172.21.15.47:0/1529313488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f840ccf90 con 0x7f1f8415eaa0 2024-05-27T10:53:02.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.779+0000 7f1f89e00640 1 --2- 172.21.15.47:0/1529313488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f8415eaa0 0x7f1f841f42d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00c680 tx=0x7f1f7c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:02.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.779+0000 7f1f81600640 1 -- 172.21.15.47:0/1529313488 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c003b70 con 0x7f1f8415eaa0 2024-05-27T10:53:02.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.779+0000 7f1f81600640 1 -- 172.21.15.47:0/1529313488 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f7c003d10 con 0x7f1f8415eaa0 2024-05-27T10:53:02.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.779+0000 7f1f81600640 1 -- 172.21.15.47:0/1529313488 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c005310 con 0x7f1f8415eaa0 2024-05-27T10:53:02.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.779+0000 7f1f8a800640 1 -- 172.21.15.47:0/1529313488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f84160290 con 0x7f1f8415eaa0 2024-05-27T10:53:02.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.779+0000 7f1f8a800640 1 -- 172.21.15.47:0/1529313488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f840c9700 con 0x7f1f8415eaa0 2024-05-27T10:53:02.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.781+0000 7f1f8a800640 1 -- 172.21.15.47:0/1529313488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f8404fce0 con 0x7f1f8415eaa0 2024-05-27T10:53:02.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.782+0000 7f1f81600640 1 -- 172.21.15.47:0/1529313488 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1f7c0054b0 con 0x7f1f8415eaa0 2024-05-27T10:53:02.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.783+0000 7f1f81600640 1 --2- 172.21.15.47:0/1529313488 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f1f6406c940 0x7f1f6406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:02.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.783+0000 7f1f81600640 1 -- 172.21.15.47:0/1529313488 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f1f7c08b960 con 0x7f1f8415eaa0 2024-05-27T10:53:02.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.783+0000 7f1f89400640 1 --2- 172.21.15.47:0/1529313488 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f1f6406c940 0x7f1f6406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:02.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.784+0000 7f1f89400640 1 --2- 172.21.15.47:0/1529313488 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f1f6406c940 0x7f1f6406ee00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1f78006fd0 tx=0x7f1f78008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:02.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.788+0000 7f1f81600640 1 -- 172.21.15.47:0/1529313488 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1f7c059df0 con 0x7f1f8415eaa0 2024-05-27T10:53:02.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.994+0000 7f1f8a800640 1 -- 172.21.15.47:0/1529313488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f840b2650 con 0x7f1f8415eaa0 2024-05-27T10:53:02.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:02.997+0000 7f1f81600640 1 -- 172.21.15.47:0/1529313488 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16770 (secure 0 0 0) 0x7f1f7c0596f0 con 0x7f1f8415eaa0 2024-05-27T10:53:02.995 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:53:02.996 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":22,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:48.545555+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:53:02.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.000+0000 7f1f8a800640 1 -- 172.21.15.47:0/1529313488 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f1f6406c940 msgr2=0x7f1f6406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:02.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.000+0000 7f1f8a800640 1 --2- 172.21.15.47:0/1529313488 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f1f6406c940 0x7f1f6406ee00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1f78006fd0 tx=0x7f1f78008040 comp rx=0 tx=0).stop 2024-05-27T10:53:02.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.000+0000 7f1f8a800640 1 -- 172.21.15.47:0/1529313488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f8415eaa0 msgr2=0x7f1f841f42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:02.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.000+0000 7f1f8a800640 1 --2- 172.21.15.47:0/1529313488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f8415eaa0 0x7f1f841f42d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00c680 tx=0x7f1f7c00cb40 comp rx=0 tx=0).stop 2024-05-27T10:53:02.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.000+0000 7f1f8a800640 1 -- 172.21.15.47:0/1529313488 shutdown_connections 2024-05-27T10:53:02.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.000+0000 7f1f8a800640 1 --2- 172.21.15.47:0/1529313488 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f1f6406c940 0x7f1f6406ee00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:02.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.000+0000 7f1f8a800640 1 --2- 172.21.15.47:0/1529313488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f8415eaa0 0x7f1f841f42d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:02.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.000+0000 7f1f8a800640 1 --2- 172.21.15.47:0/1529313488 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1f8406d240 0x7f1f8415fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:02.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.000+0000 7f1f8a800640 1 --2- 172.21.15.47:0/1529313488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f8406ca40 0x7f1f840cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:02.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.000+0000 7f1f8a800640 1 -- 172.21.15.47:0/1529313488 >> 172.21.15.47:0/1529313488 conn(0x7f1f8408bfd0 msgr2=0x7f1f840b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:02.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.000+0000 7f1f8a800640 1 -- 172.21.15.47:0/1529313488 shutdown_connections 2024-05-27T10:53:02.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.000+0000 7f1f8a800640 1 -- 172.21.15.47:0/1529313488 wait complete. 2024-05-27T10:53:03.018 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T10:51:55.073251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T10:51:59.202702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T10:52:00.664039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T10:53:03.019 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T10:53:03.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.239+0000 7f91bac00640 1 Processor -- start 2024-05-27T10:53:03.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.240+0000 7f91bac00640 1 -- start start 2024-05-27T10:53:03.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.241+0000 7f91bac00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f91b406da80 0x7f91b40d0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:03.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.241+0000 7f91bac00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f91b40d0860 0x7f91b40ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:03.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.241+0000 7f91bac00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b40d0c70 con 0x7f91b415c510 2024-05-27T10:53:03.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.241+0000 7f91bac00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f91b40b43e0 con 0x7f91b406da80 2024-05-27T10:53:03.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.241+0000 7f91bac00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f91b40b4620 con 0x7f91b40d0860 2024-05-27T10:53:03.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.242+0000 7f91b8e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f91b406da80 0x7f91b40d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:03.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.242+0000 7f91b8e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f91b406da80 0x7f91b40d0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54990/0 (socket says 172.21.15.47:54990) 2024-05-27T10:53:03.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.242+0000 7f91b8e00640 1 -- 172.21.15.47:0/1229378241 learned_addr learned my addr 172.21.15.47:0/1229378241 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:03.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.242+0000 7f91b8e00640 1 -- 172.21.15.47:0/1229378241 >> v2:172.21.15.53:3300/0 conn(0x7f91b40d0860 msgr2=0x7f91b40ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:03.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.242+0000 7f91ba200640 1 --2- 172.21.15.47:0/1229378241 >> v2:172.21.15.53:3300/0 conn(0x7f91b40d0860 0x7f91b40ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:03.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.242+0000 7f91b8e00640 1 --2- 172.21.15.47:0/1229378241 >> v2:172.21.15.53:3300/0 conn(0x7f91b40d0860 0x7f91b40ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.242+0000 7f91b8e00640 1 -- 172.21.15.47:0/1229378241 >> v1:172.21.15.53:6789/0 conn(0x7f91b415c510 legacy=0x7f91b40b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:03.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.242+0000 7f91b8e00640 1 -- 172.21.15.47:0/1229378241 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b40b4900 con 0x7f91b406da80 2024-05-27T10:53:03.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.242+0000 7f91ba200640 1 --2- 172.21.15.47:0/1229378241 >> v2:172.21.15.53:3300/0 conn(0x7f91b40d0860 0x7f91b40ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:03.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.243+0000 7f91b8e00640 1 --2- 172.21.15.47:0/1229378241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b406da80 0x7f91b40d0320 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f91b406df10 tx=0x7f91a002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32aa2061b3fb34c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:03.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.244+0000 7f91b3e00640 1 -- 172.21.15.47:0/1229378241 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0037070 con 0x7f91b406da80 2024-05-27T10:53:03.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.244+0000 7f91b3e00640 1 -- 172.21.15.47:0/1229378241 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a0032440 con 0x7f91b406da80 2024-05-27T10:53:03.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.244+0000 7f91b3e00640 1 -- 172.21.15.47:0/1229378241 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0032810 con 0x7f91b406da80 2024-05-27T10:53:03.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.244+0000 7f91bac00640 1 -- 172.21.15.47:0/1229378241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b406da80 msgr2=0x7f91b40d0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:03.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.244+0000 7f91bac00640 1 --2- 172.21.15.47:0/1229378241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b406da80 0x7f91b40d0320 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f91b406df10 tx=0x7f91a002a230 comp rx=0 tx=0).stop 2024-05-27T10:53:03.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.245+0000 7f91bac00640 1 -- 172.21.15.47:0/1229378241 shutdown_connections 2024-05-27T10:53:03.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.245+0000 7f91bac00640 1 --2- 172.21.15.47:0/1229378241 >> v2:172.21.15.53:3300/0 conn(0x7f91b40d0860 0x7f91b40ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.245+0000 7f91bac00640 1 --2- 172.21.15.47:0/1229378241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b406da80 0x7f91b40d0320 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.245+0000 7f91bac00640 1 -- 172.21.15.47:0/1229378241 >> 172.21.15.47:0/1229378241 conn(0x7f91b406bb20 msgr2=0x7f91b406bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:03.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.245+0000 7f91bac00640 1 -- 172.21.15.47:0/1229378241 shutdown_connections 2024-05-27T10:53:03.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.245+0000 7f91bac00640 1 -- 172.21.15.47:0/1229378241 wait complete. 2024-05-27T10:53:03.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.246+0000 7f91bac00640 1 Processor -- start 2024-05-27T10:53:03.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.247+0000 7f91bac00640 1 -- start start 2024-05-27T10:53:03.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.247+0000 7f91bac00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91b406da80 0x7f91b415ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:03.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.247+0000 7f91bac00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91b40d0860 0x7f91b406e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:03.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.248+0000 7f91bac00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b415c510 0x7f91b41514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:03.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.248+0000 7f91bac00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f91b415c8f0 con 0x7f91b415c510 2024-05-27T10:53:03.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.248+0000 7f91bac00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f91b40b4ec0 con 0x7f91b40d0860 2024-05-27T10:53:03.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.248+0000 7f91bac00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f91b40cef30 con 0x7f91b406da80 2024-05-27T10:53:03.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.248+0000 7f91ba200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b415c510 0x7f91b41514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:03.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.248+0000 7f91ba200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b415c510 0x7f91b41514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55004/0 (socket says 172.21.15.47:55004) 2024-05-27T10:53:03.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.248+0000 7f91ba200640 1 -- 172.21.15.47:0/2865419627 learned_addr learned my addr 172.21.15.47:0/2865419627 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:03.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.248+0000 7f91b9800640 1 --2- 172.21.15.47:0/2865419627 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91b406da80 0x7f91b415ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:03.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.248+0000 7f91b8e00640 1 --2- 172.21.15.47:0/2865419627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91b40d0860 0x7f91b406e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:03.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.249+0000 7f91ba200640 1 -- 172.21.15.47:0/2865419627 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91b406da80 msgr2=0x7f91b415ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:03.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.249+0000 7f91ba200640 1 --2- 172.21.15.47:0/2865419627 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91b406da80 0x7f91b415ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.249+0000 7f91ba200640 1 -- 172.21.15.47:0/2865419627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91b40d0860 msgr2=0x7f91b406e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:03.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.249+0000 7f91ba200640 1 --2- 172.21.15.47:0/2865419627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91b40d0860 0x7f91b406e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.249+0000 7f91ba200640 1 -- 172.21.15.47:0/2865419627 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b4152550 con 0x7f91b415c510 2024-05-27T10:53:03.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.249+0000 7f91ba200640 1 --2- 172.21.15.47:0/2865419627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b415c510 0x7f91b41514b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00c7f0 tx=0x7f91ac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:03.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.249+0000 7f91b1600640 1 -- 172.21.15.47:0/2865419627 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac015070 con 0x7f91b415c510 2024-05-27T10:53:03.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.249+0000 7f91b1600640 1 -- 172.21.15.47:0/2865419627 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91ac007820 con 0x7f91b415c510 2024-05-27T10:53:03.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.249+0000 7f91b1600640 1 -- 172.21.15.47:0/2865419627 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac007c50 con 0x7f91b415c510 2024-05-27T10:53:03.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.249+0000 7f91bac00640 1 -- 172.21.15.47:0/2865419627 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b415d330 con 0x7f91b415c510 2024-05-27T10:53:03.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.250+0000 7f91bac00640 1 -- 172.21.15.47:0/2865419627 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b415dbd0 con 0x7f91b415c510 2024-05-27T10:53:03.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.251+0000 7f91bac00640 1 -- 172.21.15.47:0/2865419627 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b415d720 con 0x7f91b415c510 2024-05-27T10:53:03.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.252+0000 7f91b1600640 1 -- 172.21.15.47:0/2865419627 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f91ac018070 con 0x7f91b415c510 2024-05-27T10:53:03.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.253+0000 7f91b1600640 1 --2- 172.21.15.47:0/2865419627 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f919406c8f0 0x7f919406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:03.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.253+0000 7f91b1600640 1 -- 172.21.15.47:0/2865419627 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f91ac08bcb0 con 0x7f91b415c510 2024-05-27T10:53:03.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.253+0000 7f91b9800640 1 --2- 172.21.15.47:0/2865419627 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f919406c8f0 0x7f919406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:03.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.254+0000 7f91b9800640 1 --2- 172.21.15.47:0/2865419627 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f919406c8f0 0x7f919406edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009f20 tx=0x7f91a80094d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:03.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.258+0000 7f91b1600640 1 -- 172.21.15.47:0/2865419627 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f91ac05a0f0 con 0x7f91b415c510 2024-05-27T10:53:03.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.462+0000 7f91bac00640 1 -- 172.21.15.47:0/2865419627 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f91b404fce0 con 0x7f91b415c510 2024-05-27T10:53:03.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.463+0000 7f91b1600640 1 -- 172.21.15.47:0/2865419627 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f91ac0599f0 con 0x7f91b415c510 2024-05-27T10:53:03.461 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-27T10:53:03.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.466+0000 7f91bac00640 1 -- 172.21.15.47:0/2865419627 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f919406c8f0 msgr2=0x7f919406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:03.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.466+0000 7f91bac00640 1 --2- 172.21.15.47:0/2865419627 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f919406c8f0 0x7f919406edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009f20 tx=0x7f91a80094d0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.466+0000 7f91bac00640 1 -- 172.21.15.47:0/2865419627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b415c510 msgr2=0x7f91b41514b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:03.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.466+0000 7f91bac00640 1 --2- 172.21.15.47:0/2865419627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b415c510 0x7f91b41514b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00c7f0 tx=0x7f91ac00ccb0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.466+0000 7f91bac00640 1 -- 172.21.15.47:0/2865419627 shutdown_connections 2024-05-27T10:53:03.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.466+0000 7f91bac00640 1 --2- 172.21.15.47:0/2865419627 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f919406c8f0 0x7f919406edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.466+0000 7f91bac00640 1 --2- 172.21.15.47:0/2865419627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91b415c510 0x7f91b41514b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.466+0000 7f91bac00640 1 --2- 172.21.15.47:0/2865419627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91b40d0860 0x7f91b406e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.466+0000 7f91bac00640 1 --2- 172.21.15.47:0/2865419627 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91b406da80 0x7f91b415ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.466+0000 7f91bac00640 1 -- 172.21.15.47:0/2865419627 >> 172.21.15.47:0/2865419627 conn(0x7f91b406bb20 msgr2=0x7f91b40ad030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:03.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.466+0000 7f91bac00640 1 -- 172.21.15.47:0/2865419627 shutdown_connections 2024-05-27T10:53:03.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.466+0000 7f91bac00640 1 -- 172.21.15.47:0/2865419627 wait complete. 2024-05-27T10:53:03.482 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T10:53:03.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.700+0000 7fbce9e00640 1 Processor -- start 2024-05-27T10:53:03.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.700+0000 7fbce9e00640 1 -- start start 2024-05-27T10:53:03.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.701+0000 7fbce9e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbce415e660 0x7fbce406e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:03.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.702+0000 7fbce9e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbce406f460 con 0x7fbce406ee30 2024-05-27T10:53:03.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.702+0000 7fbce9e00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbce40b4440 con 0x7fbce40d0a30 2024-05-27T10:53:03.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.702+0000 7fbce9e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbce40b4720 con 0x7fbce415e660 2024-05-27T10:53:03.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.702+0000 7fbce3e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbce406ee30 0x7fbce40d0320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51674/0 (socket says 172.21.15.47:51674) 2024-05-27T10:53:03.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.702+0000 7fbce3e00640 1 -- 172.21.15.47:0/790628969 learned_addr learned my addr 172.21.15.47:0/790628969 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:03.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.702+0000 7fbce3400640 1 -- 172.21.15.47:0/790628969 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 185132951 0 0) 0x7fbce406f460 con 0x7fbce406ee30 2024-05-27T10:53:03.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.702+0000 7fbce8a00640 1 --2- 172.21.15.47:0/790628969 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbce415e660 0x7fbce406e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:03.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.702+0000 7fbce3400640 1 -- 172.21.15.47:0/790628969 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbccc003520 con 0x7fbce406ee30 2024-05-27T10:53:03.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.703+0000 7fbce3400640 1 -- 172.21.15.47:0/790628969 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4258490126 0 0) 0x7fbccc003520 con 0x7fbce406ee30 2024-05-27T10:53:03.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.703+0000 7fbce3400640 1 -- 172.21.15.47:0/790628969 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbce415e660 msgr2=0x7fbce406e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:03.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.703+0000 7fbce3400640 1 --2- 172.21.15.47:0/790628969 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbce415e660 0x7fbce406e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.703+0000 7fbce3400640 1 -- 172.21.15.47:0/790628969 >> v1:172.21.15.53:6789/0 conn(0x7fbce40d0a30 legacy=0x7fbce40cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:03.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.703+0000 7fbce3400640 1 -- 172.21.15.47:0/790628969 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce40b4a00 con 0x7fbce406ee30 2024-05-27T10:53:03.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.703+0000 7fbce3400640 1 -- 172.21.15.47:0/790628969 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7fbcd0001670 con 0x7fbce406ee30 2024-05-27T10:53:03.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.703+0000 7fbce3400640 1 -- 172.21.15.47:0/790628969 >> v1:172.21.15.47:6789/0 conn(0x7fbce406ee30 legacy=0x7fbce40d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:03.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.703+0000 7fbce3400640 1 --2- 172.21.15.47:0/790628969 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbce415e660 0x7fbccc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:03.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.703+0000 7fbce3400640 1 --2- 172.21.15.47:0/790628969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbccc004060 0x7fbccc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:03.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.703+0000 7fbce3400640 1 --2- 172.21.15.47:0/790628969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbccc004d40 0x7fbccc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:03.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.703+0000 7fbce3400640 1 -- 172.21.15.47:0/790628969 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbce40b4720 con 0x7fbccc004060 2024-05-27T10:53:03.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.703+0000 7fbce3400640 1 -- 172.21.15.47:0/790628969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc00bc00 con 0x7fbccc004d40 2024-05-27T10:53:03.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.703+0000 7fbce3400640 1 -- 172.21.15.47:0/790628969 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbccc00be00 con 0x7fbce415e660 2024-05-27T10:53:03.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.703+0000 7fbce3e00640 1 --2- 172.21.15.47:0/790628969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbccc004060 0x7fbccc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:03.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.704+0000 7fbce8a00640 1 --2- 172.21.15.47:0/790628969 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbce415e660 0x7fbccc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:03.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.704+0000 7fbce9400640 1 --2- 172.21.15.47:0/790628969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbccc004d40 0x7fbccc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:03.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.704+0000 7fbce3e00640 1 -- 172.21.15.47:0/790628969 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbce415e660 msgr2=0x7fbccc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:03.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.704+0000 7fbce3e00640 1 --2- 172.21.15.47:0/790628969 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbce415e660 0x7fbccc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.704+0000 7fbce3e00640 1 -- 172.21.15.47:0/790628969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbccc004d40 msgr2=0x7fbccc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:03.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.704+0000 7fbce3e00640 1 --2- 172.21.15.47:0/790628969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbccc004d40 0x7fbccc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.704+0000 7fbce3e00640 1 -- 172.21.15.47:0/790628969 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbccc003520 con 0x7fbccc004060 2024-05-27T10:53:03.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.704+0000 7fbce9400640 1 --2- 172.21.15.47:0/790628969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbccc004d40 0x7fbccc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:03.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.705+0000 7fbce3e00640 1 --2- 172.21.15.47:0/790628969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbccc004060 0x7fbccc004800 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbcd000c0e0 tx=0x7fbccc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87ea366423bcba1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:03.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.705+0000 7fbce3400640 1 -- 172.21.15.47:0/790628969 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0007c20 con 0x7fbccc004060 2024-05-27T10:53:03.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.705+0000 7fbce3400640 1 -- 172.21.15.47:0/790628969 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd0005af0 con 0x7fbccc004060 2024-05-27T10:53:03.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.705+0000 7fbce3400640 1 -- 172.21.15.47:0/790628969 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0007070 con 0x7fbccc004060 2024-05-27T10:53:03.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.706+0000 7fbce9e00640 1 -- 172.21.15.47:0/790628969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbccc004060 msgr2=0x7fbccc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:03.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.706+0000 7fbce9e00640 1 --2- 172.21.15.47:0/790628969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbccc004060 0x7fbccc004800 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbcd000c0e0 tx=0x7fbccc005830 comp rx=0 tx=0).stop 2024-05-27T10:53:03.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.706+0000 7fbce9400640 1 -- 172.21.15.47:0/790628969 reap_dead start 2024-05-27T10:53:03.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.706+0000 7fbce9e00640 1 -- 172.21.15.47:0/790628969 shutdown_connections 2024-05-27T10:53:03.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.706+0000 7fbce9e00640 1 -- 172.21.15.47:0/790628969 >> 172.21.15.47:0/790628969 conn(0x7fbce406bb20 msgr2=0x7fbce406bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:03.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.706+0000 7fbce9e00640 1 -- 172.21.15.47:0/790628969 shutdown_connections 2024-05-27T10:53:03.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.706+0000 7fbce9e00640 1 -- 172.21.15.47:0/790628969 wait complete. 2024-05-27T10:53:03.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.708+0000 7fbce9e00640 1 Processor -- start 2024-05-27T10:53:03.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.708+0000 7fbce9e00640 1 -- start start 2024-05-27T10:53:03.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.709+0000 7fbce9e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbccc004060 0x7fbce41e9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:03.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.709+0000 7fbce9e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce4146d00 0x7fbce40c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:03.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.709+0000 7fbce9e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbce41e9ac0 0x7fbce4148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:03.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.709+0000 7fbce9e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbce40b4f20 con 0x7fbce4146d00 2024-05-27T10:53:03.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.709+0000 7fbce9e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbce40b4060 con 0x7fbccc004060 2024-05-27T10:53:03.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.709+0000 7fbce9e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbce4147190 con 0x7fbce41e9ac0 2024-05-27T10:53:03.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.709+0000 7fbce3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce4146d00 0x7fbce40c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:03.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.709+0000 7fbce3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce4146d00 0x7fbce40c93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55020/0 (socket says 172.21.15.47:55020) 2024-05-27T10:53:03.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.709+0000 7fbce3e00640 1 -- 172.21.15.47:0/2795849154 learned_addr learned my addr 172.21.15.47:0/2795849154 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.710+0000 7fbce9400640 1 --2- 172.21.15.47:0/2795849154 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbce41e9ac0 0x7fbce4148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.710+0000 7fbce8a00640 1 --2- 172.21.15.47:0/2795849154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbccc004060 0x7fbce41e9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.710+0000 7fbce3e00640 1 -- 172.21.15.47:0/2795849154 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbce41e9ac0 msgr2=0x7fbce4148230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.710+0000 7fbce3e00640 1 --2- 172.21.15.47:0/2795849154 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbce41e9ac0 0x7fbce4148230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.710+0000 7fbce3e00640 1 -- 172.21.15.47:0/2795849154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbccc004060 msgr2=0x7fbce41e9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.710+0000 7fbce3e00640 1 --2- 172.21.15.47:0/2795849154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbccc004060 0x7fbce41e9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.710+0000 7fbce3e00640 1 -- 172.21.15.47:0/2795849154 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce4147470 con 0x7fbce4146d00 2024-05-27T10:53:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.710+0000 7fbce3e00640 1 --2- 172.21.15.47:0/2795849154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce4146d00 0x7fbce40c93d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbcd002ad20 tx=0x7fbce40b4bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.710+0000 7fbce0c00640 1 -- 172.21.15.47:0/2795849154 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0001630 con 0x7fbce4146d00 2024-05-27T10:53:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.710+0000 7fbce0c00640 1 -- 172.21.15.47:0/2795849154 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd0042070 con 0x7fbce4146d00 2024-05-27T10:53:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.710+0000 7fbce0c00640 1 -- 172.21.15.47:0/2795849154 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0007290 con 0x7fbce4146d00 2024-05-27T10:53:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.710+0000 7fbce9e00640 1 -- 172.21.15.47:0/2795849154 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce4147750 con 0x7fbce4146d00 2024-05-27T10:53:03.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.711+0000 7fbce9e00640 1 -- 172.21.15.47:0/2795849154 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce4147d10 con 0x7fbce4146d00 2024-05-27T10:53:03.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.712+0000 7fbce9e00640 1 -- 172.21.15.47:0/2795849154 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce404fce0 con 0x7fbce4146d00 2024-05-27T10:53:03.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.713+0000 7fbce0c00640 1 -- 172.21.15.47:0/2795849154 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbcd0007430 con 0x7fbce4146d00 2024-05-27T10:53:03.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.714+0000 7fbce0c00640 1 --2- 172.21.15.47:0/2795849154 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbcc406c8f0 0x7fbcc406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:03.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.714+0000 7fbce0c00640 1 -- 172.21.15.47:0/2795849154 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fbcd00abcd0 con 0x7fbce4146d00 2024-05-27T10:53:03.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.714+0000 7fbce8a00640 1 --2- 172.21.15.47:0/2795849154 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbcc406c8f0 0x7fbcc406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:03.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.715+0000 7fbce8a00640 1 --2- 172.21.15.47:0/2795849154 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbcc406c8f0 0x7fbcc406edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8006fd0 tx=0x7fbcd8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:03.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.718+0000 7fbce0c00640 1 -- 172.21.15.47:0/2795849154 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbcd0079ff0 con 0x7fbce4146d00 2024-05-27T10:53:03.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.925+0000 7fbce9e00640 1 -- 172.21.15.47:0/2795849154 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbce40ce7a0 con 0x7fbce4146d00 2024-05-27T10:53:03.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.926+0000 7fbce0c00640 1 -- 172.21.15.47:0/2795849154 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fbcd00798f0 con 0x7fbce4146d00 2024-05-27T10:53:03.924 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-27T10:53:03.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.929+0000 7fbce9e00640 1 -- 172.21.15.47:0/2795849154 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbcc406c8f0 msgr2=0x7fbcc406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:03.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.929+0000 7fbce9e00640 1 --2- 172.21.15.47:0/2795849154 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbcc406c8f0 0x7fbcc406edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8006fd0 tx=0x7fbcd8008040 comp rx=0 tx=0).stop 2024-05-27T10:53:03.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.929+0000 7fbce9e00640 1 -- 172.21.15.47:0/2795849154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce4146d00 msgr2=0x7fbce40c93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:03.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.929+0000 7fbce9e00640 1 --2- 172.21.15.47:0/2795849154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce4146d00 0x7fbce40c93d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbcd002ad20 tx=0x7fbce40b4bd0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.929+0000 7fbce9e00640 1 -- 172.21.15.47:0/2795849154 shutdown_connections 2024-05-27T10:53:03.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.929+0000 7fbce9e00640 1 --2- 172.21.15.47:0/2795849154 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbcc406c8f0 0x7fbcc406edb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.929+0000 7fbce9e00640 1 --2- 172.21.15.47:0/2795849154 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbce41e9ac0 0x7fbce4148230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.929+0000 7fbce9e00640 1 --2- 172.21.15.47:0/2795849154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce4146d00 0x7fbce40c93d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.929+0000 7fbce9e00640 1 --2- 172.21.15.47:0/2795849154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbccc004060 0x7fbce41e9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:03.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.929+0000 7fbce9e00640 1 -- 172.21.15.47:0/2795849154 >> 172.21.15.47:0/2795849154 conn(0x7fbce406bb20 msgr2=0x7fbce415fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:03.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.929+0000 7fbce9e00640 1 -- 172.21.15.47:0/2795849154 shutdown_connections 2024-05-27T10:53:03.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:03.929+0000 7fbce9e00640 1 -- 172.21.15.47:0/2795849154 wait complete. 2024-05-27T10:53:03.947 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T10:53:04.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.169+0000 7facd7600640 1 Processor -- start 2024-05-27T10:53:04.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.169+0000 7facd7600640 1 -- start start 2024-05-27T10:53:04.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.171+0000 7facd7600640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7facd013f690 0x7facd00ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:04.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.171+0000 7facd7600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facd015cd60 con 0x7facd00cec90 2024-05-27T10:53:04.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.171+0000 7facd7600640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facd015d040 con 0x7facd0072440 2024-05-27T10:53:04.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.171+0000 7facd7600640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7facd015d320 con 0x7facd013f690 2024-05-27T10:53:04.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.172+0000 7faccfe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7facd00cec90 0x7facd0071d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51682/0 (socket says 172.21.15.47:51682) 2024-05-27T10:53:04.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.172+0000 7faccfe00640 1 -- 172.21.15.47:0/2676287571 learned_addr learned my addr 172.21.15.47:0/2676287571 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:04.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.172+0000 7facd4c00640 1 --2- 172.21.15.47:0/2676287571 >> v2:172.21.15.53:3300/0 conn(0x7facd013f690 0x7facd00ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:04.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.172+0000 7faccf400640 1 -- 172.21.15.47:0/2676287571 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1417172836 0 0) 0x7facd015cd60 con 0x7facd00cec90 2024-05-27T10:53:04.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.172+0000 7faccf400640 1 -- 172.21.15.47:0/2676287571 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facb8003520 con 0x7facd00cec90 2024-05-27T10:53:04.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.172+0000 7faccf400640 1 -- 172.21.15.47:0/2676287571 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 27370555 0 0) 0x7facb8003520 con 0x7facd00cec90 2024-05-27T10:53:04.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.173+0000 7faccf400640 1 -- 172.21.15.47:0/2676287571 >> v2:172.21.15.53:3300/0 conn(0x7facd013f690 msgr2=0x7facd00ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:04.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.173+0000 7faccf400640 1 --2- 172.21.15.47:0/2676287571 >> v2:172.21.15.53:3300/0 conn(0x7facd013f690 0x7facd00ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.173+0000 7faccf400640 1 -- 172.21.15.47:0/2676287571 >> v1:172.21.15.53:6789/0 conn(0x7facd0072440 legacy=0x7facd013fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:04.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.173+0000 7faccf400640 1 -- 172.21.15.47:0/2676287571 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd015d600 con 0x7facd00cec90 2024-05-27T10:53:04.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.173+0000 7faccf400640 1 -- 172.21.15.47:0/2676287571 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7facbc001670 con 0x7facd00cec90 2024-05-27T10:53:04.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.173+0000 7faccf400640 1 -- 172.21.15.47:0/2676287571 >> v1:172.21.15.47:6789/0 conn(0x7facd00cec90 legacy=0x7facd0071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:04.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.173+0000 7faccf400640 1 --2- 172.21.15.47:0/2676287571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facb8003a00 0x7facb8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:04.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.173+0000 7faccf400640 1 --2- 172.21.15.47:0/2676287571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facb8004800 0x7facb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:04.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.173+0000 7faccf400640 1 --2- 172.21.15.47:0/2676287571 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facb8005210 0x7facb800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:04.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.173+0000 7faccf400640 1 -- 172.21.15.47:0/2676287571 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7facd015d320 con 0x7facb8003a00 2024-05-27T10:53:04.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.173+0000 7faccf400640 1 -- 172.21.15.47:0/2676287571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7facb800c160 con 0x7facb8004800 2024-05-27T10:53:04.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.173+0000 7faccf400640 1 -- 172.21.15.47:0/2676287571 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7facb800c360 con 0x7facb8005210 2024-05-27T10:53:04.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.173+0000 7facd4c00640 1 --2- 172.21.15.47:0/2676287571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facb8003a00 0x7facb8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:04.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.174+0000 7faccfe00640 1 --2- 172.21.15.47:0/2676287571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facb8004800 0x7facb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:04.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.174+0000 7facd5600640 1 --2- 172.21.15.47:0/2676287571 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facb8005210 0x7facb800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:04.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.174+0000 7facd4c00640 1 -- 172.21.15.47:0/2676287571 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facb8005210 msgr2=0x7facb800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:04.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.174+0000 7facd4c00640 1 --2- 172.21.15.47:0/2676287571 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facb8005210 0x7facb800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.174+0000 7facd4c00640 1 -- 172.21.15.47:0/2676287571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facb8004800 msgr2=0x7facb8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:04.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.174+0000 7facd4c00640 1 --2- 172.21.15.47:0/2676287571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facb8004800 0x7facb8004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.174+0000 7facd4c00640 1 -- 172.21.15.47:0/2676287571 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb8003520 con 0x7facb8003a00 2024-05-27T10:53:04.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.174+0000 7facd5600640 1 -- 172.21.15.47:0/2676287571 reap_dead start 2024-05-27T10:53:04.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.175+0000 7facd4c00640 1 --2- 172.21.15.47:0/2676287571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facb8003a00 0x7facb8003e20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7facc4009a90 tx=0x7facb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18440f54d785481d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:04.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.175+0000 7faccf400640 1 -- 172.21.15.47:0/2676287571 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4036070 con 0x7facb8003a00 2024-05-27T10:53:04.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.175+0000 7faccf400640 1 -- 172.21.15.47:0/2676287571 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc4031400 con 0x7facb8003a00 2024-05-27T10:53:04.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.175+0000 7faccf400640 1 -- 172.21.15.47:0/2676287571 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4009690 con 0x7facb8003a00 2024-05-27T10:53:04.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.176+0000 7facd7600640 1 -- 172.21.15.47:0/2676287571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facb8003a00 msgr2=0x7facb8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:04.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.176+0000 7facd7600640 1 --2- 172.21.15.47:0/2676287571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facb8003a00 0x7facb8003e20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7facc4009a90 tx=0x7facb8005830 comp rx=0 tx=0).stop 2024-05-27T10:53:04.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.176+0000 7facd7600640 1 -- 172.21.15.47:0/2676287571 shutdown_connections 2024-05-27T10:53:04.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.176+0000 7facd7600640 1 --2- 172.21.15.47:0/2676287571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facb8003a00 0x7facb8003e20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.176+0000 7facd7600640 1 -- 172.21.15.47:0/2676287571 >> 172.21.15.47:0/2676287571 conn(0x7facd00b21e0 msgr2=0x7facd00b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:04.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.176+0000 7facd7600640 1 -- 172.21.15.47:0/2676287571 shutdown_connections 2024-05-27T10:53:04.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.176+0000 7facd7600640 1 -- 172.21.15.47:0/2676287571 wait complete. 2024-05-27T10:53:04.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.178+0000 7facd7600640 1 Processor -- start 2024-05-27T10:53:04.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.178+0000 7facd7600640 1 -- start start 2024-05-27T10:53:04.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.179+0000 7facd7600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facb8003a00 0x7facd0139b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:04.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.179+0000 7facd7600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facd0157280 0x7facd0157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:04.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.179+0000 7facd7600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facd006f110 0x7facd006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:04.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.179+0000 7facd7600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7facd00ce480 con 0x7facb8003a00 2024-05-27T10:53:04.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.179+0000 7facd7600640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7facd00ce300 con 0x7facd006f110 2024-05-27T10:53:04.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.179+0000 7facd7600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7facd00ce750 con 0x7facd0157280 2024-05-27T10:53:04.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.179+0000 7facd4c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facb8003a00 0x7facd0139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:04.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.179+0000 7facd4c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facb8003a00 0x7facd0139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55038/0 (socket says 172.21.15.47:55038) 2024-05-27T10:53:04.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.179+0000 7facd4c00640 1 -- 172.21.15.47:0/129620661 learned_addr learned my addr 172.21.15.47:0/129620661 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:04.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.180+0000 7facd4c00640 1 -- 172.21.15.47:0/129620661 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facd0157280 msgr2=0x7facd0157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:04.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.180+0000 7facd4c00640 1 --2- 172.21.15.47:0/129620661 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facd0157280 0x7facd0157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.180+0000 7facd4c00640 1 -- 172.21.15.47:0/129620661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facd006f110 msgr2=0x7facd006f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:04.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.180+0000 7facd4c00640 1 --2- 172.21.15.47:0/129620661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facd006f110 0x7facd006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.180+0000 7facd4c00640 1 -- 172.21.15.47:0/129620661 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd013b470 con 0x7facb8003a00 2024-05-27T10:53:04.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.180+0000 7facd4c00640 1 --2- 172.21.15.47:0/129620661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facb8003a00 0x7facd0139b10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7facc4009bb0 tx=0x7facc4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:04.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.180+0000 7facccc00640 1 -- 172.21.15.47:0/129620661 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc403f020 con 0x7facb8003a00 2024-05-27T10:53:04.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.181+0000 7facccc00640 1 -- 172.21.15.47:0/129620661 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc4037040 con 0x7facb8003a00 2024-05-27T10:53:04.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.181+0000 7facccc00640 1 -- 172.21.15.47:0/129620661 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4036070 con 0x7facb8003a00 2024-05-27T10:53:04.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.181+0000 7facd7600640 1 -- 172.21.15.47:0/129620661 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd0157e20 con 0x7facb8003a00 2024-05-27T10:53:04.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.181+0000 7facd7600640 1 -- 172.21.15.47:0/129620661 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd01583e0 con 0x7facb8003a00 2024-05-27T10:53:04.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.182+0000 7facd7600640 1 -- 172.21.15.47:0/129620661 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd006fad0 con 0x7facb8003a00 2024-05-27T10:53:04.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.183+0000 7facccc00640 1 -- 172.21.15.47:0/129620661 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7facc4042020 con 0x7facb8003a00 2024-05-27T10:53:04.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.184+0000 7facccc00640 1 --2- 172.21.15.47:0/129620661 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7facb006c920 0x7facb006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:04.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.184+0000 7facccc00640 1 -- 172.21.15.47:0/129620661 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7facc40abb80 con 0x7facb8003a00 2024-05-27T10:53:04.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.184+0000 7faccfe00640 1 --2- 172.21.15.47:0/129620661 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7facb006c920 0x7facb006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:04.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.185+0000 7faccfe00640 1 --2- 172.21.15.47:0/129620661 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7facb006c920 0x7facb006ede0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7facbc000c00 tx=0x7facbc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:04.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.188+0000 7facccc00640 1 -- 172.21.15.47:0/129620661 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7facc4049030 con 0x7facb8003a00 2024-05-27T10:53:04.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.391+0000 7facd7600640 1 -- 172.21.15.47:0/129620661 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7facd0073800 con 0x7facb8003a00 2024-05-27T10:53:04.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.392+0000 7facccc00640 1 -- 172.21.15.47:0/129620661 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7facc4079f30 con 0x7facb8003a00 2024-05-27T10:53:04.390 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-27T10:53:04.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.395+0000 7facd7600640 1 -- 172.21.15.47:0/129620661 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7facb006c920 msgr2=0x7facb006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:04.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.395+0000 7facd7600640 1 --2- 172.21.15.47:0/129620661 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7facb006c920 0x7facb006ede0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7facbc000c00 tx=0x7facbc009040 comp rx=0 tx=0).stop 2024-05-27T10:53:04.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.395+0000 7facd7600640 1 -- 172.21.15.47:0/129620661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facb8003a00 msgr2=0x7facd0139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:04.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.395+0000 7facd7600640 1 --2- 172.21.15.47:0/129620661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facb8003a00 0x7facd0139b10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7facc4009bb0 tx=0x7facc4004730 comp rx=0 tx=0).stop 2024-05-27T10:53:04.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.395+0000 7facd7600640 1 -- 172.21.15.47:0/129620661 shutdown_connections 2024-05-27T10:53:04.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.395+0000 7facd7600640 1 --2- 172.21.15.47:0/129620661 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7facb006c920 0x7facb006ede0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.395+0000 7facd7600640 1 --2- 172.21.15.47:0/129620661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facd006f110 0x7facd006f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.395+0000 7facd7600640 1 --2- 172.21.15.47:0/129620661 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7facd0157280 0x7facd0157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.395+0000 7facd7600640 1 --2- 172.21.15.47:0/129620661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facb8003a00 0x7facd0139b10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.395+0000 7facd7600640 1 -- 172.21.15.47:0/129620661 >> 172.21.15.47:0/129620661 conn(0x7facd00b21e0 msgr2=0x7facd006e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:04.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.395+0000 7facd7600640 1 -- 172.21.15.47:0/129620661 shutdown_connections 2024-05-27T10:53:04.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.395+0000 7facd7600640 1 -- 172.21.15.47:0/129620661 wait complete. 2024-05-27T10:53:04.414 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T10:53:04.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.634+0000 7f87a9800640 1 Processor -- start 2024-05-27T10:53:04.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.634+0000 7f87a9800640 1 -- start start 2024-05-27T10:53:04.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.635+0000 7f87a9800640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f87a406d240 0x7f87a406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:04.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.635+0000 7f87a9800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f87a415eaa0 0x7f87a40cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:04.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.635+0000 7f87a9800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f87a406ca40 0x7f87a40cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:04.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.635+0000 7f87a9800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f87a40cf4b0 con 0x7f87a406ca40 2024-05-27T10:53:04.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.635+0000 7f87a9800640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f87a40cebc0 con 0x7f87a406d240 2024-05-27T10:53:04.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.635+0000 7f87a9800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f87a406db60 con 0x7f87a415eaa0 2024-05-27T10:53:04.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.636+0000 7f87a8e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f87a406ca40 0x7f87a40cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:04.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.636+0000 7f87a8e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f87a406ca40 0x7f87a40cfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55044/0 (socket says 172.21.15.47:55044) 2024-05-27T10:53:04.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.636+0000 7f87a8e00640 1 -- 172.21.15.47:0/3108338277 learned_addr learned my addr 172.21.15.47:0/3108338277 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:04.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.636+0000 7f87a3400640 1 --2- 172.21.15.47:0/3108338277 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f87a415eaa0 0x7f87a40cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:04.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.636+0000 7f87a3e00640 1 --2- 172.21.15.47:0/3108338277 >> v2:172.21.15.53:3300/0 conn(0x7f87a406d240 0x7f87a406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:04.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.636+0000 7f87a8e00640 1 -- 172.21.15.47:0/3108338277 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f87a415eaa0 msgr2=0x7f87a40cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:04.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.636+0000 7f87a8e00640 1 --2- 172.21.15.47:0/3108338277 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f87a415eaa0 0x7f87a40cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.636+0000 7f87a8e00640 1 -- 172.21.15.47:0/3108338277 >> v2:172.21.15.53:3300/0 conn(0x7f87a406d240 msgr2=0x7f87a406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:04.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.636+0000 7f87a8e00640 1 --2- 172.21.15.47:0/3108338277 >> v2:172.21.15.53:3300/0 conn(0x7f87a406d240 0x7f87a406d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.636+0000 7f87a8e00640 1 -- 172.21.15.47:0/3108338277 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a40cee60 con 0x7f87a406ca40 2024-05-27T10:53:04.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.637+0000 7f87a8e00640 1 --2- 172.21.15.47:0/3108338277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87a406ca40 0x7f87a40cfe80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f87a408c570 tx=0x7f879c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843e1f1f83e470cc server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:04.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.638+0000 7f87a2a00640 1 -- 172.21.15.47:0/3108338277 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879c036070 con 0x7f87a406ca40 2024-05-27T10:53:04.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.638+0000 7f87a2a00640 1 -- 172.21.15.47:0/3108338277 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f879c031600 con 0x7f87a406ca40 2024-05-27T10:53:04.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.638+0000 7f87a2a00640 1 -- 172.21.15.47:0/3108338277 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879c0319d0 con 0x7f87a406ca40 2024-05-27T10:53:04.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.638+0000 7f87a9800640 1 -- 172.21.15.47:0/3108338277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87a406ca40 msgr2=0x7f87a40cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:04.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.638+0000 7f87a9800640 1 --2- 172.21.15.47:0/3108338277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87a406ca40 0x7f87a40cfe80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f87a408c570 tx=0x7f879c02a6a0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.638+0000 7f87a9800640 1 -- 172.21.15.47:0/3108338277 shutdown_connections 2024-05-27T10:53:04.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.638+0000 7f87a9800640 1 --2- 172.21.15.47:0/3108338277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87a406ca40 0x7f87a40cfe80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.638+0000 7f87a9800640 1 --2- 172.21.15.47:0/3108338277 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f87a415eaa0 0x7f87a40cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.638+0000 7f87a9800640 1 --2- 172.21.15.47:0/3108338277 >> v2:172.21.15.53:3300/0 conn(0x7f87a406d240 0x7f87a406d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.638+0000 7f87a9800640 1 -- 172.21.15.47:0/3108338277 >> 172.21.15.47:0/3108338277 conn(0x7f87a408bfd0 msgr2=0x7f87a40d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:04.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.638+0000 7f87a9800640 1 -- 172.21.15.47:0/3108338277 shutdown_connections 2024-05-27T10:53:04.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.638+0000 7f87a9800640 1 -- 172.21.15.47:0/3108338277 wait complete. 2024-05-27T10:53:04.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.640+0000 7f87a9800640 1 Processor -- start 2024-05-27T10:53:04.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.640+0000 7f87a9800640 1 -- start start 2024-05-27T10:53:04.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.641+0000 7f87a9800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87a406ca40 0x7f87a40b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:04.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.641+0000 7f87a9800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f87a406d240 0x7f87a40c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:04.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.641+0000 7f87a9800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87a415eaa0 0x7f87a40ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:04.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.641+0000 7f87a9800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f87a40b10a0 con 0x7f87a406ca40 2024-05-27T10:53:04.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.641+0000 7f87a9800640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f87a406cf40 con 0x7f87a415eaa0 2024-05-27T10:53:04.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.641+0000 7f87a9800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f87a40b1220 con 0x7f87a406d240 2024-05-27T10:53:04.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.641+0000 7f87a3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87a406ca40 0x7f87a40b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:04.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.642+0000 7f87a3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87a406ca40 0x7f87a40b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55052/0 (socket says 172.21.15.47:55052) 2024-05-27T10:53:04.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.642+0000 7f87a3e00640 1 -- 172.21.15.47:0/4235011481 learned_addr learned my addr 172.21.15.47:0/4235011481 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:04.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.642+0000 7f87a3400640 1 --2- 172.21.15.47:0/4235011481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f87a406d240 0x7f87a40c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:04.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.642+0000 7f87a3e00640 1 -- 172.21.15.47:0/4235011481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f87a406d240 msgr2=0x7f87a40c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:04.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.642+0000 7f87a3e00640 1 --2- 172.21.15.47:0/4235011481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f87a406d240 0x7f87a40c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.642+0000 7f87a3e00640 1 -- 172.21.15.47:0/4235011481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87a415eaa0 msgr2=0x7f87a40ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:04.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.642+0000 7f87a8e00640 1 --2- 172.21.15.47:0/4235011481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87a415eaa0 0x7f87a40ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:04.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.642+0000 7f87a3e00640 1 --2- 172.21.15.47:0/4235011481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87a415eaa0 0x7f87a40ca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.642+0000 7f87a3e00640 1 -- 172.21.15.47:0/4235011481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a40c9370 con 0x7f87a406ca40 2024-05-27T10:53:04.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.642+0000 7f87a3e00640 1 --2- 172.21.15.47:0/4235011481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87a406ca40 0x7f87a40b70f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f878c00c7f0 tx=0x7f878c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:04.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.643+0000 7f879be00640 1 -- 172.21.15.47:0/4235011481 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c015070 con 0x7f87a406ca40 2024-05-27T10:53:04.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.643+0000 7f879be00640 1 -- 172.21.15.47:0/4235011481 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f878c004220 con 0x7f87a406ca40 2024-05-27T10:53:04.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.643+0000 7f87a9800640 1 -- 172.21.15.47:0/4235011481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87a4160c00 con 0x7f87a406ca40 2024-05-27T10:53:04.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.643+0000 7f879be00640 1 -- 172.21.15.47:0/4235011481 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c007620 con 0x7f87a406ca40 2024-05-27T10:53:04.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.643+0000 7f87a9800640 1 -- 172.21.15.47:0/4235011481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87a40c9610 con 0x7f87a406ca40 2024-05-27T10:53:04.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.644+0000 7f87a9800640 1 -- 172.21.15.47:0/4235011481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87a404fce0 con 0x7f87a406ca40 2024-05-27T10:53:04.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.645+0000 7f879be00640 1 -- 172.21.15.47:0/4235011481 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f878c007a50 con 0x7f87a406ca40 2024-05-27T10:53:04.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.646+0000 7f879be00640 1 --2- 172.21.15.47:0/4235011481 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f878006c8f0 0x7f878006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:04.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.646+0000 7f879be00640 1 -- 172.21.15.47:0/4235011481 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f878c08bf30 con 0x7f87a406ca40 2024-05-27T10:53:04.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.646+0000 7f87a3400640 1 --2- 172.21.15.47:0/4235011481 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f878006c8f0 0x7f878006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:04.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.647+0000 7f87a3400640 1 --2- 172.21.15.47:0/4235011481 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f878006c8f0 0x7f878006edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f87a40cad10 tx=0x7f8794008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:04.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.651+0000 7f879be00640 1 -- 172.21.15.47:0/4235011481 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f878c05a2e0 con 0x7f87a406ca40 2024-05-27T10:53:04.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.867+0000 7f87a9800640 1 -- 172.21.15.47:0/4235011481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f87a40ba350 con 0x7f87a406ca40 2024-05-27T10:53:04.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.867+0000 7f879be00640 1 -- 172.21.15.47:0/4235011481 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f878c059be0 con 0x7f87a406ca40 2024-05-27T10:53:04.865 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-05-27T10:53:04.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.870+0000 7f87a9800640 1 -- 172.21.15.47:0/4235011481 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f878006c8f0 msgr2=0x7f878006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:04.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.870+0000 7f87a9800640 1 --2- 172.21.15.47:0/4235011481 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f878006c8f0 0x7f878006edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f87a40cad10 tx=0x7f8794008040 comp rx=0 tx=0).stop 2024-05-27T10:53:04.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.870+0000 7f87a9800640 1 -- 172.21.15.47:0/4235011481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87a406ca40 msgr2=0x7f87a40b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:04.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.870+0000 7f87a9800640 1 --2- 172.21.15.47:0/4235011481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87a406ca40 0x7f87a40b70f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f878c00c7f0 tx=0x7f878c00ccb0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.870+0000 7f87a9800640 1 -- 172.21.15.47:0/4235011481 shutdown_connections 2024-05-27T10:53:04.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.870+0000 7f87a9800640 1 --2- 172.21.15.47:0/4235011481 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f878006c8f0 0x7f878006edb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.870+0000 7f87a9800640 1 --2- 172.21.15.47:0/4235011481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87a415eaa0 0x7f87a40ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.870+0000 7f87a9800640 1 --2- 172.21.15.47:0/4235011481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f87a406d240 0x7f87a40c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.870+0000 7f87a9800640 1 --2- 172.21.15.47:0/4235011481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87a406ca40 0x7f87a40b70f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:04.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.870+0000 7f87a9800640 1 -- 172.21.15.47:0/4235011481 >> 172.21.15.47:0/4235011481 conn(0x7f87a408bfd0 msgr2=0x7f87a40b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:04.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.871+0000 7f87a9800640 1 -- 172.21.15.47:0/4235011481 shutdown_connections 2024-05-27T10:53:04.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:04.871+0000 7f87a9800640 1 -- 172.21.15.47:0/4235011481 wait complete. 2024-05-27T10:53:04.889 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2024-05-27T10:53:04.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:53:04.889 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-05-27T10:53:04.980 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T10:53:04.986 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-05-27T10:53:04.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:53:04.987 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-27T10:53:05.042 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-27T10:53:05.042 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T10:53:05.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.264+0000 7fb36ce00640 1 Processor -- start 2024-05-27T10:53:05.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.264+0000 7fb36ce00640 1 -- start start 2024-05-27T10:53:05.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.266+0000 7fb36ce00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb3680d30d0 0x7fb3680b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:05.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.266+0000 7fb36ce00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb3680b6540 0x7fb36806ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:05.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.266+0000 7fb36ce00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3680d3550 con 0x7fb36815e880 2024-05-27T10:53:05.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.266+0000 7fb36ce00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb3680d20c0 con 0x7fb3680d30d0 2024-05-27T10:53:05.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.266+0000 7fb36ce00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb3680d2c40 con 0x7fb3680b6540 2024-05-27T10:53:05.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.266+0000 7fb366a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb3680d30d0 0x7fb3680b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:05.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.267+0000 7fb366a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb3680d30d0 0x7fb3680b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55058/0 (socket says 172.21.15.47:55058) 2024-05-27T10:53:05.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.267+0000 7fb366a00640 1 -- 172.21.15.47:0/2912807540 learned_addr learned my addr 172.21.15.47:0/2912807540 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:05.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.267+0000 7fb367e00640 1 --2- 172.21.15.47:0/2912807540 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb3680b6540 0x7fb36806ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:05.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.267+0000 7fb366a00640 1 -- 172.21.15.47:0/2912807540 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb3680b6540 msgr2=0x7fb36806ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:05.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.267+0000 7fb366a00640 1 --2- 172.21.15.47:0/2912807540 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb3680b6540 0x7fb36806ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:05.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.267+0000 7fb366a00640 1 -- 172.21.15.47:0/2912807540 >> v1:172.21.15.53:6789/0 conn(0x7fb36815e880 legacy=0x7fb3680cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:05.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.267+0000 7fb366a00640 1 -- 172.21.15.47:0/2912807540 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3680d2310 con 0x7fb3680d30d0 2024-05-27T10:53:05.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.268+0000 7fb366a00640 1 --2- 172.21.15.47:0/2912807540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3680d30d0 0x7fb3680b6000 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb354009870 tx=0x7fb35402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e058d89451c868 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:05.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.269+0000 7fb366000640 1 -- 172.21.15.47:0/2912807540 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354037070 con 0x7fb3680d30d0 2024-05-27T10:53:05.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.269+0000 7fb366000640 1 -- 172.21.15.47:0/2912807540 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb35402ae10 con 0x7fb3680d30d0 2024-05-27T10:53:05.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.269+0000 7fb366000640 1 -- 172.21.15.47:0/2912807540 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354032660 con 0x7fb3680d30d0 2024-05-27T10:53:05.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.269+0000 7fb36ce00640 1 -- 172.21.15.47:0/2912807540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3680d30d0 msgr2=0x7fb3680b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:05.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.269+0000 7fb36ce00640 1 --2- 172.21.15.47:0/2912807540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3680d30d0 0x7fb3680b6000 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb354009870 tx=0x7fb35402a100 comp rx=0 tx=0).stop 2024-05-27T10:53:05.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.269+0000 7fb36ce00640 1 -- 172.21.15.47:0/2912807540 shutdown_connections 2024-05-27T10:53:05.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.270+0000 7fb36ce00640 1 --2- 172.21.15.47:0/2912807540 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb3680b6540 0x7fb36806ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:05.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.270+0000 7fb36ce00640 1 --2- 172.21.15.47:0/2912807540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3680d30d0 0x7fb3680b6000 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:05.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.270+0000 7fb36ce00640 1 -- 172.21.15.47:0/2912807540 >> 172.21.15.47:0/2912807540 conn(0x7fb36808bfd0 msgr2=0x7fb3680d4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:05.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.270+0000 7fb36ce00640 1 -- 172.21.15.47:0/2912807540 shutdown_connections 2024-05-27T10:53:05.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.270+0000 7fb36ce00640 1 -- 172.21.15.47:0/2912807540 wait complete. 2024-05-27T10:53:05.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.271+0000 7fb36ce00640 1 Processor -- start 2024-05-27T10:53:05.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.272+0000 7fb36ce00640 1 -- start start 2024-05-27T10:53:05.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.273+0000 7fb36ce00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb3680b6540 0x7fb3680cf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:05.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.273+0000 7fb36ce00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3680d30d0 0x7fb36815f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:05.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.273+0000 7fb36ce00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb36815e880 0x7fb36815f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:05.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.273+0000 7fb36ce00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb3680d50a0 con 0x7fb36815e880 2024-05-27T10:53:05.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.273+0000 7fb36ce00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb3680d28d0 con 0x7fb3680d30d0 2024-05-27T10:53:05.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.273+0000 7fb36ce00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb36815ec60 con 0x7fb3680b6540 2024-05-27T10:53:05.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.273+0000 7fb367e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb36815e880 0x7fb36815f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:05.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.273+0000 7fb367e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb36815e880 0x7fb36815f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55060/0 (socket says 172.21.15.47:55060) 2024-05-27T10:53:05.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.273+0000 7fb367e00640 1 -- 172.21.15.47:0/2620338515 learned_addr learned my addr 172.21.15.47:0/2620338515 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:05.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.273+0000 7fb367400640 1 --2- 172.21.15.47:0/2620338515 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb3680b6540 0x7fb3680cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:05.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.273+0000 7fb366a00640 1 --2- 172.21.15.47:0/2620338515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3680d30d0 0x7fb36815f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:05.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.273+0000 7fb367e00640 1 -- 172.21.15.47:0/2620338515 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb3680b6540 msgr2=0x7fb3680cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:05.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.273+0000 7fb367e00640 1 --2- 172.21.15.47:0/2620338515 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb3680b6540 0x7fb3680cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:05.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.273+0000 7fb367e00640 1 -- 172.21.15.47:0/2620338515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3680d30d0 msgr2=0x7fb36815f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:05.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.273+0000 7fb367e00640 1 --2- 172.21.15.47:0/2620338515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3680d30d0 0x7fb36815f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:05.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.273+0000 7fb367e00640 1 -- 172.21.15.47:0/2620338515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb36815fd70 con 0x7fb36815e880 2024-05-27T10:53:05.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.273+0000 7fb367400640 1 --2- 172.21.15.47:0/2620338515 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb3680b6540 0x7fb3680cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:05.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.274+0000 7fb367e00640 1 --2- 172.21.15.47:0/2620338515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb36815e880 0x7fb36815f540 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb360007e90 tx=0x7fb36000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:05.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.274+0000 7fb35f400640 1 -- 172.21.15.47:0/2620338515 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb360014420 con 0x7fb36815e880 2024-05-27T10:53:05.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.274+0000 7fb35f400640 1 -- 172.21.15.47:0/2620338515 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb360019070 con 0x7fb36815e880 2024-05-27T10:53:05.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.274+0000 7fb35f400640 1 -- 172.21.15.47:0/2620338515 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb360014800 con 0x7fb36815e880 2024-05-27T10:53:05.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.274+0000 7fb36ce00640 1 -- 172.21.15.47:0/2620338515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb368160050 con 0x7fb36815e880 2024-05-27T10:53:05.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.274+0000 7fb36ce00640 1 -- 172.21.15.47:0/2620338515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb368160610 con 0x7fb36815e880 2024-05-27T10:53:05.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.275+0000 7fb36ce00640 1 -- 172.21.15.47:0/2620338515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb36804fce0 con 0x7fb36815e880 2024-05-27T10:53:05.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.276+0000 7fb35f400640 1 -- 172.21.15.47:0/2620338515 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb3600149a0 con 0x7fb36815e880 2024-05-27T10:53:05.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.277+0000 7fb35f400640 1 --2- 172.21.15.47:0/2620338515 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb34806c8f0 0x7fb34806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:05.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.278+0000 7fb35f400640 1 -- 172.21.15.47:0/2620338515 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fb36008c490 con 0x7fb36815e880 2024-05-27T10:53:05.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.278+0000 7fb367400640 1 --2- 172.21.15.47:0/2620338515 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb34806c8f0 0x7fb34806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:05.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.278+0000 7fb367400640 1 --2- 172.21.15.47:0/2620338515 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb34806c8f0 0x7fb34806edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb35800a830 tx=0x7fb358008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:05.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.282+0000 7fb35f400640 1 -- 172.21.15.47:0/2620338515 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb36005a830 con 0x7fb36815e880 2024-05-27T10:53:05.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.528+0000 7fb36ce00640 1 -- 172.21.15.47:0/2620338515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3680b6ca0 con 0x7fb36815e880 2024-05-27T10:53:05.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.529+0000 7fb35f400640 1 -- 172.21.15.47:0/2620338515 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7fb36005a130 con 0x7fb36815e880 2024-05-27T10:53:05.527 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:53:05.527 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/4062514569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4062514569},{"type":"v1","addr":"172.21.15.47:6836","nonce":4062514569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/4113289884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":4113289884},{"type":"v1","addr":"172.21.15.53:6834","nonce":4113289884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3409529039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":3409529039},{"type":"v1","addr":"172.21.15.47:6837","nonce":3409529039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T10:52:01.683075+0000","modified":"2024-05-27T10:52:04.791891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6835/4292385883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":4292385883},{"type":"v1","addr":"172.21.15.53:6835","nonce":4292385883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-27T10:53:05.527 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-05-27T10:53:05.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.532+0000 7fb36ce00640 1 -- 172.21.15.47:0/2620338515 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb34806c8f0 msgr2=0x7fb34806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:05.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.532+0000 7fb36ce00640 1 --2- 172.21.15.47:0/2620338515 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb34806c8f0 0x7fb34806edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb35800a830 tx=0x7fb358008040 comp rx=0 tx=0).stop 2024-05-27T10:53:05.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.532+0000 7fb36ce00640 1 -- 172.21.15.47:0/2620338515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb36815e880 msgr2=0x7fb36815f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:05.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.532+0000 7fb36ce00640 1 --2- 172.21.15.47:0/2620338515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb36815e880 0x7fb36815f540 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb360007e90 tx=0x7fb36000e4b0 comp rx=0 tx=0).stop 2024-05-27T10:53:05.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.532+0000 7fb36ce00640 1 -- 172.21.15.47:0/2620338515 shutdown_connections 2024-05-27T10:53:05.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.532+0000 7fb36ce00640 1 --2- 172.21.15.47:0/2620338515 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb34806c8f0 0x7fb34806edb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:05.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.532+0000 7fb36ce00640 1 --2- 172.21.15.47:0/2620338515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb36815e880 0x7fb36815f540 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:05.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.532+0000 7fb36ce00640 1 --2- 172.21.15.47:0/2620338515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3680d30d0 0x7fb36815f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:05.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.532+0000 7fb36ce00640 1 --2- 172.21.15.47:0/2620338515 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb3680b6540 0x7fb3680cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:05.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.532+0000 7fb36ce00640 1 -- 172.21.15.47:0/2620338515 >> 172.21.15.47:0/2620338515 conn(0x7fb36808bfd0 msgr2=0x7fb3680b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:05.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.533+0000 7fb36ce00640 1 -- 172.21.15.47:0/2620338515 shutdown_connections 2024-05-27T10:53:05.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.533+0000 7fb36ce00640 1 -- 172.21.15.47:0/2620338515 wait complete. 2024-05-27T10:53:05.552 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:53:05.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.765+0000 7f325ca00640 1 Processor -- start 2024-05-27T10:53:05.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.765+0000 7f325ca00640 1 -- start start 2024-05-27T10:53:05.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.766+0000 7f325ca00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f325815b380 0x7f32580d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:05.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.766+0000 7f325ca00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f32580d08a0 0x7f325806e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:05.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.766+0000 7f325ca00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f325806f3a0 con 0x7f325806ebd0 2024-05-27T10:53:05.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.766+0000 7f325ca00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f32580adcc0 con 0x7f32580d08a0 2024-05-27T10:53:05.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.766+0000 7f325ca00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f325806ff20 con 0x7f325815b380 2024-05-27T10:53:05.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.767+0000 7f3257200640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f325806ebd0 0x7f32580b43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51690/0 (socket says 172.21.15.47:51690) 2024-05-27T10:53:05.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.767+0000 7f3257200640 1 -- 172.21.15.47:0/278536124 learned_addr learned my addr 172.21.15.47:0/278536124 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:05.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.767+0000 7f3256800640 1 --2- 172.21.15.47:0/278536124 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f325815b380 0x7f32580d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:05.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.767+0000 7f324de00640 1 --2- 172.21.15.47:0/278536124 >> v2:172.21.15.53:3300/0 conn(0x7f32580d08a0 0x7f325806e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:05.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.767+0000 7f3255e00640 1 -- 172.21.15.47:0/278536124 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2841927510 0 0) 0x7f325806f3a0 con 0x7f325806ebd0 2024-05-27T10:53:05.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.767+0000 7f3255e00640 1 -- 172.21.15.47:0/278536124 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f323c003520 con 0x7f325806ebd0 2024-05-27T10:53:05.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.768+0000 7f3255e00640 1 -- 172.21.15.47:0/278536124 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3427531138 0 0) 0x7f323c003520 con 0x7f325806ebd0 2024-05-27T10:53:05.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.768+0000 7f3255e00640 1 -- 172.21.15.47:0/278536124 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f325815b380 msgr2=0x7f32580d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:05.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.768+0000 7f3255e00640 1 --2- 172.21.15.47:0/278536124 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f325815b380 0x7f32580d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:05.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.768+0000 7f3255e00640 1 -- 172.21.15.47:0/278536124 >> v2:172.21.15.53:3300/0 conn(0x7f32580d08a0 msgr2=0x7f325806e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:05.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.768+0000 7f3255e00640 1 --2- 172.21.15.47:0/278536124 >> v2:172.21.15.53:3300/0 conn(0x7f32580d08a0 0x7f325806e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:05.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.768+0000 7f3255e00640 1 -- 172.21.15.47:0/278536124 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f325806f680 con 0x7f325806ebd0 2024-05-27T10:53:05.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.768+0000 7f3255e00640 1 -- 172.21.15.47:0/278536124 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f32500019f0 con 0x7f325806ebd0 2024-05-27T10:53:05.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.768+0000 7f3255e00640 1 -- 172.21.15.47:0/278536124 >> v1:172.21.15.47:6789/0 conn(0x7f325806ebd0 legacy=0x7f32580b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:05.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.768+0000 7f3255e00640 1 --2- 172.21.15.47:0/278536124 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f325815b380 0x7f323c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:05.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.768+0000 7f3255e00640 1 --2- 172.21.15.47:0/278536124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f323c004030 0x7f323c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:05.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.768+0000 7f3255e00640 1 --2- 172.21.15.47:0/278536124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f323c004d40 0x7f323c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:05.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.768+0000 7f3255e00640 1 -- 172.21.15.47:0/278536124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f325806ff20 con 0x7f323c004030 2024-05-27T10:53:05.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.768+0000 7f3255e00640 1 -- 172.21.15.47:0/278536124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f323c00dd60 con 0x7f323c004d40 2024-05-27T10:53:05.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.768+0000 7f3255e00640 1 -- 172.21.15.47:0/278536124 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f323c00df60 con 0x7f325815b380 2024-05-27T10:53:05.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.768+0000 7f324de00640 1 --2- 172.21.15.47:0/278536124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f323c004030 0x7f323c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:05.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.769+0000 7f3256800640 1 --2- 172.21.15.47:0/278536124 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f325815b380 0x7f323c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:05.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.769+0000 7f3257200640 1 --2- 172.21.15.47:0/278536124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f323c004d40 0x7f323c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:05.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.769+0000 7f324de00640 1 -- 172.21.15.47:0/278536124 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f325815b380 msgr2=0x7f323c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:05.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.769+0000 7f324de00640 1 --2- 172.21.15.47:0/278536124 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f325815b380 0x7f323c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:05.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.769+0000 7f324de00640 1 -- 172.21.15.47:0/278536124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f323c004d40 msgr2=0x7f323c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:05.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.769+0000 7f324de00640 1 --2- 172.21.15.47:0/278536124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f323c004d40 0x7f323c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:05.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.769+0000 7f324de00640 1 -- 172.21.15.47:0/278536124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323c003520 con 0x7f323c004030 2024-05-27T10:53:05.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.770+0000 7f324de00640 1 --2- 172.21.15.47:0/278536124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f323c004030 0x7f323c004800 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f324000ba30 tx=0x7f323c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452cb991e1e4661c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:05.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.770+0000 7f3255e00640 1 -- 172.21.15.47:0/278536124 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3240030070 con 0x7f323c004030 2024-05-27T10:53:05.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.770+0000 7f3255e00640 1 -- 172.21.15.47:0/278536124 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f324002ae10 con 0x7f323c004030 2024-05-27T10:53:05.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.770+0000 7f3255e00640 1 -- 172.21.15.47:0/278536124 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324000b600 con 0x7f323c004030 2024-05-27T10:53:05.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.771+0000 7f325ca00640 1 -- 172.21.15.47:0/278536124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f323c004030 msgr2=0x7f323c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:05.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.771+0000 7f325ca00640 1 --2- 172.21.15.47:0/278536124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f323c004030 0x7f323c004800 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f324000ba30 tx=0x7f323c005830 comp rx=0 tx=0).stop 2024-05-27T10:53:05.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.771+0000 7f3257200640 1 -- 172.21.15.47:0/278536124 reap_dead start 2024-05-27T10:53:05.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.771+0000 7f325ca00640 1 -- 172.21.15.47:0/278536124 shutdown_connections 2024-05-27T10:53:05.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.771+0000 7f325ca00640 1 -- 172.21.15.47:0/278536124 >> 172.21.15.47:0/278536124 conn(0x7f325806bb20 msgr2=0x7f325806bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:05.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.771+0000 7f325ca00640 1 -- 172.21.15.47:0/278536124 shutdown_connections 2024-05-27T10:53:05.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.771+0000 7f325ca00640 1 -- 172.21.15.47:0/278536124 wait complete. 2024-05-27T10:53:05.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.773+0000 7f325ca00640 1 Processor -- start 2024-05-27T10:53:05.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.773+0000 7f325ca00640 1 -- start start 2024-05-27T10:53:05.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.774+0000 7f325ca00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f323c004030 0x7f32581f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:05.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.774+0000 7f325ca00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f32581f7050 0x7f325815a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:05.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.774+0000 7f325ca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32581f74d0 0x7f325815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:05.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.774+0000 7f325ca00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f325806fc40 con 0x7f32581f74d0 2024-05-27T10:53:05.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.774+0000 7f325ca00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f32580d0ce0 con 0x7f323c004030 2024-05-27T10:53:05.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.774+0000 7f325ca00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f325806f020 con 0x7f32581f7050 2024-05-27T10:53:05.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.774+0000 7f3257200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32581f74d0 0x7f325815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:05.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.775+0000 7f3257200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32581f74d0 0x7f325815a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55076/0 (socket says 172.21.15.47:55076) 2024-05-27T10:53:05.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.775+0000 7f3257200640 1 -- 172.21.15.47:0/4166009018 learned_addr learned my addr 172.21.15.47:0/4166009018 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:05.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.775+0000 7f324de00640 1 --2- 172.21.15.47:0/4166009018 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f32581f7050 0x7f325815a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:05.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.775+0000 7f3256800640 1 --2- 172.21.15.47:0/4166009018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f323c004030 0x7f32581f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:05.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.775+0000 7f3257200640 1 -- 172.21.15.47:0/4166009018 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f32581f7050 msgr2=0x7f325815a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:05.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.775+0000 7f3257200640 1 --2- 172.21.15.47:0/4166009018 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f32581f7050 0x7f325815a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:05.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.775+0000 7f3257200640 1 -- 172.21.15.47:0/4166009018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f323c004030 msgr2=0x7f32581f5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:05.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.775+0000 7f3257200640 1 --2- 172.21.15.47:0/4166009018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f323c004030 0x7f32581f5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:05.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.775+0000 7f3257200640 1 -- 172.21.15.47:0/4166009018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f325809a3f0 con 0x7f32581f74d0 2024-05-27T10:53:05.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.775+0000 7f324de00640 1 --2- 172.21.15.47:0/4166009018 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f32581f7050 0x7f325815a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:05.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.775+0000 7f3257200640 1 --2- 172.21.15.47:0/4166009018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32581f74d0 0x7f325815a5e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f32500013d0 tx=0x7f325000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:05.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.775+0000 7f324f400640 1 -- 172.21.15.47:0/4166009018 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325000ec10 con 0x7f32581f74d0 2024-05-27T10:53:05.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.776+0000 7f324f400640 1 -- 172.21.15.47:0/4166009018 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3250018070 con 0x7f32581f74d0 2024-05-27T10:53:05.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.776+0000 7f324f400640 1 -- 172.21.15.47:0/4166009018 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3250013420 con 0x7f32581f74d0 2024-05-27T10:53:05.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.776+0000 7f325ca00640 1 -- 172.21.15.47:0/4166009018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f325809a6d0 con 0x7f32581f74d0 2024-05-27T10:53:05.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.776+0000 7f325ca00640 1 -- 172.21.15.47:0/4166009018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32581f4580 con 0x7f32581f74d0 2024-05-27T10:53:05.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.777+0000 7f325ca00640 1 -- 172.21.15.47:0/4166009018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f325804fce0 con 0x7f32581f74d0 2024-05-27T10:53:05.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.778+0000 7f324f400640 1 -- 172.21.15.47:0/4166009018 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f32500135c0 con 0x7f32581f74d0 2024-05-27T10:53:05.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.779+0000 7f324f400640 1 --2- 172.21.15.47:0/4166009018 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f323406c8f0 0x7f323406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:05.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.779+0000 7f324f400640 1 -- 172.21.15.47:0/4166009018 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f325008bee0 con 0x7f32581f74d0 2024-05-27T10:53:05.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.780+0000 7f3256800640 1 --2- 172.21.15.47:0/4166009018 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f323406c8f0 0x7f323406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:05.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.780+0000 7f3256800640 1 --2- 172.21.15.47:0/4166009018 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f323406c8f0 0x7f323406edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3248006fd0 tx=0x7f3248008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:05.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.784+0000 7f324f400640 1 -- 172.21.15.47:0/4166009018 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f325005a290 con 0x7f32581f74d0 2024-05-27T10:53:05.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:05.997+0000 7f325ca00640 1 -- 172.21.15.47:0/4166009018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32580b4e30 con 0x7f32581f74d0 2024-05-27T10:53:05.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.000+0000 7f324f400640 1 -- 172.21.15.47:0/4166009018 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16770 (secure 0 0 0) 0x7f3250059b90 con 0x7f32581f74d0 2024-05-27T10:53:05.998 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:53:05.998 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":22,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:48.545555+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:53:06.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.002+0000 7f325ca00640 1 -- 172.21.15.47:0/4166009018 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f323406c8f0 msgr2=0x7f323406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:06.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.003+0000 7f325ca00640 1 --2- 172.21.15.47:0/4166009018 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f323406c8f0 0x7f323406edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3248006fd0 tx=0x7f3248008040 comp rx=0 tx=0).stop 2024-05-27T10:53:06.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.003+0000 7f325ca00640 1 -- 172.21.15.47:0/4166009018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32581f74d0 msgr2=0x7f325815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:06.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.003+0000 7f325ca00640 1 --2- 172.21.15.47:0/4166009018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32581f74d0 0x7f325815a5e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f32500013d0 tx=0x7f325000e530 comp rx=0 tx=0).stop 2024-05-27T10:53:06.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.003+0000 7f325ca00640 1 -- 172.21.15.47:0/4166009018 shutdown_connections 2024-05-27T10:53:06.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.003+0000 7f325ca00640 1 --2- 172.21.15.47:0/4166009018 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f323406c8f0 0x7f323406edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.003+0000 7f325ca00640 1 --2- 172.21.15.47:0/4166009018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32581f74d0 0x7f325815a5e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.003+0000 7f325ca00640 1 --2- 172.21.15.47:0/4166009018 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f32581f7050 0x7f325815a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.003+0000 7f325ca00640 1 --2- 172.21.15.47:0/4166009018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f323c004030 0x7f32581f5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.003+0000 7f325ca00640 1 -- 172.21.15.47:0/4166009018 >> 172.21.15.47:0/4166009018 conn(0x7f325806bb20 msgr2=0x7f32580b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:06.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.003+0000 7f325ca00640 1 -- 172.21.15.47:0/4166009018 shutdown_connections 2024-05-27T10:53:06.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.003+0000 7f325ca00640 1 -- 172.21.15.47:0/4166009018 wait complete. 2024-05-27T10:53:06.021 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T10:51:55.073251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T10:51:59.202702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T10:52:00.664039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T10:53:06.022 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T10:53:06.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.239+0000 7ff96ac00640 1 Processor -- start 2024-05-27T10:53:06.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.240+0000 7ff96ac00640 1 -- start start 2024-05-27T10:53:06.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.241+0000 7ff96ac00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9640d0a30 0x7ff964167470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:06.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.241+0000 7ff96ac00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9640b4620 con 0x7ff96406da80 2024-05-27T10:53:06.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.241+0000 7ff96ac00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9640b4900 con 0x7ff96415c510 2024-05-27T10:53:06.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.241+0000 7ff96ac00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff9640b43e0 con 0x7ff9640d0a30 2024-05-27T10:53:06.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.242+0000 7ff968e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff96406da80 0x7ff9640d0320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51696/0 (socket says 172.21.15.47:51696) 2024-05-27T10:53:06.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.242+0000 7ff968e00640 1 -- 172.21.15.47:0/1435516884 learned_addr learned my addr 172.21.15.47:0/1435516884 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:06.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.242+0000 7ff96a200640 1 --2- 172.21.15.47:0/1435516884 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9640d0a30 0x7ff964167470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:06.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.242+0000 7ff963e00640 1 -- 172.21.15.47:0/1435516884 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2362793386 0 0) 0x7ff9640b4620 con 0x7ff96406da80 2024-05-27T10:53:06.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.242+0000 7ff963e00640 1 -- 172.21.15.47:0/1435516884 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff94c003520 con 0x7ff96406da80 2024-05-27T10:53:06.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.242+0000 7ff963e00640 1 -- 172.21.15.47:0/1435516884 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2479608216 0 0) 0x7ff94c003520 con 0x7ff96406da80 2024-05-27T10:53:06.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.242+0000 7ff963e00640 1 -- 172.21.15.47:0/1435516884 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9640d0a30 msgr2=0x7ff964167470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:06.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.242+0000 7ff963e00640 1 --2- 172.21.15.47:0/1435516884 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9640d0a30 0x7ff964167470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.242+0000 7ff963e00640 1 -- 172.21.15.47:0/1435516884 >> v1:172.21.15.53:6789/0 conn(0x7ff96415c510 legacy=0x7ff9640b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:06.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.243+0000 7ff963e00640 1 -- 172.21.15.47:0/1435516884 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9640b4be0 con 0x7ff96406da80 2024-05-27T10:53:06.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.243+0000 7ff963e00640 1 -- 172.21.15.47:0/1435516884 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7ff950001670 con 0x7ff96406da80 2024-05-27T10:53:06.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.243+0000 7ff963e00640 1 -- 172.21.15.47:0/1435516884 >> v1:172.21.15.47:6789/0 conn(0x7ff96406da80 legacy=0x7ff9640d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:06.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.243+0000 7ff963e00640 1 --2- 172.21.15.47:0/1435516884 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9640d0a30 0x7ff94c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:06.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.243+0000 7ff963e00640 1 --2- 172.21.15.47:0/1435516884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff94c003f60 0x7ff94c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:06.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.243+0000 7ff963e00640 1 --2- 172.21.15.47:0/1435516884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff94c004d40 0x7ff94c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:06.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.243+0000 7ff963e00640 1 -- 172.21.15.47:0/1435516884 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff9640b43e0 con 0x7ff94c004d40 2024-05-27T10:53:06.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.243+0000 7ff963e00640 1 -- 172.21.15.47:0/1435516884 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c00baa0 con 0x7ff94c003f60 2024-05-27T10:53:06.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.243+0000 7ff963e00640 1 -- 172.21.15.47:0/1435516884 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff94c00bca0 con 0x7ff9640d0a30 2024-05-27T10:53:06.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.243+0000 7ff96a200640 1 --2- 172.21.15.47:0/1435516884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff94c004d40 0x7ff94c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:06.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.243+0000 7ff969800640 1 --2- 172.21.15.47:0/1435516884 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9640d0a30 0x7ff94c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:06.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.243+0000 7ff96a200640 1 -- 172.21.15.47:0/1435516884 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9640d0a30 msgr2=0x7ff94c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:06.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.243+0000 7ff96a200640 1 --2- 172.21.15.47:0/1435516884 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9640d0a30 0x7ff94c0039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.243+0000 7ff96a200640 1 -- 172.21.15.47:0/1435516884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff94c003f60 msgr2=0x7ff94c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:06.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.243+0000 7ff96a200640 1 --2- 172.21.15.47:0/1435516884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff94c003f60 0x7ff94c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.243+0000 7ff96a200640 1 -- 172.21.15.47:0/1435516884 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94c003520 con 0x7ff94c004d40 2024-05-27T10:53:06.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.245+0000 7ff96a200640 1 --2- 172.21.15.47:0/1435516884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff94c004d40 0x7ff94c0051c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009fc0 tx=0x7ff94c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c0f3d1d28e8bb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:06.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.245+0000 7ff963e00640 1 -- 172.21.15.47:0/1435516884 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95c009c10 con 0x7ff94c004d40 2024-05-27T10:53:06.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.245+0000 7ff963e00640 1 -- 172.21.15.47:0/1435516884 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff95c036070 con 0x7ff94c004d40 2024-05-27T10:53:06.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.245+0000 7ff963e00640 1 -- 172.21.15.47:0/1435516884 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95c031880 con 0x7ff94c004d40 2024-05-27T10:53:06.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.245+0000 7ff96ac00640 1 -- 172.21.15.47:0/1435516884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff94c004d40 msgr2=0x7ff94c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:06.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.245+0000 7ff96ac00640 1 --2- 172.21.15.47:0/1435516884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff94c004d40 0x7ff94c0051c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009fc0 tx=0x7ff94c005830 comp rx=0 tx=0).stop 2024-05-27T10:53:06.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.245+0000 7ff96a200640 1 -- 172.21.15.47:0/1435516884 reap_dead start 2024-05-27T10:53:06.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.245+0000 7ff96ac00640 1 -- 172.21.15.47:0/1435516884 shutdown_connections 2024-05-27T10:53:06.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.245+0000 7ff96ac00640 1 -- 172.21.15.47:0/1435516884 >> 172.21.15.47:0/1435516884 conn(0x7ff96406bb20 msgr2=0x7ff96406bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:06.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.246+0000 7ff96ac00640 1 -- 172.21.15.47:0/1435516884 shutdown_connections 2024-05-27T10:53:06.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.246+0000 7ff96ac00640 1 -- 172.21.15.47:0/1435516884 wait complete. 2024-05-27T10:53:06.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.247+0000 7ff96ac00640 1 Processor -- start 2024-05-27T10:53:06.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.247+0000 7ff96ac00640 1 -- start start 2024-05-27T10:53:06.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.248+0000 7ff96ac00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9641463b0 0x7ff964153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:06.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.248+0000 7ff96ac00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff964146790 0x7ff96415ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:06.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.248+0000 7ff96ac00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9640affa0 0x7ff9640b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:06.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.248+0000 7ff96ac00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff9640cfa00 con 0x7ff9640affa0 2024-05-27T10:53:06.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.248+0000 7ff96ac00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff96415c8f0 con 0x7ff9641463b0 2024-05-27T10:53:06.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.248+0000 7ff96ac00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff9640cfb80 con 0x7ff964146790 2024-05-27T10:53:06.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.249+0000 7ff96a200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9640affa0 0x7ff9640b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:06.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.249+0000 7ff96a200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9640affa0 0x7ff9640b0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55094/0 (socket says 172.21.15.47:55094) 2024-05-27T10:53:06.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.249+0000 7ff96a200640 1 -- 172.21.15.47:0/3324052758 learned_addr learned my addr 172.21.15.47:0/3324052758 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:06.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.249+0000 7ff969800640 1 --2- 172.21.15.47:0/3324052758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9641463b0 0x7ff964153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:06.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.249+0000 7ff968e00640 1 --2- 172.21.15.47:0/3324052758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff964146790 0x7ff96415ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:06.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.249+0000 7ff96a200640 1 -- 172.21.15.47:0/3324052758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff964146790 msgr2=0x7ff96415ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:06.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.249+0000 7ff96a200640 1 --2- 172.21.15.47:0/3324052758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff964146790 0x7ff96415ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.249+0000 7ff96a200640 1 -- 172.21.15.47:0/3324052758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9641463b0 msgr2=0x7ff964153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:06.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.249+0000 7ff96a200640 1 --2- 172.21.15.47:0/3324052758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9641463b0 0x7ff964153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.249+0000 7ff96a200640 1 -- 172.21.15.47:0/3324052758 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96415cfb0 con 0x7ff9640affa0 2024-05-27T10:53:06.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.250+0000 7ff96a200640 1 --2- 172.21.15.47:0/3324052758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9640affa0 0x7ff9640b0430 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00e230 tx=0x7ff95c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:06.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.250+0000 7ff961600640 1 -- 172.21.15.47:0/3324052758 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95c009c10 con 0x7ff9640affa0 2024-05-27T10:53:06.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.250+0000 7ff961600640 1 -- 172.21.15.47:0/3324052758 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff95c031df0 con 0x7ff9640affa0 2024-05-27T10:53:06.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.250+0000 7ff961600640 1 -- 172.21.15.47:0/3324052758 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95c003bd0 con 0x7ff9640affa0 2024-05-27T10:53:06.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.250+0000 7ff96ac00640 1 -- 172.21.15.47:0/3324052758 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff96415d230 con 0x7ff9640affa0 2024-05-27T10:53:06.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.250+0000 7ff96ac00640 1 -- 172.21.15.47:0/3324052758 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff96415d7f0 con 0x7ff9640affa0 2024-05-27T10:53:06.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.252+0000 7ff96ac00640 1 -- 172.21.15.47:0/3324052758 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff96404fce0 con 0x7ff9640affa0 2024-05-27T10:53:06.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.253+0000 7ff961600640 1 -- 172.21.15.47:0/3324052758 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff95c005d10 con 0x7ff9640affa0 2024-05-27T10:53:06.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.254+0000 7ff961600640 1 --2- 172.21.15.47:0/3324052758 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff94406c8f0 0x7ff94406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:06.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.254+0000 7ff961600640 1 -- 172.21.15.47:0/3324052758 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ff95c0acee0 con 0x7ff9640affa0 2024-05-27T10:53:06.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.254+0000 7ff969800640 1 --2- 172.21.15.47:0/3324052758 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff94406c8f0 0x7ff94406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:06.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.255+0000 7ff969800640 1 --2- 172.21.15.47:0/3324052758 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff94406c8f0 0x7ff94406edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff958001710 tx=0x7ff958009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:06.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.259+0000 7ff961600640 1 -- 172.21.15.47:0/3324052758 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff95c04a060 con 0x7ff9640affa0 2024-05-27T10:53:06.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.468+0000 7ff96ac00640 1 -- 172.21.15.47:0/3324052758 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff9640ce430 con 0x7ff9640affa0 2024-05-27T10:53:06.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.469+0000 7ff961600640 1 -- 172.21.15.47:0/3324052758 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7ff96415cfb0 con 0x7ff9640affa0 2024-05-27T10:53:06.467 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-27T10:53:06.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.471+0000 7ff96ac00640 1 -- 172.21.15.47:0/3324052758 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff94406c8f0 msgr2=0x7ff94406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:06.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.471+0000 7ff96ac00640 1 --2- 172.21.15.47:0/3324052758 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff94406c8f0 0x7ff94406edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff958001710 tx=0x7ff958009040 comp rx=0 tx=0).stop 2024-05-27T10:53:06.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.471+0000 7ff96ac00640 1 -- 172.21.15.47:0/3324052758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9640affa0 msgr2=0x7ff9640b0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:06.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.471+0000 7ff96ac00640 1 --2- 172.21.15.47:0/3324052758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9640affa0 0x7ff9640b0430 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00e230 tx=0x7ff95c009750 comp rx=0 tx=0).stop 2024-05-27T10:53:06.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.472+0000 7ff96ac00640 1 -- 172.21.15.47:0/3324052758 shutdown_connections 2024-05-27T10:53:06.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.472+0000 7ff96ac00640 1 --2- 172.21.15.47:0/3324052758 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7ff94406c8f0 0x7ff94406edb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.472+0000 7ff96ac00640 1 --2- 172.21.15.47:0/3324052758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9640affa0 0x7ff9640b0430 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.472+0000 7ff96ac00640 1 --2- 172.21.15.47:0/3324052758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff964146790 0x7ff96415ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.472+0000 7ff96ac00640 1 --2- 172.21.15.47:0/3324052758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9641463b0 0x7ff964153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.472+0000 7ff96ac00640 1 -- 172.21.15.47:0/3324052758 >> 172.21.15.47:0/3324052758 conn(0x7ff96406bb20 msgr2=0x7ff9640ae570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:06.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.472+0000 7ff96ac00640 1 -- 172.21.15.47:0/3324052758 shutdown_connections 2024-05-27T10:53:06.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.472+0000 7ff96ac00640 1 -- 172.21.15.47:0/3324052758 wait complete. 2024-05-27T10:53:06.490 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T10:53:06.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.712+0000 7fcea1000640 1 Processor -- start 2024-05-27T10:53:06.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.712+0000 7fcea1000640 1 -- start start 2024-05-27T10:53:06.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.713+0000 7fcea1000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fce9c06da80 0x7fce9c0d0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:06.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.713+0000 7fcea1000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce9c0d0c70 con 0x7fce9c0d0860 2024-05-27T10:53:06.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.713+0000 7fcea1000640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce9c0b4620 con 0x7fce9c15c510 2024-05-27T10:53:06.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.713+0000 7fcea1000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fce9c0b43e0 con 0x7fce9c06da80 2024-05-27T10:53:06.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.713+0000 7fce9aa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fce9c06da80 0x7fce9c0d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:06.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.713+0000 7fce9aa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fce9c06da80 0x7fce9c0d0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55102/0 (socket says 172.21.15.47:55102) 2024-05-27T10:53:06.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.713+0000 7fce9aa00640 1 -- 172.21.15.47:0/217464551 learned_addr learned my addr 172.21.15.47:0/217464551 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:06.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.714+0000 7fce9aa00640 1 -- 172.21.15.47:0/217464551 >> v1:172.21.15.53:6789/0 conn(0x7fce9c15c510 legacy=0x7fce9c0b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:06.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.714+0000 7fce9aa00640 1 -- 172.21.15.47:0/217464551 >> v1:172.21.15.47:6789/0 conn(0x7fce9c0d0860 legacy=0x7fce9c0ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:06.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.714+0000 7fce9aa00640 1 -- 172.21.15.47:0/217464551 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c0b4900 con 0x7fce9c06da80 2024-05-27T10:53:06.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.715+0000 7fce9aa00640 1 --2- 172.21.15.47:0/217464551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce9c06da80 0x7fce9c0d0320 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fce84009e50 tx=0x7fce8402a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791db3e135a4282a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:06.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.715+0000 7fce9a000640 1 -- 172.21.15.47:0/217464551 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84036070 con 0x7fce9c06da80 2024-05-27T10:53:06.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.715+0000 7fce9a000640 1 -- 172.21.15.47:0/217464551 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce84031600 con 0x7fce9c06da80 2024-05-27T10:53:06.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.715+0000 7fce9a000640 1 -- 172.21.15.47:0/217464551 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce840319d0 con 0x7fce9c06da80 2024-05-27T10:53:06.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.716+0000 7fcea1000640 1 -- 172.21.15.47:0/217464551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce9c06da80 msgr2=0x7fce9c0d0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:06.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.716+0000 7fcea1000640 1 --2- 172.21.15.47:0/217464551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce9c06da80 0x7fce9c0d0320 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fce84009e50 tx=0x7fce8402a760 comp rx=0 tx=0).stop 2024-05-27T10:53:06.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.716+0000 7fcea1000640 1 -- 172.21.15.47:0/217464551 shutdown_connections 2024-05-27T10:53:06.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.716+0000 7fcea1000640 1 --2- 172.21.15.47:0/217464551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce9c06da80 0x7fce9c0d0320 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.716+0000 7fcea1000640 1 -- 172.21.15.47:0/217464551 >> 172.21.15.47:0/217464551 conn(0x7fce9c06bb20 msgr2=0x7fce9c06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:06.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.716+0000 7fcea1000640 1 -- 172.21.15.47:0/217464551 shutdown_connections 2024-05-27T10:53:06.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.716+0000 7fcea1000640 1 -- 172.21.15.47:0/217464551 wait complete. 2024-05-27T10:53:06.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.718+0000 7fcea1000640 1 Processor -- start 2024-05-27T10:53:06.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.718+0000 7fcea1000640 1 -- start start 2024-05-27T10:53:06.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.719+0000 7fcea1000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce9c06da80 0x7fce9c14e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:06.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.719+0000 7fcea1000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce9c0d0860 0x7fce9c14dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:06.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.719+0000 7fcea1000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fce9c15c510 0x7fce9c156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:06.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.719+0000 7fcea1000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c15c8f0 con 0x7fce9c0d0860 2024-05-27T10:53:06.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.719+0000 7fcea1000640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c0b4ec0 con 0x7fce9c06da80 2024-05-27T10:53:06.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.719+0000 7fcea1000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fce9c0cf100 con 0x7fce9c15c510 2024-05-27T10:53:06.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.719+0000 7fce9aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce9c0d0860 0x7fce9c14dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:06.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.719+0000 7fce9aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce9c0d0860 0x7fce9c14dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55110/0 (socket says 172.21.15.47:55110) 2024-05-27T10:53:06.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.719+0000 7fce9aa00640 1 -- 172.21.15.47:0/3367898638 learned_addr learned my addr 172.21.15.47:0/3367898638 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:06.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.719+0000 7fce9aa00640 1 -- 172.21.15.47:0/3367898638 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fce9c15c510 msgr2=0x7fce9c156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.719+0000 7fce9aa00640 1 --2- 172.21.15.47:0/3367898638 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fce9c15c510 0x7fce9c156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.719+0000 7fce9aa00640 1 -- 172.21.15.47:0/3367898638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce9c06da80 msgr2=0x7fce9c14e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.719+0000 7fce9aa00640 1 --2- 172.21.15.47:0/3367898638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce9c06da80 0x7fce9c14e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.719+0000 7fce9aa00640 1 -- 172.21.15.47:0/3367898638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c152a70 con 0x7fce9c0d0860 2024-05-27T10:53:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.720+0000 7fce9aa00640 1 --2- 172.21.15.47:0/3367898638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce9c0d0860 0x7fce9c14dee0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fce84009f70 tx=0x7fce84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.720+0000 7fce93400640 1 -- 172.21.15.47:0/3367898638 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84041020 con 0x7fce9c0d0860 2024-05-27T10:53:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.720+0000 7fce93400640 1 -- 172.21.15.47:0/3367898638 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce84008790 con 0x7fce9c0d0860 2024-05-27T10:53:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.720+0000 7fcea1000640 1 -- 172.21.15.47:0/3367898638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce9c152d50 con 0x7fce9c0d0860 2024-05-27T10:53:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.720+0000 7fce93400640 1 -- 172.21.15.47:0/3367898638 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84036040 con 0x7fce9c0d0860 2024-05-27T10:53:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.720+0000 7fcea1000640 1 -- 172.21.15.47:0/3367898638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce9c153310 con 0x7fce9c0d0860 2024-05-27T10:53:06.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.721+0000 7fcea1000640 1 -- 172.21.15.47:0/3367898638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce9c04fce0 con 0x7fce9c0d0860 2024-05-27T10:53:06.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.723+0000 7fce93400640 1 -- 172.21.15.47:0/3367898638 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce84044020 con 0x7fce9c0d0860 2024-05-27T10:53:06.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.723+0000 7fce93400640 1 --2- 172.21.15.47:0/3367898638 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fce7806c8f0 0x7fce7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:06.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.724+0000 7fce93400640 1 -- 172.21.15.47:0/3367898638 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fce840ac970 con 0x7fce9c0d0860 2024-05-27T10:53:06.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.724+0000 7fce9b400640 1 --2- 172.21.15.47:0/3367898638 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fce7806c8f0 0x7fce7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:06.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.725+0000 7fce9b400640 1 --2- 172.21.15.47:0/3367898638 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fce7806c8f0 0x7fce7806edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fce8c006fd0 tx=0x7fce8c006bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:06.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.728+0000 7fce93400640 1 -- 172.21.15.47:0/3367898638 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fce8404b070 con 0x7fce9c0d0860 2024-05-27T10:53:06.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.931+0000 7fcea1000640 1 -- 172.21.15.47:0/3367898638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fce9c06f480 con 0x7fce9c0d0860 2024-05-27T10:53:06.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.932+0000 7fce93400640 1 -- 172.21.15.47:0/3367898638 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fce8407ac80 con 0x7fce9c0d0860 2024-05-27T10:53:06.931 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-27T10:53:06.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.935+0000 7fcea1000640 1 -- 172.21.15.47:0/3367898638 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fce7806c8f0 msgr2=0x7fce7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:06.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.935+0000 7fcea1000640 1 --2- 172.21.15.47:0/3367898638 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fce7806c8f0 0x7fce7806edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fce8c006fd0 tx=0x7fce8c006bc0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.935+0000 7fcea1000640 1 -- 172.21.15.47:0/3367898638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce9c0d0860 msgr2=0x7fce9c14dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:06.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.935+0000 7fcea1000640 1 --2- 172.21.15.47:0/3367898638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce9c0d0860 0x7fce9c14dee0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fce84009f70 tx=0x7fce84004a40 comp rx=0 tx=0).stop 2024-05-27T10:53:06.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.935+0000 7fcea1000640 1 -- 172.21.15.47:0/3367898638 shutdown_connections 2024-05-27T10:53:06.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.935+0000 7fcea1000640 1 --2- 172.21.15.47:0/3367898638 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fce7806c8f0 0x7fce7806edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.935+0000 7fcea1000640 1 --2- 172.21.15.47:0/3367898638 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fce9c15c510 0x7fce9c156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.935+0000 7fcea1000640 1 --2- 172.21.15.47:0/3367898638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce9c0d0860 0x7fce9c14dee0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.935+0000 7fcea1000640 1 --2- 172.21.15.47:0/3367898638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce9c06da80 0x7fce9c14e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:06.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.935+0000 7fcea1000640 1 -- 172.21.15.47:0/3367898638 >> 172.21.15.47:0/3367898638 conn(0x7fce9c06bb20 msgr2=0x7fce9c0b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:06.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.936+0000 7fcea1000640 1 -- 172.21.15.47:0/3367898638 shutdown_connections 2024-05-27T10:53:06.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:06.936+0000 7fcea1000640 1 -- 172.21.15.47:0/3367898638 wait complete. 2024-05-27T10:53:06.952 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T10:53:07.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.170+0000 7f37a2400640 1 Processor -- start 2024-05-27T10:53:07.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.171+0000 7f37a2400640 1 -- start start 2024-05-27T10:53:07.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.172+0000 7f37a2400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f379c15e660 0x7f379c06e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:07.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.172+0000 7f37a2400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f379c06f460 con 0x7f379c0d0a30 2024-05-27T10:53:07.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.172+0000 7f37a2400640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f379c0b4440 con 0x7f379c06ee30 2024-05-27T10:53:07.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.172+0000 7f37a2400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f379c0b4720 con 0x7f379c15e660 2024-05-27T10:53:07.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.173+0000 7f37a1a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f379c0d0a30 0x7f379c0cec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51722/0 (socket says 172.21.15.47:51722) 2024-05-27T10:53:07.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.173+0000 7f37a1a00640 1 -- 172.21.15.47:0/3076714597 learned_addr learned my addr 172.21.15.47:0/3076714597 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:07.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.173+0000 7f37a1000640 1 --2- 172.21.15.47:0/3076714597 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f379c15e660 0x7f379c06e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:07.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.173+0000 7f379b400640 1 -- 172.21.15.47:0/3076714597 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1789737027 0 0) 0x7f379c06f460 con 0x7f379c0d0a30 2024-05-27T10:53:07.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.173+0000 7f379b400640 1 -- 172.21.15.47:0/3076714597 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3784003520 con 0x7f379c0d0a30 2024-05-27T10:53:07.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.174+0000 7f379b400640 1 -- 172.21.15.47:0/3076714597 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3597313926 0 0) 0x7f379c0b4440 con 0x7f379c06ee30 2024-05-27T10:53:07.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.174+0000 7f379b400640 1 -- 172.21.15.47:0/3076714597 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f379c06f460 con 0x7f379c06ee30 2024-05-27T10:53:07.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.174+0000 7f379b400640 1 -- 172.21.15.47:0/3076714597 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3098661633 0 0) 0x7f3784003520 con 0x7f379c0d0a30 2024-05-27T10:53:07.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.174+0000 7f379b400640 1 -- 172.21.15.47:0/3076714597 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f379c15e660 msgr2=0x7f379c06e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:07.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.174+0000 7f379b400640 1 --2- 172.21.15.47:0/3076714597 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f379c15e660 0x7f379c06e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:07.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.174+0000 7f379b400640 1 -- 172.21.15.47:0/3076714597 >> v1:172.21.15.53:6789/0 conn(0x7f379c06ee30 legacy=0x7f379c0d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:07.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.174+0000 7f379b400640 1 -- 172.21.15.47:0/3076714597 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f379c0b4a00 con 0x7f379c0d0a30 2024-05-27T10:53:07.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.174+0000 7f379b400640 1 -- 172.21.15.47:0/3076714597 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f37940019f0 con 0x7f379c0d0a30 2024-05-27T10:53:07.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.174+0000 7f379b400640 1 -- 172.21.15.47:0/3076714597 >> v1:172.21.15.47:6789/0 conn(0x7f379c0d0a30 legacy=0x7f379c0cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:07.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.174+0000 7f379b400640 1 --2- 172.21.15.47:0/3076714597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3784003b70 0x7f3784003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:07.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.174+0000 7f379b400640 1 --2- 172.21.15.47:0/3076714597 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f379c15e660 0x7f3784004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:07.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.174+0000 7f379b400640 1 --2- 172.21.15.47:0/3076714597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3784004d40 0x7f37840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:07.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.174+0000 7f379b400640 1 -- 172.21.15.47:0/3076714597 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f379c0b4720 con 0x7f3784004d40 2024-05-27T10:53:07.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.174+0000 7f379b400640 1 -- 172.21.15.47:0/3076714597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f378400ba70 con 0x7f3784003b70 2024-05-27T10:53:07.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.174+0000 7f379b400640 1 -- 172.21.15.47:0/3076714597 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f378400bc70 con 0x7f379c15e660 2024-05-27T10:53:07.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.174+0000 7f37a1a00640 1 --2- 172.21.15.47:0/3076714597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3784004d40 0x7f37840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:07.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.175+0000 7f37a1000640 1 --2- 172.21.15.47:0/3076714597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3784003b70 0x7f3784003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.175+0000 7f379be00640 1 --2- 172.21.15.47:0/3076714597 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f379c15e660 0x7f3784004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.175+0000 7f37a1a00640 1 -- 172.21.15.47:0/3076714597 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f379c15e660 msgr2=0x7f3784004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.175+0000 7f37a1a00640 1 --2- 172.21.15.47:0/3076714597 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f379c15e660 0x7f3784004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.175+0000 7f37a1a00640 1 -- 172.21.15.47:0/3076714597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3784003b70 msgr2=0x7f3784003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.175+0000 7f37a1a00640 1 --2- 172.21.15.47:0/3076714597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3784003b70 0x7f3784003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.175+0000 7f37a1a00640 1 -- 172.21.15.47:0/3076714597 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3784003520 con 0x7f3784004d40 2024-05-27T10:53:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.175+0000 7f379be00640 1 --2- 172.21.15.47:0/3076714597 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f379c15e660 0x7f3784004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.175+0000 7f37a1000640 1 --2- 172.21.15.47:0/3076714597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3784003b70 0x7f3784003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.176+0000 7f37a1a00640 1 --2- 172.21.15.47:0/3076714597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3784004d40 0x7f37840051c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f379400a700 tx=0x7f3784005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e70c2b8e057aec server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.176+0000 7f379b400640 1 -- 172.21.15.47:0/3076714597 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379400a350 con 0x7f3784004d40 2024-05-27T10:53:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.176+0000 7f379b400640 1 -- 172.21.15.47:0/3076714597 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f379402f070 con 0x7f3784004d40 2024-05-27T10:53:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.176+0000 7f379b400640 1 -- 172.21.15.47:0/3076714597 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379402bb50 con 0x7f3784004d40 2024-05-27T10:53:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.177+0000 7f37a2400640 1 -- 172.21.15.47:0/3076714597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3784004d40 msgr2=0x7f37840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:07.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.177+0000 7f37a2400640 1 --2- 172.21.15.47:0/3076714597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3784004d40 0x7f37840051c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f379400a700 tx=0x7f3784005830 comp rx=0 tx=0).stop 2024-05-27T10:53:07.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.177+0000 7f37a1a00640 1 -- 172.21.15.47:0/3076714597 reap_dead start 2024-05-27T10:53:07.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.177+0000 7f37a2400640 1 -- 172.21.15.47:0/3076714597 shutdown_connections 2024-05-27T10:53:07.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.177+0000 7f37a2400640 1 -- 172.21.15.47:0/3076714597 >> 172.21.15.47:0/3076714597 conn(0x7f379c06bb20 msgr2=0x7f379c06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:07.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.177+0000 7f37a2400640 1 -- 172.21.15.47:0/3076714597 shutdown_connections 2024-05-27T10:53:07.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.177+0000 7f37a2400640 1 -- 172.21.15.47:0/3076714597 wait complete. 2024-05-27T10:53:07.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.179+0000 7f37a2400640 1 Processor -- start 2024-05-27T10:53:07.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.179+0000 7f37a2400640 1 -- start start 2024-05-27T10:53:07.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.180+0000 7f37a2400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3784004d40 0x7f379c1e8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:07.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.180+0000 7f37a2400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f379c158f70 0x7f379c0caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:07.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.180+0000 7f37a2400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f379c15b1d0 0x7f379c15b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:07.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.180+0000 7f37a2400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f379c0b4f20 con 0x7f379c158f70 2024-05-27T10:53:07.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.180+0000 7f37a2400640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f379c0b4060 con 0x7f379c15b1d0 2024-05-27T10:53:07.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.180+0000 7f37a2400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f379c0cb460 con 0x7f3784004d40 2024-05-27T10:53:07.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.180+0000 7f379be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f379c158f70 0x7f379c0caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:07.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.181+0000 7f379be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f379c158f70 0x7f379c0caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55122/0 (socket says 172.21.15.47:55122) 2024-05-27T10:53:07.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.181+0000 7f379be00640 1 -- 172.21.15.47:0/2767990321 learned_addr learned my addr 172.21.15.47:0/2767990321 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:07.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.181+0000 7f37a1000640 1 --2- 172.21.15.47:0/2767990321 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3784004d40 0x7f379c1e8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:07.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.181+0000 7f37a1a00640 1 --2- 172.21.15.47:0/2767990321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f379c15b1d0 0x7f379c15b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:07.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.181+0000 7f379be00640 1 -- 172.21.15.47:0/2767990321 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3784004d40 msgr2=0x7f379c1e8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:07.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.181+0000 7f379be00640 1 --2- 172.21.15.47:0/2767990321 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3784004d40 0x7f379c1e8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:07.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.181+0000 7f379be00640 1 -- 172.21.15.47:0/2767990321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f379c15b1d0 msgr2=0x7f379c15b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:07.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.181+0000 7f379be00640 1 --2- 172.21.15.47:0/2767990321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f379c15b1d0 0x7f379c15b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:07.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.181+0000 7f379be00640 1 -- 172.21.15.47:0/2767990321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f379c1e9220 con 0x7f379c158f70 2024-05-27T10:53:07.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.181+0000 7f379be00640 1 --2- 172.21.15.47:0/2767990321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f379c158f70 0x7f379c0caf20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f378c00d7a0 tx=0x7f378c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:07.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.182+0000 7f3798c00640 1 -- 172.21.15.47:0/2767990321 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378c007230 con 0x7f379c158f70 2024-05-27T10:53:07.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.182+0000 7f3798c00640 1 -- 172.21.15.47:0/2767990321 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f378c0073d0 con 0x7f379c158f70 2024-05-27T10:53:07.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.182+0000 7f37a2400640 1 -- 172.21.15.47:0/2767990321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f379c1e9500 con 0x7f379c158f70 2024-05-27T10:53:07.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.182+0000 7f3798c00640 1 -- 172.21.15.47:0/2767990321 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378c0067d0 con 0x7f379c158f70 2024-05-27T10:53:07.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.182+0000 7f37a2400640 1 -- 172.21.15.47:0/2767990321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f379c1e9ac0 con 0x7f379c158f70 2024-05-27T10:53:07.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.183+0000 7f37a2400640 1 -- 172.21.15.47:0/2767990321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f379c15bb90 con 0x7f379c158f70 2024-05-27T10:53:07.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.184+0000 7f3798c00640 1 -- 172.21.15.47:0/2767990321 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f378c006970 con 0x7f379c158f70 2024-05-27T10:53:07.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.185+0000 7f3798c00640 1 --2- 172.21.15.47:0/2767990321 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f378006c8f0 0x7f378006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:07.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.185+0000 7f3798c00640 1 -- 172.21.15.47:0/2767990321 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f378c08bd80 con 0x7f379c158f70 2024-05-27T10:53:07.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.186+0000 7f37a1000640 1 --2- 172.21.15.47:0/2767990321 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f378006c8f0 0x7f378006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:07.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.187+0000 7f37a1000640 1 --2- 172.21.15.47:0/2767990321 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f378006c8f0 0x7f378006edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3790009aa0 tx=0x7f3790008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:07.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.190+0000 7f3798c00640 1 -- 172.21.15.47:0/2767990321 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f378c016020 con 0x7f379c158f70 2024-05-27T10:53:07.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.397+0000 7f37a2400640 1 -- 172.21.15.47:0/2767990321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f379c04fce0 con 0x7f379c158f70 2024-05-27T10:53:07.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.398+0000 7f3798c00640 1 -- 172.21.15.47:0/2767990321 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f378c05a090 con 0x7f379c158f70 2024-05-27T10:53:07.396 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-27T10:53:07.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.401+0000 7f37a2400640 1 -- 172.21.15.47:0/2767990321 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f378006c8f0 msgr2=0x7f378006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:07.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.401+0000 7f37a2400640 1 --2- 172.21.15.47:0/2767990321 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f378006c8f0 0x7f378006edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3790009aa0 tx=0x7f3790008040 comp rx=0 tx=0).stop 2024-05-27T10:53:07.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.401+0000 7f37a2400640 1 -- 172.21.15.47:0/2767990321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f379c158f70 msgr2=0x7f379c0caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:07.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.401+0000 7f37a2400640 1 --2- 172.21.15.47:0/2767990321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f379c158f70 0x7f379c0caf20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f378c00d7a0 tx=0x7f378c00dc60 comp rx=0 tx=0).stop 2024-05-27T10:53:07.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.401+0000 7f37a2400640 1 -- 172.21.15.47:0/2767990321 shutdown_connections 2024-05-27T10:53:07.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.401+0000 7f37a2400640 1 --2- 172.21.15.47:0/2767990321 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f378006c8f0 0x7f378006edb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:07.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.401+0000 7f37a2400640 1 --2- 172.21.15.47:0/2767990321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f379c15b1d0 0x7f379c15b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:07.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.401+0000 7f37a2400640 1 --2- 172.21.15.47:0/2767990321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f379c158f70 0x7f379c0caf20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:07.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.401+0000 7f37a2400640 1 --2- 172.21.15.47:0/2767990321 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3784004d40 0x7f379c1e8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:07.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.401+0000 7f37a2400640 1 -- 172.21.15.47:0/2767990321 >> 172.21.15.47:0/2767990321 conn(0x7f379c06bb20 msgr2=0x7f379c15fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:07.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.401+0000 7f37a2400640 1 -- 172.21.15.47:0/2767990321 shutdown_connections 2024-05-27T10:53:07.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.401+0000 7f37a2400640 1 -- 172.21.15.47:0/2767990321 wait complete. 2024-05-27T10:53:07.419 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T10:53:07.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.630+0000 7f99abe00640 1 Processor -- start 2024-05-27T10:53:07.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.630+0000 7f99abe00640 1 -- start start 2024-05-27T10:53:07.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.632+0000 7f99abe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f99ac0b4ab0 0x7f99ac0d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:07.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.632+0000 7f99abe00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f99ac073c50 0x7f99ac0d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:07.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.632+0000 7f99abe00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99ac15c800 con 0x7f99ac15c420 2024-05-27T10:53:07.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.632+0000 7f99abe00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f99ac0afc90 con 0x7f99ac0b4ab0 2024-05-27T10:53:07.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.632+0000 7f99abe00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f99ac0726d0 con 0x7f99ac073c50 2024-05-27T10:53:07.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.632+0000 7f99a2000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f99ac0b4ab0 0x7f99ac0d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:07.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.632+0000 7f99a2000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f99ac0b4ab0 0x7f99ac0d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55128/0 (socket says 172.21.15.47:55128) 2024-05-27T10:53:07.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.632+0000 7f99a2000640 1 -- 172.21.15.47:0/2824666052 learned_addr learned my addr 172.21.15.47:0/2824666052 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:07.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.632+0000 7f99a2000640 1 -- 172.21.15.47:0/2824666052 >> v2:172.21.15.53:3300/0 conn(0x7f99ac073c50 msgr2=0x7f99ac0d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:07.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.632+0000 7f99a2000640 1 --2- 172.21.15.47:0/2824666052 >> v2:172.21.15.53:3300/0 conn(0x7f99ac073c50 0x7f99ac0d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:07.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.632+0000 7f99a2000640 1 -- 172.21.15.47:0/2824666052 >> v1:172.21.15.53:6789/0 conn(0x7f99ac15c420 legacy=0x7f99ac071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:07.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.632+0000 7f99a2000640 1 -- 172.21.15.47:0/2824666052 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99ac0ad2e0 con 0x7f99ac0b4ab0 2024-05-27T10:53:07.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.633+0000 7f99a2000640 1 --2- 172.21.15.47:0/2824666052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99ac0b4ab0 0x7f99ac0d0360 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f99ac0cf290 tx=0x7f999402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7402ff37117bffa server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:07.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.634+0000 7f99aa000640 1 -- 172.21.15.47:0/2824666052 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9994037070 con 0x7f99ac0b4ab0 2024-05-27T10:53:07.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.634+0000 7f99aa000640 1 -- 172.21.15.47:0/2824666052 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9994032440 con 0x7f99ac0b4ab0 2024-05-27T10:53:07.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.634+0000 7f99aa000640 1 -- 172.21.15.47:0/2824666052 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9994032810 con 0x7f99ac0b4ab0 2024-05-27T10:53:07.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.634+0000 7f99abe00640 1 -- 172.21.15.47:0/2824666052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99ac0b4ab0 msgr2=0x7f99ac0d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:07.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.634+0000 7f99abe00640 1 --2- 172.21.15.47:0/2824666052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99ac0b4ab0 0x7f99ac0d0360 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f99ac0cf290 tx=0x7f999402a1a0 comp rx=0 tx=0).stop 2024-05-27T10:53:07.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.635+0000 7f99abe00640 1 -- 172.21.15.47:0/2824666052 shutdown_connections 2024-05-27T10:53:07.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.635+0000 7f99abe00640 1 --2- 172.21.15.47:0/2824666052 >> v2:172.21.15.53:3300/0 conn(0x7f99ac073c50 0x7f99ac0d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:07.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.635+0000 7f99abe00640 1 --2- 172.21.15.47:0/2824666052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99ac0b4ab0 0x7f99ac0d0360 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:07.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.635+0000 7f99abe00640 1 -- 172.21.15.47:0/2824666052 >> 172.21.15.47:0/2824666052 conn(0x7f99ac06bb20 msgr2=0x7f99ac06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:07.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.635+0000 7f99abe00640 1 -- 172.21.15.47:0/2824666052 shutdown_connections 2024-05-27T10:53:07.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.635+0000 7f99abe00640 1 -- 172.21.15.47:0/2824666052 wait complete. 2024-05-27T10:53:07.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.636+0000 7f99abe00640 1 Processor -- start 2024-05-27T10:53:07.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.637+0000 7f99abe00640 1 -- start start 2024-05-27T10:53:07.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.637+0000 7f99abe00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f99ac073c50 0x7f99ac14cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:07.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.637+0000 7f99abe00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99ac15c420 0x7f99ac06e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:07.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.637+0000 7f99abe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99ac1e84c0 0x7f99ac152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:07.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.638+0000 7f99abe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac0ad8a0 con 0x7f99ac1e84c0 2024-05-27T10:53:07.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.638+0000 7f99abe00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac0b3270 con 0x7f99ac15c420 2024-05-27T10:53:07.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.638+0000 7f99abe00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f99ac0af8f0 con 0x7f99ac073c50 2024-05-27T10:53:07.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.638+0000 7f99ab400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99ac1e84c0 0x7f99ac152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:07.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.638+0000 7f99ab400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99ac1e84c0 0x7f99ac152f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55136/0 (socket says 172.21.15.47:55136) 2024-05-27T10:53:07.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.638+0000 7f99ab400640 1 -- 172.21.15.47:0/1629466058 learned_addr learned my addr 172.21.15.47:0/1629466058 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:07.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.638+0000 7f99aaa00640 1 --2- 172.21.15.47:0/1629466058 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f99ac073c50 0x7f99ac14cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:07.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.638+0000 7f99a2000640 1 --2- 172.21.15.47:0/1629466058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99ac15c420 0x7f99ac06e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:07.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.638+0000 7f99ab400640 1 -- 172.21.15.47:0/1629466058 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f99ac073c50 msgr2=0x7f99ac14cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:07.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.638+0000 7f99ab400640 1 --2- 172.21.15.47:0/1629466058 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f99ac073c50 0x7f99ac14cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:07.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.638+0000 7f99ab400640 1 -- 172.21.15.47:0/1629466058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99ac15c420 msgr2=0x7f99ac06e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:07.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.638+0000 7f99ab400640 1 --2- 172.21.15.47:0/1629466058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99ac15c420 0x7f99ac06e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:07.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.638+0000 7f99ab400640 1 -- 172.21.15.47:0/1629466058 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99ac14d4e0 con 0x7f99ac1e84c0 2024-05-27T10:53:07.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.639+0000 7f99ab400640 1 --2- 172.21.15.47:0/1629466058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99ac1e84c0 0x7f99ac152f10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f99a400b970 tx=0x7f99a400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:07.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.639+0000 7f99a3400640 1 -- 172.21.15.47:0/1629466058 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a4019070 con 0x7f99ac1e84c0 2024-05-27T10:53:07.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.639+0000 7f99a3400640 1 -- 172.21.15.47:0/1629466058 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a400cb60 con 0x7f99ac1e84c0 2024-05-27T10:53:07.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.639+0000 7f99a3400640 1 -- 172.21.15.47:0/1629466058 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a4014440 con 0x7f99ac1e84c0 2024-05-27T10:53:07.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.639+0000 7f99abe00640 1 -- 172.21.15.47:0/1629466058 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99ac14d7c0 con 0x7f99ac1e84c0 2024-05-27T10:53:07.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.639+0000 7f99abe00640 1 -- 172.21.15.47:0/1629466058 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99ac14dd80 con 0x7f99ac1e84c0 2024-05-27T10:53:07.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.640+0000 7f99abe00640 1 -- 172.21.15.47:0/1629466058 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99ac04fce0 con 0x7f99ac1e84c0 2024-05-27T10:53:07.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.641+0000 7f99a3400640 1 -- 172.21.15.47:0/1629466058 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f99a401c070 con 0x7f99ac1e84c0 2024-05-27T10:53:07.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.642+0000 7f99a3400640 1 --2- 172.21.15.47:0/1629466058 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f998806c8f0 0x7f998806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:07.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.642+0000 7f99a3400640 1 -- 172.21.15.47:0/1629466058 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f99a408b9b0 con 0x7f99ac1e84c0 2024-05-27T10:53:07.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.642+0000 7f99aaa00640 1 --2- 172.21.15.47:0/1629466058 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f998806c8f0 0x7f998806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:07.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.643+0000 7f99aaa00640 1 --2- 172.21.15.47:0/1629466058 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f998806c8f0 0x7f998806edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f999c007fd0 tx=0x7f999c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:07.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.649+0000 7f99a3400640 1 -- 172.21.15.47:0/1629466058 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f99a4059cc0 con 0x7f99ac1e84c0 2024-05-27T10:53:07.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.894+0000 7f99abe00640 1 -- 172.21.15.47:0/1629466058 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99ac073a30 con 0x7f99ac1e84c0 2024-05-27T10:53:07.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.895+0000 7f99a3400640 1 -- 172.21.15.47:0/1629466058 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f99a40595c0 con 0x7f99ac1e84c0 2024-05-27T10:53:07.893 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:53:07.893 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/4062514569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4062514569},{"type":"v1","addr":"172.21.15.47:6836","nonce":4062514569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/4113289884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":4113289884},{"type":"v1","addr":"172.21.15.53:6834","nonce":4113289884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3409529039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":3409529039},{"type":"v1","addr":"172.21.15.47:6837","nonce":3409529039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T10:52:01.683075+0000","modified":"2024-05-27T10:52:04.791891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6835/4292385883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":4292385883},{"type":"v1","addr":"172.21.15.53:6835","nonce":4292385883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-27T10:53:07.893 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-05-27T10:53:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.897+0000 7f99abe00640 1 -- 172.21.15.47:0/1629466058 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f998806c8f0 msgr2=0x7f998806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.897+0000 7f99abe00640 1 --2- 172.21.15.47:0/1629466058 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f998806c8f0 0x7f998806edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f999c007fd0 tx=0x7f999c009040 comp rx=0 tx=0).stop 2024-05-27T10:53:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.898+0000 7f99abe00640 1 -- 172.21.15.47:0/1629466058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99ac1e84c0 msgr2=0x7f99ac152f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.898+0000 7f99abe00640 1 --2- 172.21.15.47:0/1629466058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99ac1e84c0 0x7f99ac152f10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f99a400b970 tx=0x7f99a400be30 comp rx=0 tx=0).stop 2024-05-27T10:53:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.898+0000 7f99abe00640 1 -- 172.21.15.47:0/1629466058 shutdown_connections 2024-05-27T10:53:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.898+0000 7f99abe00640 1 --2- 172.21.15.47:0/1629466058 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f998806c8f0 0x7f998806edb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.898+0000 7f99abe00640 1 --2- 172.21.15.47:0/1629466058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99ac1e84c0 0x7f99ac152f10 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.898+0000 7f99abe00640 1 --2- 172.21.15.47:0/1629466058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99ac15c420 0x7f99ac06e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.898+0000 7f99abe00640 1 --2- 172.21.15.47:0/1629466058 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f99ac073c50 0x7f99ac14cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.898+0000 7f99abe00640 1 -- 172.21.15.47:0/1629466058 >> 172.21.15.47:0/1629466058 conn(0x7f99ac06bb20 msgr2=0x7f99ac159b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.898+0000 7f99abe00640 1 -- 172.21.15.47:0/1629466058 shutdown_connections 2024-05-27T10:53:07.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:07.898+0000 7f99abe00640 1 -- 172.21.15.47:0/1629466058 wait complete. 2024-05-27T10:53:07.916 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:53:08.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.132+0000 7f65de600640 1 Processor -- start 2024-05-27T10:53:08.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.132+0000 7f65de600640 1 -- start start 2024-05-27T10:53:08.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.134+0000 7f65de600640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f65d815b380 0x7f65d80d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:08.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.134+0000 7f65de600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f65d80d08a0 0x7f65d806e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:08.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.134+0000 7f65de600640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65d806f3a0 con 0x7f65d806ebd0 2024-05-27T10:53:08.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.134+0000 7f65de600640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f65d80adcc0 con 0x7f65d815b380 2024-05-27T10:53:08.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.134+0000 7f65de600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f65d806ff20 con 0x7f65d80d08a0 2024-05-27T10:53:08.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.135+0000 7f65d7e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f65d80d08a0 0x7f65d806e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:08.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.135+0000 7f65d7e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f65d80d08a0 0x7f65d806e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:52772/0 (socket says 172.21.15.47:52772) 2024-05-27T10:53:08.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.135+0000 7f65d7e00640 1 -- 172.21.15.47:0/1995697151 learned_addr learned my addr 172.21.15.47:0/1995697151 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:08.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.135+0000 7f65dd200640 1 --2- 172.21.15.47:0/1995697151 >> v2:172.21.15.53:3300/0 conn(0x7f65d815b380 0x7f65d80d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:08.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.136+0000 7f65d7e00640 1 -- 172.21.15.47:0/1995697151 >> v2:172.21.15.53:3300/0 conn(0x7f65d815b380 msgr2=0x7f65d80d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:08.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.136+0000 7f65d7e00640 1 --2- 172.21.15.47:0/1995697151 >> v2:172.21.15.53:3300/0 conn(0x7f65d815b380 0x7f65d80d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:08.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.136+0000 7f65d7e00640 1 -- 172.21.15.47:0/1995697151 >> v1:172.21.15.53:6789/0 conn(0x7f65d806ebd0 legacy=0x7f65d80b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:08.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.136+0000 7f65d7e00640 1 -- 172.21.15.47:0/1995697151 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d806f680 con 0x7f65d80d08a0 2024-05-27T10:53:08.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.137+0000 7f65d7e00640 1 --2- 172.21.15.47:0/1995697151 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f65d80d08a0 0x7f65d806e690 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f65c4009870 tx=0x7f65c402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2348a72e60ca8d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:08.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.137+0000 7f65d7400640 1 -- 172.21.15.47:0/1995697151 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4037070 con 0x7f65d80d08a0 2024-05-27T10:53:08.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.137+0000 7f65d7400640 1 -- 172.21.15.47:0/1995697151 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c4032440 con 0x7f65d80d08a0 2024-05-27T10:53:08.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.137+0000 7f65d7400640 1 -- 172.21.15.47:0/1995697151 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4032810 con 0x7f65d80d08a0 2024-05-27T10:53:08.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.138+0000 7f65de600640 1 -- 172.21.15.47:0/1995697151 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f65d80d08a0 msgr2=0x7f65d806e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:08.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.138+0000 7f65de600640 1 --2- 172.21.15.47:0/1995697151 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f65d80d08a0 0x7f65d806e690 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f65c4009870 tx=0x7f65c402a1c0 comp rx=0 tx=0).stop 2024-05-27T10:53:08.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.138+0000 7f65de600640 1 -- 172.21.15.47:0/1995697151 shutdown_connections 2024-05-27T10:53:08.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.138+0000 7f65de600640 1 --2- 172.21.15.47:0/1995697151 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f65d80d08a0 0x7f65d806e690 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:08.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.138+0000 7f65de600640 1 --2- 172.21.15.47:0/1995697151 >> v2:172.21.15.53:3300/0 conn(0x7f65d815b380 0x7f65d80d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:08.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.138+0000 7f65de600640 1 -- 172.21.15.47:0/1995697151 >> 172.21.15.47:0/1995697151 conn(0x7f65d806bb20 msgr2=0x7f65d806bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:08.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.138+0000 7f65de600640 1 -- 172.21.15.47:0/1995697151 shutdown_connections 2024-05-27T10:53:08.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.138+0000 7f65de600640 1 -- 172.21.15.47:0/1995697151 wait complete. 2024-05-27T10:53:08.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.140+0000 7f65de600640 1 Processor -- start 2024-05-27T10:53:08.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.140+0000 7f65de600640 1 -- start start 2024-05-27T10:53:08.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.141+0000 7f65de600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65d806ebd0 0x7f65d814f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:08.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.141+0000 7f65de600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f65d80d08a0 0x7f65d81585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:08.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.141+0000 7f65de600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65d815b380 0x7f65d80b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:08.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.141+0000 7f65de600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f65d806fc40 con 0x7f65d815b380 2024-05-27T10:53:08.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.141+0000 7f65de600640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f65d80d0ce0 con 0x7f65d806ebd0 2024-05-27T10:53:08.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.141+0000 7f65de600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f65d806f020 con 0x7f65d80d08a0 2024-05-27T10:53:08.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.142+0000 7f65ddc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65d815b380 0x7f65d80b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:08.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.142+0000 7f65ddc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65d815b380 0x7f65d80b38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55152/0 (socket says 172.21.15.47:55152) 2024-05-27T10:53:08.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.142+0000 7f65ddc00640 1 -- 172.21.15.47:0/443649444 learned_addr learned my addr 172.21.15.47:0/443649444 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:08.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.142+0000 7f65d7e00640 1 --2- 172.21.15.47:0/443649444 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f65d80d08a0 0x7f65d81585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:08.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.142+0000 7f65dd200640 1 --2- 172.21.15.47:0/443649444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65d806ebd0 0x7f65d814f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:08.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.142+0000 7f65ddc00640 1 -- 172.21.15.47:0/443649444 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f65d80d08a0 msgr2=0x7f65d81585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:08.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.142+0000 7f65ddc00640 1 --2- 172.21.15.47:0/443649444 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f65d80d08a0 0x7f65d81585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:08.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.142+0000 7f65ddc00640 1 -- 172.21.15.47:0/443649444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65d806ebd0 msgr2=0x7f65d814f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:08.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.142+0000 7f65ddc00640 1 --2- 172.21.15.47:0/443649444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65d806ebd0 0x7f65d814f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:08.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.142+0000 7f65ddc00640 1 -- 172.21.15.47:0/443649444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d8151d70 con 0x7f65d815b380 2024-05-27T10:53:08.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.143+0000 7f65ddc00640 1 --2- 172.21.15.47:0/443649444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65d815b380 0x7f65d80b38a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f65d000c7d0 tx=0x7f65d000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:08.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.143+0000 7f65d4c00640 1 -- 172.21.15.47:0/443649444 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d0003b70 con 0x7f65d815b380 2024-05-27T10:53:08.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.143+0000 7f65d4c00640 1 -- 172.21.15.47:0/443649444 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d0003d30 con 0x7f65d815b380 2024-05-27T10:53:08.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.143+0000 7f65de600640 1 -- 172.21.15.47:0/443649444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d8157b00 con 0x7f65d815b380 2024-05-27T10:53:08.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.143+0000 7f65d4c00640 1 -- 172.21.15.47:0/443649444 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d000aa90 con 0x7f65d815b380 2024-05-27T10:53:08.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.143+0000 7f65de600640 1 -- 172.21.15.47:0/443649444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d8158b20 con 0x7f65d815b380 2024-05-27T10:53:08.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.145+0000 7f65de600640 1 -- 172.21.15.47:0/443649444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d8158db0 con 0x7f65d815b380 2024-05-27T10:53:08.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.146+0000 7f65d4c00640 1 -- 172.21.15.47:0/443649444 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f65d000ac30 con 0x7f65d815b380 2024-05-27T10:53:08.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.146+0000 7f65d4c00640 1 --2- 172.21.15.47:0/443649444 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f65b806c8f0 0x7f65b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:08.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.147+0000 7f65d4c00640 1 -- 172.21.15.47:0/443649444 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f65d008ba20 con 0x7f65d815b380 2024-05-27T10:53:08.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.147+0000 7f65dd200640 1 --2- 172.21.15.47:0/443649444 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f65b806c8f0 0x7f65b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:08.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.148+0000 7f65dd200640 1 --2- 172.21.15.47:0/443649444 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f65b806c8f0 0x7f65b806edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009a30 tx=0x7f65cc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:08.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.152+0000 7f65d4c00640 1 -- 172.21.15.47:0/443649444 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f65d0059e60 con 0x7f65d815b380 2024-05-27T10:53:08.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.356+0000 7f65de600640 1 -- 172.21.15.47:0/443649444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65d804fce0 con 0x7f65d815b380 2024-05-27T10:53:08.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.357+0000 7f65d4c00640 1 -- 172.21.15.47:0/443649444 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16770 (secure 0 0 0) 0x7f65d0059760 con 0x7f65d815b380 2024-05-27T10:53:08.356 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:53:08.356 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":22,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:48.545555+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:53:08.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.360+0000 7f65de600640 1 -- 172.21.15.47:0/443649444 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f65b806c8f0 msgr2=0x7f65b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:08.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.360+0000 7f65de600640 1 --2- 172.21.15.47:0/443649444 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f65b806c8f0 0x7f65b806edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009a30 tx=0x7f65cc008040 comp rx=0 tx=0).stop 2024-05-27T10:53:08.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.360+0000 7f65de600640 1 -- 172.21.15.47:0/443649444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65d815b380 msgr2=0x7f65d80b38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:08.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.360+0000 7f65de600640 1 --2- 172.21.15.47:0/443649444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65d815b380 0x7f65d80b38a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f65d000c7d0 tx=0x7f65d000cc90 comp rx=0 tx=0).stop 2024-05-27T10:53:08.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.360+0000 7f65de600640 1 -- 172.21.15.47:0/443649444 shutdown_connections 2024-05-27T10:53:08.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.360+0000 7f65de600640 1 --2- 172.21.15.47:0/443649444 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f65b806c8f0 0x7f65b806edb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:08.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.360+0000 7f65de600640 1 --2- 172.21.15.47:0/443649444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65d815b380 0x7f65d80b38a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:08.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.360+0000 7f65de600640 1 --2- 172.21.15.47:0/443649444 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f65d80d08a0 0x7f65d81585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:08.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.360+0000 7f65de600640 1 --2- 172.21.15.47:0/443649444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65d806ebd0 0x7f65d814f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:08.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.360+0000 7f65de600640 1 -- 172.21.15.47:0/443649444 >> 172.21.15.47:0/443649444 conn(0x7f65d806bb20 msgr2=0x7f65d8156ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:08.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.360+0000 7f65de600640 1 -- 172.21.15.47:0/443649444 shutdown_connections 2024-05-27T10:53:08.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.360+0000 7f65de600640 1 -- 172.21.15.47:0/443649444 wait complete. 2024-05-27T10:53:08.379 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-27T10:53:08.380 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T10:53:08.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.597+0000 7fd37a200640 1 Processor -- start 2024-05-27T10:53:08.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.597+0000 7fd37a200640 1 -- start start 2024-05-27T10:53:08.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.598+0000 7fd37a200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd37415c840 0x7fd3740d0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:08.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.598+0000 7fd37a200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd374160140 con 0x7fd3740d0c40 2024-05-27T10:53:08.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.598+0000 7fd37a200640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd374160420 con 0x7fd37415c460 2024-05-27T10:53:08.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.598+0000 7fd37a200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd374160700 con 0x7fd37415c840 2024-05-27T10:53:08.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.599+0000 7fd36aa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd37415c840 0x7fd3740d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:08.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.599+0000 7fd36aa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd37415c840 0x7fd3740d0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55156/0 (socket says 172.21.15.47:55156) 2024-05-27T10:53:08.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.599+0000 7fd36aa00640 1 -- 172.21.15.47:0/1134021776 learned_addr learned my addr 172.21.15.47:0/1134021776 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:08.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.599+0000 7fd36aa00640 1 -- 172.21.15.47:0/1134021776 >> v1:172.21.15.53:6789/0 conn(0x7fd37415c460 legacy=0x7fd3740ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:08.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.599+0000 7fd36aa00640 1 -- 172.21.15.47:0/1134021776 >> v1:172.21.15.47:6789/0 conn(0x7fd3740d0c40 legacy=0x7fd37406def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:08.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.599+0000 7fd36aa00640 1 -- 172.21.15.47:0/1134021776 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3741609e0 con 0x7fd37415c840 2024-05-27T10:53:08.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.600+0000 7fd36aa00640 1 --2- 172.21.15.47:0/1134021776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd37415c840 0x7fd3740d0700 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd35c009e50 tx=0x7fd35c02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34aa9d3507c449a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:08.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.601+0000 7fd372a00640 1 -- 172.21.15.47:0/1134021776 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c036070 con 0x7fd37415c840 2024-05-27T10:53:08.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.601+0000 7fd372a00640 1 -- 172.21.15.47:0/1134021776 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd35c031600 con 0x7fd37415c840 2024-05-27T10:53:08.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.601+0000 7fd372a00640 1 -- 172.21.15.47:0/1134021776 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c0319f0 con 0x7fd37415c840 2024-05-27T10:53:08.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.601+0000 7fd37a200640 1 -- 172.21.15.47:0/1134021776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd37415c840 msgr2=0x7fd3740d0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:08.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.601+0000 7fd37a200640 1 --2- 172.21.15.47:0/1134021776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd37415c840 0x7fd3740d0700 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd35c009e50 tx=0x7fd35c02a7c0 comp rx=0 tx=0).stop 2024-05-27T10:53:08.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.601+0000 7fd37a200640 1 -- 172.21.15.47:0/1134021776 shutdown_connections 2024-05-27T10:53:08.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.601+0000 7fd37a200640 1 --2- 172.21.15.47:0/1134021776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd37415c840 0x7fd3740d0700 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:08.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.601+0000 7fd37a200640 1 -- 172.21.15.47:0/1134021776 >> 172.21.15.47:0/1134021776 conn(0x7fd37406bd60 msgr2=0x7fd37406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:08.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.601+0000 7fd37a200640 1 -- 172.21.15.47:0/1134021776 shutdown_connections 2024-05-27T10:53:08.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.601+0000 7fd37a200640 1 -- 172.21.15.47:0/1134021776 wait complete. 2024-05-27T10:53:08.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.603+0000 7fd37a200640 1 Processor -- start 2024-05-27T10:53:08.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.603+0000 7fd37a200640 1 -- start start 2024-05-27T10:53:08.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.604+0000 7fd37a200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3740d0c40 0x7fd374154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:08.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.604+0000 7fd37a200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd37415c460 0x7fd37415cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:08.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.604+0000 7fd37a200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd37415c840 0x7fd37414e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:08.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.604+0000 7fd37a200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd3740ada10 con 0x7fd3740d0c40 2024-05-27T10:53:08.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.604+0000 7fd37a200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd374160fa0 con 0x7fd37415c840 2024-05-27T10:53:08.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.604+0000 7fd37a200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd3740adb90 con 0x7fd37415c460 2024-05-27T10:53:08.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.605+0000 7fd373400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3740d0c40 0x7fd374154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:08.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.605+0000 7fd373400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3740d0c40 0x7fd374154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55172/0 (socket says 172.21.15.47:55172) 2024-05-27T10:53:08.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.605+0000 7fd373400640 1 -- 172.21.15.47:0/2354896144 learned_addr learned my addr 172.21.15.47:0/2354896144 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:08.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.605+0000 7fd373e00640 1 --2- 172.21.15.47:0/2354896144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd37415c840 0x7fd37414e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:08.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.605+0000 7fd373400640 1 -- 172.21.15.47:0/2354896144 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd37415c460 msgr2=0x7fd37415cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:08.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.605+0000 7fd373400640 1 --2- 172.21.15.47:0/2354896144 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd37415c460 0x7fd37415cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:08.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.605+0000 7fd373400640 1 -- 172.21.15.47:0/2354896144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd37415c840 msgr2=0x7fd37414e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:08.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.605+0000 7fd373400640 1 --2- 172.21.15.47:0/2354896144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd37415c840 0x7fd37414e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:08.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.605+0000 7fd373400640 1 -- 172.21.15.47:0/2354896144 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37415dd60 con 0x7fd3740d0c40 2024-05-27T10:53:08.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.605+0000 7fd373e00640 1 --2- 172.21.15.47:0/2354896144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd37415c840 0x7fd37414e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:08.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.606+0000 7fd373400640 1 --2- 172.21.15.47:0/2354896144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3740d0c40 0x7fd374154ab0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd36400c400 tx=0x7fd36400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:08.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.606+0000 7fd36be00640 1 -- 172.21.15.47:0/2354896144 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3640052d0 con 0x7fd3740d0c40 2024-05-27T10:53:08.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.606+0000 7fd36be00640 1 -- 172.21.15.47:0/2354896144 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd364005470 con 0x7fd3740d0c40 2024-05-27T10:53:08.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.606+0000 7fd36be00640 1 -- 172.21.15.47:0/2354896144 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd364007260 con 0x7fd3740d0c40 2024-05-27T10:53:08.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.606+0000 7fd37a200640 1 -- 172.21.15.47:0/2354896144 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd37415d4c0 con 0x7fd3740d0c40 2024-05-27T10:53:08.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.606+0000 7fd37a200640 1 -- 172.21.15.47:0/2354896144 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd37415da80 con 0x7fd3740d0c40 2024-05-27T10:53:08.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.607+0000 7fd37a200640 1 -- 172.21.15.47:0/2354896144 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3740689e0 con 0x7fd3740d0c40 2024-05-27T10:53:08.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.608+0000 7fd36be00640 1 -- 172.21.15.47:0/2354896144 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd364007400 con 0x7fd3740d0c40 2024-05-27T10:53:08.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.609+0000 7fd36be00640 1 --2- 172.21.15.47:0/2354896144 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd35006c8f0 0x7fd35006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:08.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.609+0000 7fd36be00640 1 -- 172.21.15.47:0/2354896144 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fd36408b130 con 0x7fd3740d0c40 2024-05-27T10:53:08.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.609+0000 7fd36aa00640 1 --2- 172.21.15.47:0/2354896144 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd35006c8f0 0x7fd35006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:08.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.610+0000 7fd36aa00640 1 --2- 172.21.15.47:0/2354896144 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd35006c8f0 0x7fd35006edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd35c033000 tx=0x7fd35c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:08.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.614+0000 7fd36be00640 1 -- 172.21.15.47:0/2354896144 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd3640594d0 con 0x7fd3740d0c40 2024-05-27T10:53:08.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.860+0000 7fd37a200640 1 -- 172.21.15.47:0/2354896144 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3740b5170 con 0x7fd3740d0c40 2024-05-27T10:53:08.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.861+0000 7fd36be00640 1 -- 172.21.15.47:0/2354896144 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7fd364058dd0 con 0x7fd3740d0c40 2024-05-27T10:53:08.859 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:53:08.859 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/4062514569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4062514569},{"type":"v1","addr":"172.21.15.47:6836","nonce":4062514569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/4113289884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":4113289884},{"type":"v1","addr":"172.21.15.53:6834","nonce":4113289884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3409529039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":3409529039},{"type":"v1","addr":"172.21.15.47:6837","nonce":3409529039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T10:52:01.683075+0000","modified":"2024-05-27T10:52:04.791891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6835/4292385883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":4292385883},{"type":"v1","addr":"172.21.15.53:6835","nonce":4292385883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-27T10:53:08.860 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-05-27T10:53:08.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.864+0000 7fd37a200640 1 -- 172.21.15.47:0/2354896144 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd35006c8f0 msgr2=0x7fd35006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:08.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.864+0000 7fd37a200640 1 --2- 172.21.15.47:0/2354896144 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd35006c8f0 0x7fd35006edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd35c033000 tx=0x7fd35c02e000 comp rx=0 tx=0).stop 2024-05-27T10:53:08.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.864+0000 7fd37a200640 1 -- 172.21.15.47:0/2354896144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3740d0c40 msgr2=0x7fd374154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:08.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.864+0000 7fd37a200640 1 --2- 172.21.15.47:0/2354896144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3740d0c40 0x7fd374154ab0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd36400c400 tx=0x7fd36400c8c0 comp rx=0 tx=0).stop 2024-05-27T10:53:08.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.864+0000 7fd37a200640 1 -- 172.21.15.47:0/2354896144 shutdown_connections 2024-05-27T10:53:08.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.864+0000 7fd37a200640 1 --2- 172.21.15.47:0/2354896144 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd35006c8f0 0x7fd35006edb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:08.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.864+0000 7fd37a200640 1 --2- 172.21.15.47:0/2354896144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd37415c840 0x7fd37414e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:08.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.864+0000 7fd37a200640 1 --2- 172.21.15.47:0/2354896144 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd37415c460 0x7fd37415cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:08.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.864+0000 7fd37a200640 1 --2- 172.21.15.47:0/2354896144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3740d0c40 0x7fd374154ab0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:08.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.864+0000 7fd37a200640 1 -- 172.21.15.47:0/2354896144 >> 172.21.15.47:0/2354896144 conn(0x7fd37406bd60 msgr2=0x7fd37406ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:08.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.864+0000 7fd37a200640 1 -- 172.21.15.47:0/2354896144 shutdown_connections 2024-05-27T10:53:08.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:08.864+0000 7fd37a200640 1 -- 172.21.15.47:0/2354896144 wait complete. 2024-05-27T10:53:08.882 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T10:53:09.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.096+0000 7fdfe2400640 1 Processor -- start 2024-05-27T10:53:09.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.096+0000 7fdfe2400640 1 -- start start 2024-05-27T10:53:09.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.098+0000 7fdfe2400640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdfdc15c460 0x7fdfdc0ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:09.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.098+0000 7fdfe2400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdfdc15c840 0x7fdfdc0d0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:09.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.098+0000 7fdfe2400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdfdc0ad840 0x7fdfdc0d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:09.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.098+0000 7fdfe2400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fdfdc160140 con 0x7fdfdc0ad840 2024-05-27T10:53:09.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.098+0000 7fdfe2400640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fdfdc160420 con 0x7fdfdc15c460 2024-05-27T10:53:09.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.098+0000 7fdfe2400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fdfdc160700 con 0x7fdfdc15c840 2024-05-27T10:53:09.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.098+0000 7fdfdbe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdfdc0ad840 0x7fdfdc0d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:09.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.098+0000 7fdfdbe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdfdc0ad840 0x7fdfdc0d0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55178/0 (socket says 172.21.15.47:55178) 2024-05-27T10:53:09.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.098+0000 7fdfdbe00640 1 -- 172.21.15.47:0/168789480 learned_addr learned my addr 172.21.15.47:0/168789480 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:09.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.099+0000 7fdfdaa00640 1 --2- 172.21.15.47:0/168789480 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdfdc15c840 0x7fdfdc0d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:09.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.099+0000 7fdfdb400640 1 --2- 172.21.15.47:0/168789480 >> v2:172.21.15.53:3300/0 conn(0x7fdfdc15c460 0x7fdfdc0ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:09.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.099+0000 7fdfdbe00640 1 -- 172.21.15.47:0/168789480 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdfdc15c840 msgr2=0x7fdfdc0d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:09.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.099+0000 7fdfdbe00640 1 --2- 172.21.15.47:0/168789480 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdfdc15c840 0x7fdfdc0d0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.099+0000 7fdfdbe00640 1 -- 172.21.15.47:0/168789480 >> v2:172.21.15.53:3300/0 conn(0x7fdfdc15c460 msgr2=0x7fdfdc0ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:09.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.099+0000 7fdfdbe00640 1 --2- 172.21.15.47:0/168789480 >> v2:172.21.15.53:3300/0 conn(0x7fdfdc15c460 0x7fdfdc0ad300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.099+0000 7fdfdbe00640 1 -- 172.21.15.47:0/168789480 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfdc1609e0 con 0x7fdfdc0ad840 2024-05-27T10:53:09.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.100+0000 7fdfdbe00640 1 --2- 172.21.15.47:0/168789480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfdc0ad840 0x7fdfdc0d0c40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0740a0 tx=0x7fdfd402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5414008d8a11ee3e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:09.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.100+0000 7fdfda000640 1 -- 172.21.15.47:0/168789480 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4036070 con 0x7fdfdc0ad840 2024-05-27T10:53:09.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.100+0000 7fdfda000640 1 -- 172.21.15.47:0/168789480 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd4031600 con 0x7fdfdc0ad840 2024-05-27T10:53:09.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.100+0000 7fdfda000640 1 -- 172.21.15.47:0/168789480 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40319d0 con 0x7fdfdc0ad840 2024-05-27T10:53:09.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.101+0000 7fdfe2400640 1 -- 172.21.15.47:0/168789480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfdc0ad840 msgr2=0x7fdfdc0d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:09.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.101+0000 7fdfe2400640 1 --2- 172.21.15.47:0/168789480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfdc0ad840 0x7fdfdc0d0c40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0740a0 tx=0x7fdfd402a6a0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.101+0000 7fdfe2400640 1 -- 172.21.15.47:0/168789480 shutdown_connections 2024-05-27T10:53:09.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.101+0000 7fdfe2400640 1 --2- 172.21.15.47:0/168789480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfdc0ad840 0x7fdfdc0d0c40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.101+0000 7fdfe2400640 1 --2- 172.21.15.47:0/168789480 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdfdc15c840 0x7fdfdc0d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.101+0000 7fdfe2400640 1 --2- 172.21.15.47:0/168789480 >> v2:172.21.15.53:3300/0 conn(0x7fdfdc15c460 0x7fdfdc0ad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.101+0000 7fdfe2400640 1 -- 172.21.15.47:0/168789480 >> 172.21.15.47:0/168789480 conn(0x7fdfdc06bd60 msgr2=0x7fdfdc06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.101+0000 7fdfe2400640 1 -- 172.21.15.47:0/168789480 shutdown_connections 2024-05-27T10:53:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.101+0000 7fdfe2400640 1 -- 172.21.15.47:0/168789480 wait complete. 2024-05-27T10:53:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.103+0000 7fdfe2400640 1 Processor -- start 2024-05-27T10:53:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.103+0000 7fdfe2400640 1 -- start start 2024-05-27T10:53:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.104+0000 7fdfe2400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfdc0ad840 0x7fdfdc147880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.104+0000 7fdfe2400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfdc15c460 0x7fdfdc15f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.104+0000 7fdfe2400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdfdc15c840 0x7fdfdc150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:09.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.104+0000 7fdfe2400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdfdc0b31d0 con 0x7fdfdc0ad840 2024-05-27T10:53:09.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.104+0000 7fdfe2400640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdfdc160fa0 con 0x7fdfdc15c460 2024-05-27T10:53:09.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.104+0000 7fdfe2400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fdfdc0b3350 con 0x7fdfdc15c840 2024-05-27T10:53:09.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.104+0000 7fdfdb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfdc0ad840 0x7fdfdc147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:09.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.104+0000 7fdfdb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfdc0ad840 0x7fdfdc147880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55182/0 (socket says 172.21.15.47:55182) 2024-05-27T10:53:09.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.104+0000 7fdfdb400640 1 -- 172.21.15.47:0/3571108110 learned_addr learned my addr 172.21.15.47:0/3571108110 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:09.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.105+0000 7fdfdaa00640 1 --2- 172.21.15.47:0/3571108110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfdc15c460 0x7fdfdc15f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:09.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.105+0000 7fdfdbe00640 1 --2- 172.21.15.47:0/3571108110 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdfdc15c840 0x7fdfdc150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:09.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.105+0000 7fdfdb400640 1 -- 172.21.15.47:0/3571108110 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdfdc15c840 msgr2=0x7fdfdc150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:09.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.105+0000 7fdfdb400640 1 --2- 172.21.15.47:0/3571108110 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdfdc15c840 0x7fdfdc150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.105+0000 7fdfdb400640 1 -- 172.21.15.47:0/3571108110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfdc15c460 msgr2=0x7fdfdc15f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:09.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.105+0000 7fdfdb400640 1 --2- 172.21.15.47:0/3571108110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfdc15c460 0x7fdfdc15f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.105+0000 7fdfdb400640 1 -- 172.21.15.47:0/3571108110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfdc15fc90 con 0x7fdfdc0ad840 2024-05-27T10:53:09.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.105+0000 7fdfdaa00640 1 --2- 172.21.15.47:0/3571108110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfdc15c460 0x7fdfdc15f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:09.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.105+0000 7fdfdbe00640 1 --2- 172.21.15.47:0/3571108110 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdfdc15c840 0x7fdfdc150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:09.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.105+0000 7fdfdb400640 1 --2- 172.21.15.47:0/3571108110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfdc0ad840 0x7fdfdc147880 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00d830 tx=0x7fdfcc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:09.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.105+0000 7fdfd3400640 1 -- 172.21.15.47:0/3571108110 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc00b6c0 con 0x7fdfdc0ad840 2024-05-27T10:53:09.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.105+0000 7fdfd3400640 1 -- 172.21.15.47:0/3571108110 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfcc019070 con 0x7fdfdc0ad840 2024-05-27T10:53:09.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.105+0000 7fdfd3400640 1 -- 172.21.15.47:0/3571108110 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc00ba80 con 0x7fdfdc0ad840 2024-05-27T10:53:09.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.106+0000 7fdfe2400640 1 -- 172.21.15.47:0/3571108110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfdc15d260 con 0x7fdfdc0ad840 2024-05-27T10:53:09.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.106+0000 7fdfe2400640 1 -- 172.21.15.47:0/3571108110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfdc15d820 con 0x7fdfdc0ad840 2024-05-27T10:53:09.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.107+0000 7fdfe2400640 1 -- 172.21.15.47:0/3571108110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfdc0689e0 con 0x7fdfdc0ad840 2024-05-27T10:53:09.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.108+0000 7fdfd3400640 1 -- 172.21.15.47:0/3571108110 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdfcc01e460 con 0x7fdfdc0ad840 2024-05-27T10:53:09.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.108+0000 7fdfd3400640 1 --2- 172.21.15.47:0/3571108110 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdfbc06c8f0 0x7fdfbc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:09.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.109+0000 7fdfd3400640 1 -- 172.21.15.47:0/3571108110 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fdfcc08c220 con 0x7fdfdc0ad840 2024-05-27T10:53:09.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.109+0000 7fdfdaa00640 1 --2- 172.21.15.47:0/3571108110 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdfbc06c8f0 0x7fdfbc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:09.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.110+0000 7fdfdaa00640 1 --2- 172.21.15.47:0/3571108110 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdfbc06c8f0 0x7fdfbc06edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8006fd0 tx=0x7fdfc8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:09.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.113+0000 7fdfd3400640 1 -- 172.21.15.47:0/3571108110 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdfcc05a660 con 0x7fdfdc0ad840 2024-05-27T10:53:09.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.355+0000 7fdfe2400640 1 -- 172.21.15.47:0/3571108110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfdc0b5170 con 0x7fdfdc0ad840 2024-05-27T10:53:09.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.356+0000 7fdfd3400640 1 -- 172.21.15.47:0/3571108110 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7fdfcc059f60 con 0x7fdfdc0ad840 2024-05-27T10:53:09.354 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:53:09.354 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/4062514569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4062514569},{"type":"v1","addr":"172.21.15.47:6836","nonce":4062514569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/4113289884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":4113289884},{"type":"v1","addr":"172.21.15.53:6834","nonce":4113289884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3409529039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":3409529039},{"type":"v1","addr":"172.21.15.47:6837","nonce":3409529039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T10:52:01.683075+0000","modified":"2024-05-27T10:52:04.791891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6835/4292385883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":4292385883},{"type":"v1","addr":"172.21.15.53:6835","nonce":4292385883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-27T10:53:09.354 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-05-27T10:53:09.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.358+0000 7fdfe2400640 1 -- 172.21.15.47:0/3571108110 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdfbc06c8f0 msgr2=0x7fdfbc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:09.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.358+0000 7fdfe2400640 1 --2- 172.21.15.47:0/3571108110 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdfbc06c8f0 0x7fdfbc06edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8006fd0 tx=0x7fdfc8008040 comp rx=0 tx=0).stop 2024-05-27T10:53:09.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.358+0000 7fdfe2400640 1 -- 172.21.15.47:0/3571108110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfdc0ad840 msgr2=0x7fdfdc147880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:09.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.358+0000 7fdfe2400640 1 --2- 172.21.15.47:0/3571108110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfdc0ad840 0x7fdfdc147880 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00d830 tx=0x7fdfcc00dcf0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.359+0000 7fdfe2400640 1 -- 172.21.15.47:0/3571108110 shutdown_connections 2024-05-27T10:53:09.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.359+0000 7fdfe2400640 1 --2- 172.21.15.47:0/3571108110 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fdfbc06c8f0 0x7fdfbc06edb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.359+0000 7fdfe2400640 1 --2- 172.21.15.47:0/3571108110 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdfdc15c840 0x7fdfdc150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.359+0000 7fdfe2400640 1 --2- 172.21.15.47:0/3571108110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfdc15c460 0x7fdfdc15f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.359+0000 7fdfe2400640 1 --2- 172.21.15.47:0/3571108110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfdc0ad840 0x7fdfdc147880 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.359+0000 7fdfe2400640 1 -- 172.21.15.47:0/3571108110 >> 172.21.15.47:0/3571108110 conn(0x7fdfdc06bd60 msgr2=0x7fdfdc0b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:09.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.359+0000 7fdfe2400640 1 -- 172.21.15.47:0/3571108110 shutdown_connections 2024-05-27T10:53:09.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.359+0000 7fdfe2400640 1 -- 172.21.15.47:0/3571108110 wait complete. 2024-05-27T10:53:09.376 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:53:09.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.581+0000 7efc31200640 1 Processor -- start 2024-05-27T10:53:09.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.581+0000 7efc31200640 1 -- start start 2024-05-27T10:53:09.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.582+0000 7efc31200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc2c15c420 0x7efc2c071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:09.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.582+0000 7efc31200640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efc2c0b4ab0 0x7efc2c0d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:09.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.583+0000 7efc31200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc2c15c800 con 0x7efc2c073c50 2024-05-27T10:53:09.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.583+0000 7efc31200640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7efc2c0afc90 con 0x7efc2c0b4ab0 2024-05-27T10:53:09.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.583+0000 7efc31200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7efc2c0ad2e0 con 0x7efc2c15c420 2024-05-27T10:53:09.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.583+0000 7efc2be00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7efc2c073c50 0x7efc2c0b3790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51746/0 (socket says 172.21.15.47:51746) 2024-05-27T10:53:09.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.583+0000 7efc2be00640 1 -- 172.21.15.47:0/1942985469 learned_addr learned my addr 172.21.15.47:0/1942985469 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:09.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.583+0000 7efc23e00640 1 --2- 172.21.15.47:0/1942985469 >> v2:172.21.15.53:3300/0 conn(0x7efc2c0b4ab0 0x7efc2c0d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:09.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.583+0000 7efc2b400640 1 --2- 172.21.15.47:0/1942985469 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc2c15c420 0x7efc2c071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:09.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.583+0000 7efc2aa00640 1 -- 172.21.15.47:0/1942985469 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4059503290 0 0) 0x7efc2c15c800 con 0x7efc2c073c50 2024-05-27T10:53:09.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.584+0000 7efc2aa00640 1 -- 172.21.15.47:0/1942985469 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc10003520 con 0x7efc2c073c50 2024-05-27T10:53:09.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.584+0000 7efc2aa00640 1 -- 172.21.15.47:0/1942985469 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3075012864 0 0) 0x7efc10003520 con 0x7efc2c073c50 2024-05-27T10:53:09.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.584+0000 7efc2aa00640 1 -- 172.21.15.47:0/1942985469 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc2c15c420 msgr2=0x7efc2c071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:09.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.584+0000 7efc2aa00640 1 --2- 172.21.15.47:0/1942985469 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc2c15c420 0x7efc2c071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.584+0000 7efc2aa00640 1 -- 172.21.15.47:0/1942985469 >> v2:172.21.15.53:3300/0 conn(0x7efc2c0b4ab0 msgr2=0x7efc2c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.584+0000 7efc2aa00640 1 --2- 172.21.15.47:0/1942985469 >> v2:172.21.15.53:3300/0 conn(0x7efc2c0b4ab0 0x7efc2c0d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.584+0000 7efc2aa00640 1 -- 172.21.15.47:0/1942985469 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2c0ad5c0 con 0x7efc2c073c50 2024-05-27T10:53:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.584+0000 7efc2aa00640 1 -- 172.21.15.47:0/1942985469 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7efc240019f0 con 0x7efc2c073c50 2024-05-27T10:53:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.584+0000 7efc2aa00640 1 -- 172.21.15.47:0/1942985469 >> v1:172.21.15.47:6789/0 conn(0x7efc2c073c50 legacy=0x7efc2c0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.584+0000 7efc2aa00640 1 --2- 172.21.15.47:0/1942985469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc100039b0 0x7efc10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.584+0000 7efc2aa00640 1 --2- 172.21.15.47:0/1942985469 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc2c15c420 0x7efc10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.584+0000 7efc2aa00640 1 --2- 172.21.15.47:0/1942985469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc10004d40 0x7efc100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.584+0000 7efc2aa00640 1 -- 172.21.15.47:0/1942985469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c0afc90 con 0x7efc10004d40 2024-05-27T10:53:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.584+0000 7efc2aa00640 1 -- 172.21.15.47:0/1942985469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c0ad2e0 con 0x7efc100039b0 2024-05-27T10:53:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.584+0000 7efc2aa00640 1 -- 172.21.15.47:0/1942985469 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7efc1000b9c0 con 0x7efc2c15c420 2024-05-27T10:53:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.584+0000 7efc2be00640 1 --2- 172.21.15.47:0/1942985469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc10004d40 0x7efc100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:09.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.585+0000 7efc2b400640 1 --2- 172.21.15.47:0/1942985469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc100039b0 0x7efc10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:09.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.585+0000 7efc2be00640 1 -- 172.21.15.47:0/1942985469 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc2c15c420 msgr2=0x7efc10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:09.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.585+0000 7efc2be00640 1 --2- 172.21.15.47:0/1942985469 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc2c15c420 0x7efc10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.585+0000 7efc2be00640 1 -- 172.21.15.47:0/1942985469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc100039b0 msgr2=0x7efc10003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:09.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.585+0000 7efc2be00640 1 --2- 172.21.15.47:0/1942985469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc100039b0 0x7efc10003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.585+0000 7efc2be00640 1 -- 172.21.15.47:0/1942985469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc10003520 con 0x7efc10004d40 2024-05-27T10:53:09.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.585+0000 7efc2b400640 1 --2- 172.21.15.47:0/1942985469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc100039b0 0x7efc10003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:09.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.586+0000 7efc2be00640 1 --2- 172.21.15.47:0/1942985469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc10004d40 0x7efc100051c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7efc2400a880 tx=0x7efc10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0e3c22e4e5b6bc server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:09.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.586+0000 7efc2aa00640 1 -- 172.21.15.47:0/1942985469 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2400a4a0 con 0x7efc10004d40 2024-05-27T10:53:09.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.586+0000 7efc2aa00640 1 -- 172.21.15.47:0/1942985469 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2402f070 con 0x7efc10004d40 2024-05-27T10:53:09.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.586+0000 7efc2aa00640 1 -- 172.21.15.47:0/1942985469 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2402bd00 con 0x7efc10004d40 2024-05-27T10:53:09.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.587+0000 7efc31200640 1 -- 172.21.15.47:0/1942985469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc10004d40 msgr2=0x7efc100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:09.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.587+0000 7efc31200640 1 --2- 172.21.15.47:0/1942985469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc10004d40 0x7efc100051c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7efc2400a880 tx=0x7efc10005830 comp rx=0 tx=0).stop 2024-05-27T10:53:09.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.587+0000 7efc2be00640 1 -- 172.21.15.47:0/1942985469 reap_dead start 2024-05-27T10:53:09.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.587+0000 7efc31200640 1 -- 172.21.15.47:0/1942985469 shutdown_connections 2024-05-27T10:53:09.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.587+0000 7efc31200640 1 -- 172.21.15.47:0/1942985469 >> 172.21.15.47:0/1942985469 conn(0x7efc2c06bb20 msgr2=0x7efc2c06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:09.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.587+0000 7efc31200640 1 -- 172.21.15.47:0/1942985469 shutdown_connections 2024-05-27T10:53:09.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.587+0000 7efc31200640 1 -- 172.21.15.47:0/1942985469 wait complete. 2024-05-27T10:53:09.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.589+0000 7efc31200640 1 Processor -- start 2024-05-27T10:53:09.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.589+0000 7efc31200640 1 -- start start 2024-05-27T10:53:09.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.590+0000 7efc31200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc10004d40 0x7efc2c158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:09.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.590+0000 7efc31200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc2c157440 0x7efc2c099310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:09.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.590+0000 7efc31200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc2c1f3db0 0x7efc2c1f4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.590+0000 7efc31200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c0af8f0 con 0x7efc10004d40 2024-05-27T10:53:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.590+0000 7efc31200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c0ad8a0 con 0x7efc2c1f3db0 2024-05-27T10:53:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.590+0000 7efc31200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7efc2c0afa70 con 0x7efc2c157440 2024-05-27T10:53:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.590+0000 7efc2b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc10004d40 0x7efc2c158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.590+0000 7efc2b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc10004d40 0x7efc2c158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55212/0 (socket says 172.21.15.47:55212) 2024-05-27T10:53:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.590+0000 7efc2b400640 1 -- 172.21.15.47:0/4281565046 learned_addr learned my addr 172.21.15.47:0/4281565046 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.590+0000 7efc2b400640 1 -- 172.21.15.47:0/4281565046 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc2c157440 msgr2=0x7efc2c099310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.590+0000 7efc2b400640 1 --2- 172.21.15.47:0/4281565046 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc2c157440 0x7efc2c099310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.590+0000 7efc2b400640 1 -- 172.21.15.47:0/4281565046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc2c1f3db0 msgr2=0x7efc2c1f4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.590+0000 7efc2b400640 1 --2- 172.21.15.47:0/4281565046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc2c1f3db0 0x7efc2c1f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.590+0000 7efc2b400640 1 -- 172.21.15.47:0/4281565046 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2c1587e0 con 0x7efc10004d40 2024-05-27T10:53:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.591+0000 7efc2b400640 1 --2- 172.21.15.47:0/4281565046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc10004d40 0x7efc2c158200 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efc1c010870 tx=0x7efc1c010d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.591+0000 7efc23400640 1 -- 172.21.15.47:0/4281565046 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1c00f040 con 0x7efc10004d40 2024-05-27T10:53:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.591+0000 7efc23400640 1 -- 172.21.15.47:0/4281565046 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc1c00eae0 con 0x7efc10004d40 2024-05-27T10:53:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.591+0000 7efc23400640 1 -- 172.21.15.47:0/4281565046 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1c01c400 con 0x7efc10004d40 2024-05-27T10:53:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.591+0000 7efc31200640 1 -- 172.21.15.47:0/4281565046 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc2c156960 con 0x7efc10004d40 2024-05-27T10:53:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.591+0000 7efc31200640 1 -- 172.21.15.47:0/4281565046 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc2c156f20 con 0x7efc10004d40 2024-05-27T10:53:09.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.592+0000 7efc31200640 1 -- 172.21.15.47:0/4281565046 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc2c0b0e60 con 0x7efc10004d40 2024-05-27T10:53:09.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.593+0000 7efc23400640 1 -- 172.21.15.47:0/4281565046 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efc1c01c5a0 con 0x7efc10004d40 2024-05-27T10:53:09.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.594+0000 7efc23400640 1 --2- 172.21.15.47:0/4281565046 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7efc0806c8f0 0x7efc0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:09.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.594+0000 7efc23400640 1 -- 172.21.15.47:0/4281565046 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7efc1c08c1d0 con 0x7efc10004d40 2024-05-27T10:53:09.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.594+0000 7efc23e00640 1 --2- 172.21.15.47:0/4281565046 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7efc0806c8f0 0x7efc0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:09.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.595+0000 7efc23e00640 1 --2- 172.21.15.47:0/4281565046 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7efc0806c8f0 0x7efc0806edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efc14006a90 tx=0x7efc14006a20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:09.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.598+0000 7efc23400640 1 -- 172.21.15.47:0/4281565046 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efc2c0b0e60 con 0x7efc10004d40 2024-05-27T10:53:09.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.796+0000 7efc31200640 1 -- 172.21.15.47:0/4281565046 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc2c04fce0 con 0x7efc10004d40 2024-05-27T10:53:09.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.798+0000 7efc23400640 1 -- 172.21.15.47:0/4281565046 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16770 (secure 0 0 0) 0x7efc1c018030 con 0x7efc10004d40 2024-05-27T10:53:09.797 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:53:09.797 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":22,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:52:48.545555+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:51:59.202702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T10:52:00.664039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:53:09.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.801+0000 7efc31200640 1 -- 172.21.15.47:0/4281565046 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7efc0806c8f0 msgr2=0x7efc0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:09.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.801+0000 7efc31200640 1 --2- 172.21.15.47:0/4281565046 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7efc0806c8f0 0x7efc0806edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efc14006a90 tx=0x7efc14006a20 comp rx=0 tx=0).stop 2024-05-27T10:53:09.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.801+0000 7efc31200640 1 -- 172.21.15.47:0/4281565046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc10004d40 msgr2=0x7efc2c158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:09.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.801+0000 7efc31200640 1 --2- 172.21.15.47:0/4281565046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc10004d40 0x7efc2c158200 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efc1c010870 tx=0x7efc1c010d30 comp rx=0 tx=0).stop 2024-05-27T10:53:09.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.801+0000 7efc31200640 1 -- 172.21.15.47:0/4281565046 shutdown_connections 2024-05-27T10:53:09.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.801+0000 7efc31200640 1 --2- 172.21.15.47:0/4281565046 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7efc0806c8f0 0x7efc0806edb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.801+0000 7efc31200640 1 --2- 172.21.15.47:0/4281565046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc2c1f3db0 0x7efc2c1f4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.801+0000 7efc31200640 1 --2- 172.21.15.47:0/4281565046 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc2c157440 0x7efc2c099310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.801+0000 7efc31200640 1 --2- 172.21.15.47:0/4281565046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc10004d40 0x7efc2c158200 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:09.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.801+0000 7efc31200640 1 -- 172.21.15.47:0/4281565046 >> 172.21.15.47:0/4281565046 conn(0x7efc2c06bb20 msgr2=0x7efc2c06ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:09.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.801+0000 7efc31200640 1 -- 172.21.15.47:0/4281565046 shutdown_connections 2024-05-27T10:53:09.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:09.801+0000 7efc31200640 1 -- 172.21.15.47:0/4281565046 wait complete. 2024-05-27T10:53:09.817 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-27T10:53:10.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.030+0000 7f28ee000640 1 Processor -- start 2024-05-27T10:53:10.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.030+0000 7f28ee000640 1 -- start start 2024-05-27T10:53:10.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.032+0000 7f28ee000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f28e8072330 0x7f28e806eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:10.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.032+0000 7f28ee000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28e806fe40 con 0x7f28e815f2a0 2024-05-27T10:53:10.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.032+0000 7f28ee000640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28e815f830 con 0x7f28e80d0360 2024-05-27T10:53:10.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.032+0000 7f28ee000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f28e8072710 con 0x7f28e8072330 2024-05-27T10:53:10.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.032+0000 7f28ecc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f28e8072330 0x7f28e806eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:10.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.032+0000 7f28ecc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f28e8072330 0x7f28e806eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55214/0 (socket says 172.21.15.47:55214) 2024-05-27T10:53:10.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.032+0000 7f28ecc00640 1 -- 172.21.15.47:0/3684896802 learned_addr learned my addr 172.21.15.47:0/3684896802 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:10.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.033+0000 7f28ecc00640 1 -- 172.21.15.47:0/3684896802 >> v1:172.21.15.53:6789/0 conn(0x7f28e80d0360 legacy=0x7f28e815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:10.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.033+0000 7f28ecc00640 1 -- 172.21.15.47:0/3684896802 >> v1:172.21.15.47:6789/0 conn(0x7f28e815f2a0 legacy=0x7f28e80b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:10.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.033+0000 7f28ecc00640 1 -- 172.21.15.47:0/3684896802 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e806dfd0 con 0x7f28e8072330 2024-05-27T10:53:10.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.034+0000 7f28ecc00640 1 --2- 172.21.15.47:0/3684896802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e8072330 0x7f28e806eab0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009870 tx=0x7f28dc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f92f40cb35f4fed server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:10.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.034+0000 7f28e7400640 1 -- 172.21.15.47:0/3684896802 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc037070 con 0x7f28e8072330 2024-05-27T10:53:10.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.034+0000 7f28e7400640 1 -- 172.21.15.47:0/3684896802 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28dc032440 con 0x7f28e8072330 2024-05-27T10:53:10.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.034+0000 7f28e7400640 1 -- 172.21.15.47:0/3684896802 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc032810 con 0x7f28e8072330 2024-05-27T10:53:10.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.035+0000 7f28ee000640 1 -- 172.21.15.47:0/3684896802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e8072330 msgr2=0x7f28e806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:10.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.035+0000 7f28ee000640 1 --2- 172.21.15.47:0/3684896802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e8072330 0x7f28e806eab0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009870 tx=0x7f28dc02a180 comp rx=0 tx=0).stop 2024-05-27T10:53:10.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.035+0000 7f28ee000640 1 -- 172.21.15.47:0/3684896802 shutdown_connections 2024-05-27T10:53:10.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.035+0000 7f28ee000640 1 --2- 172.21.15.47:0/3684896802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e8072330 0x7f28e806eab0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:10.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.035+0000 7f28ee000640 1 -- 172.21.15.47:0/3684896802 >> 172.21.15.47:0/3684896802 conn(0x7f28e806bb20 msgr2=0x7f28e806bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:10.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.035+0000 7f28ee000640 1 -- 172.21.15.47:0/3684896802 shutdown_connections 2024-05-27T10:53:10.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.035+0000 7f28ee000640 1 -- 172.21.15.47:0/3684896802 wait complete. 2024-05-27T10:53:10.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.037+0000 7f28ee000640 1 Processor -- start 2024-05-27T10:53:10.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.037+0000 7f28ee000640 1 -- start start 2024-05-27T10:53:10.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.038+0000 7f28ee000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e8072330 0x7f28e81e7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:10.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.038+0000 7f28ee000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f28e80d0360 0x7f28e8152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:10.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.038+0000 7f28ee000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28e815f2a0 0x7f28e8153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:10.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.038+0000 7f28ee000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f28e806e620 con 0x7f28e8072330 2024-05-27T10:53:10.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.038+0000 7f28ee000640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f28e815fb10 con 0x7f28e815f2a0 2024-05-27T10:53:10.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.038+0000 7f28ee000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f28e80d07c0 con 0x7f28e80d0360 2024-05-27T10:53:10.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.038+0000 7f28ecc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e8072330 0x7f28e81e7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:10.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.038+0000 7f28ecc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e8072330 0x7f28e81e7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55222/0 (socket says 172.21.15.47:55222) 2024-05-27T10:53:10.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.038+0000 7f28ecc00640 1 -- 172.21.15.47:0/3907232503 learned_addr learned my addr 172.21.15.47:0/3907232503 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:10.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.038+0000 7f28ecc00640 1 -- 172.21.15.47:0/3907232503 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f28e80d0360 msgr2=0x7f28e8152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:10.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.038+0000 7f28ecc00640 1 --2- 172.21.15.47:0/3907232503 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f28e80d0360 0x7f28e8152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:10.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.038+0000 7f28ecc00640 1 -- 172.21.15.47:0/3907232503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28e815f2a0 msgr2=0x7f28e8153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:10.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.038+0000 7f28ecc00640 1 --2- 172.21.15.47:0/3907232503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28e815f2a0 0x7f28e8153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:10.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.038+0000 7f28ecc00640 1 -- 172.21.15.47:0/3907232503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e81e8530 con 0x7f28e8072330 2024-05-27T10:53:10.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.039+0000 7f28ecc00640 1 --2- 172.21.15.47:0/3907232503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e8072330 0x7f28e81e7ff0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009870 tx=0x7f28dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:10.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.039+0000 7f28e4c00640 1 -- 172.21.15.47:0/3907232503 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc041020 con 0x7f28e8072330 2024-05-27T10:53:10.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.039+0000 7f28e4c00640 1 -- 172.21.15.47:0/3907232503 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28dc030990 con 0x7f28e8072330 2024-05-27T10:53:10.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.039+0000 7f28e4c00640 1 -- 172.21.15.47:0/3907232503 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc037040 con 0x7f28e8072330 2024-05-27T10:53:10.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.039+0000 7f28ee000640 1 -- 172.21.15.47:0/3907232503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e81e87d0 con 0x7f28e8072330 2024-05-27T10:53:10.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.039+0000 7f28ee000640 1 -- 172.21.15.47:0/3907232503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e81e8d90 con 0x7f28e8072330 2024-05-27T10:53:10.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.041+0000 7f28ee000640 1 -- 172.21.15.47:0/3907232503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e804fce0 con 0x7f28e8072330 2024-05-27T10:53:10.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.042+0000 7f28e4c00640 1 -- 172.21.15.47:0/3907232503 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f28dc044020 con 0x7f28e8072330 2024-05-27T10:53:10.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.043+0000 7f28e4c00640 1 --2- 172.21.15.47:0/3907232503 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f28cc06c8f0 0x7f28cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:10.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.043+0000 7f28e4c00640 1 -- 172.21.15.47:0/3907232503 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f28dc0ac620 con 0x7f28e8072330 2024-05-27T10:53:10.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.043+0000 7f28e7e00640 1 --2- 172.21.15.47:0/3907232503 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f28cc06c8f0 0x7f28cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:10.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.044+0000 7f28e7e00640 1 --2- 172.21.15.47:0/3907232503 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f28cc06c8f0 0x7f28cc06edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f28e8158960 tx=0x7f28d80079b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:10.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.047+0000 7f28e4c00640 1 -- 172.21.15.47:0/3907232503 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f28dc04b030 con 0x7f28e8072330 2024-05-27T10:53:10.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.296+0000 7f28ee000640 1 -- 172.21.15.47:0/3907232503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f28e8072b00 con 0x7f28e8072330 2024-05-27T10:53:10.295 INFO:tasks.ceph.mon.a.smithi047.stderr:2024-05-27T10:53:10.297+0000 7fdaa1600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-27T10:53:10.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.300+0000 7f28e4c00640 1 -- 172.21.15.47:0/3907232503 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f28dc07aa60 con 0x7f28e8072330 2024-05-27T10:53:10.298 INFO:teuthology.orchestra.run.smithi047.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-27T10:53:10.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.303+0000 7f28ee000640 1 -- 172.21.15.47:0/3907232503 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f28cc06c8f0 msgr2=0x7f28cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:10.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.303+0000 7f28ee000640 1 --2- 172.21.15.47:0/3907232503 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f28cc06c8f0 0x7f28cc06edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f28e8158960 tx=0x7f28d80079b0 comp rx=0 tx=0).stop 2024-05-27T10:53:10.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.303+0000 7f28ee000640 1 -- 172.21.15.47:0/3907232503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e8072330 msgr2=0x7f28e81e7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:10.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.303+0000 7f28ee000640 1 --2- 172.21.15.47:0/3907232503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e8072330 0x7f28e81e7ff0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009870 tx=0x7f28dc0046c0 comp rx=0 tx=0).stop 2024-05-27T10:53:10.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.304+0000 7f28ee000640 1 -- 172.21.15.47:0/3907232503 shutdown_connections 2024-05-27T10:53:10.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.304+0000 7f28ee000640 1 --2- 172.21.15.47:0/3907232503 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f28cc06c8f0 0x7f28cc06edb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:10.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.304+0000 7f28ee000640 1 --2- 172.21.15.47:0/3907232503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28e815f2a0 0x7f28e8153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:10.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.304+0000 7f28ee000640 1 --2- 172.21.15.47:0/3907232503 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f28e80d0360 0x7f28e8152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:10.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.304+0000 7f28ee000640 1 --2- 172.21.15.47:0/3907232503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e8072330 0x7f28e81e7ff0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:10.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.304+0000 7f28ee000640 1 -- 172.21.15.47:0/3907232503 >> 172.21.15.47:0/3907232503 conn(0x7f28e806bb20 msgr2=0x7f28e80b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:10.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.304+0000 7f28ee000640 1 -- 172.21.15.47:0/3907232503 shutdown_connections 2024-05-27T10:53:10.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.304+0000 7f28ee000640 1 -- 172.21.15.47:0/3907232503 wait complete. 2024-05-27T10:53:10.332 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-27T10:53:10.333 INFO:tasks.ceph.mds.b.smithi053.stderr: -4178> 2024-05-27T10:52:05.060+0000 7fa7b4200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-27T10:53:10.425 INFO:tasks.ceph.mds.b.smithi053.stdout:starting mds.b at 2024-05-27T10:53:10.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.550+0000 7fa563200640 1 Processor -- start 2024-05-27T10:53:10.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.551+0000 7fa563200640 1 -- start start 2024-05-27T10:53:10.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.552+0000 7fa563200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa55c15e630 0x7fa55c0d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:10.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.552+0000 7fa563200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa55c0b6670 0x7fa55c0d3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:10.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.552+0000 7fa563200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa55c0ced40 con 0x7fa55c0cfde0 2024-05-27T10:53:10.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.552+0000 7fa563200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa55c0cf950 con 0x7fa55c0b6670 2024-05-27T10:53:10.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.552+0000 7fa563200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fa55c0cf020 con 0x7fa55c15e630 2024-05-27T10:53:10.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.552+0000 7fa562800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa55c0b6670 0x7fa55c0d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:10.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.552+0000 7fa562800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa55c0b6670 0x7fa55c0d3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55228/0 (socket says 172.21.15.47:55228) 2024-05-27T10:53:10.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.552+0000 7fa562800640 1 -- 172.21.15.47:0/2343584217 learned_addr learned my addr 172.21.15.47:0/2343584217 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:10.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.552+0000 7fa561400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa55c0cfde0 0x7fa55c0b5f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51762/0 (socket says 172.21.15.47:51762) 2024-05-27T10:53:10.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.553+0000 7fa561e00640 1 --2- 172.21.15.47:0/2343584217 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa55c15e630 0x7fa55c0d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:10.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.553+0000 7fa562800640 1 -- 172.21.15.47:0/2343584217 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa55c15e630 msgr2=0x7fa55c0d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:10.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.553+0000 7fa562800640 1 --2- 172.21.15.47:0/2343584217 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa55c15e630 0x7fa55c0d3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:10.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.553+0000 7fa562800640 1 -- 172.21.15.47:0/2343584217 >> v1:172.21.15.47:6789/0 conn(0x7fa55c0cfde0 legacy=0x7fa55c0b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:10.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.553+0000 7fa562800640 1 -- 172.21.15.47:0/2343584217 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55c0cf300 con 0x7fa55c0b6670 2024-05-27T10:53:10.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.554+0000 7fa562800640 1 --2- 172.21.15.47:0/2343584217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa55c0b6670 0x7fa55c0d3770 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa558009e50 tx=0x7fa55802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cc727677b0ff8 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:10.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.554+0000 7fa560a00640 1 -- 172.21.15.47:0/2343584217 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558036070 con 0x7fa55c0b6670 2024-05-27T10:53:10.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.554+0000 7fa560a00640 1 -- 172.21.15.47:0/2343584217 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa558031600 con 0x7fa55c0b6670 2024-05-27T10:53:10.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.554+0000 7fa560a00640 1 -- 172.21.15.47:0/2343584217 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5580319d0 con 0x7fa55c0b6670 2024-05-27T10:53:10.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.555+0000 7fa563200640 1 -- 172.21.15.47:0/2343584217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa55c0b6670 msgr2=0x7fa55c0d3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:10.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.555+0000 7fa563200640 1 --2- 172.21.15.47:0/2343584217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa55c0b6670 0x7fa55c0d3770 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa558009e50 tx=0x7fa55802a730 comp rx=0 tx=0).stop 2024-05-27T10:53:10.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.555+0000 7fa563200640 1 -- 172.21.15.47:0/2343584217 shutdown_connections 2024-05-27T10:53:10.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.555+0000 7fa563200640 1 --2- 172.21.15.47:0/2343584217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa55c0b6670 0x7fa55c0d3770 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:10.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.555+0000 7fa563200640 1 --2- 172.21.15.47:0/2343584217 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa55c15e630 0x7fa55c0d3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:10.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.555+0000 7fa563200640 1 -- 172.21.15.47:0/2343584217 >> 172.21.15.47:0/2343584217 conn(0x7fa55c08bfd0 msgr2=0x7fa55c0d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:10.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.555+0000 7fa563200640 1 -- 172.21.15.47:0/2343584217 shutdown_connections 2024-05-27T10:53:10.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.555+0000 7fa563200640 1 -- 172.21.15.47:0/2343584217 wait complete. 2024-05-27T10:53:10.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.557+0000 7fa563200640 1 Processor -- start 2024-05-27T10:53:10.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.557+0000 7fa563200640 1 -- start start 2024-05-27T10:53:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.558+0000 7fa563200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa55c0b6670 0x7fa55c1553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.558+0000 7fa563200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa55c0cfde0 0x7fa55c0b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.558+0000 7fa563200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa55c15e630 0x7fa55c15d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.558+0000 7fa563200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c15eb90 con 0x7fa55c15e630 2024-05-27T10:53:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.558+0000 7fa563200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c15ea10 con 0x7fa55c0b6670 2024-05-27T10:53:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.558+0000 7fa563200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fa55c1685f0 con 0x7fa55c0cfde0 2024-05-27T10:53:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.558+0000 7fa562800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa55c15e630 0x7fa55c15d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.558+0000 7fa562800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa55c15e630 0x7fa55c15d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55240/0 (socket says 172.21.15.47:55240) 2024-05-27T10:53:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.558+0000 7fa562800640 1 -- 172.21.15.47:0/1763999860 learned_addr learned my addr 172.21.15.47:0/1763999860 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.559+0000 7fa561400640 1 --2- 172.21.15.47:0/1763999860 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa55c0cfde0 0x7fa55c0b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.559+0000 7fa561e00640 1 --2- 172.21.15.47:0/1763999860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa55c0b6670 0x7fa55c1553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.559+0000 7fa562800640 1 -- 172.21.15.47:0/1763999860 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa55c0cfde0 msgr2=0x7fa55c0b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:10.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.559+0000 7fa562800640 1 --2- 172.21.15.47:0/1763999860 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa55c0cfde0 0x7fa55c0b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:10.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.559+0000 7fa562800640 1 -- 172.21.15.47:0/1763999860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa55c0b6670 msgr2=0x7fa55c1553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:10.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.559+0000 7fa562800640 1 --2- 172.21.15.47:0/1763999860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa55c0b6670 0x7fa55c1553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:10.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.559+0000 7fa562800640 1 -- 172.21.15.47:0/1763999860 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55c0b1fe0 con 0x7fa55c15e630 2024-05-27T10:53:10.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.559+0000 7fa561400640 1 --2- 172.21.15.47:0/1763999860 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa55c0cfde0 0x7fa55c0b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:10.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.559+0000 7fa562800640 1 --2- 172.21.15.47:0/1763999860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa55c15e630 0x7fa55c15d530 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa558009f70 tx=0x7fa558004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.559+0000 7fa556000640 1 -- 172.21.15.47:0/1763999860 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558041020 con 0x7fa55c15e630 2024-05-27T10:53:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.559+0000 7fa556000640 1 -- 172.21.15.47:0/1763999860 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa558008730 con 0x7fa55c15e630 2024-05-27T10:53:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.559+0000 7fa563200640 1 -- 172.21.15.47:0/1763999860 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa55c0b1a20 con 0x7fa55c15e630 2024-05-27T10:53:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.560+0000 7fa556000640 1 -- 172.21.15.47:0/1763999860 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558036040 con 0x7fa55c15e630 2024-05-27T10:53:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.560+0000 7fa563200640 1 -- 172.21.15.47:0/1763999860 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa55c155930 con 0x7fa55c15e630 2024-05-27T10:53:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.561+0000 7fa563200640 1 -- 172.21.15.47:0/1763999860 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa55c04fce0 con 0x7fa55c15e630 2024-05-27T10:53:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.562+0000 7fa556000640 1 -- 172.21.15.47:0/1763999860 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa558044020 con 0x7fa55c15e630 2024-05-27T10:53:10.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.563+0000 7fa556000640 1 --2- 172.21.15.47:0/1763999860 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa54006c8f0 0x7fa54006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:10.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.563+0000 7fa556000640 1 -- 172.21.15.47:0/1763999860 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5911+0+0 (secure 0 0 0) 0x7fa5580ac850 con 0x7fa55c15e630 2024-05-27T10:53:10.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.563+0000 7fa561e00640 1 --2- 172.21.15.47:0/1763999860 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa54006c8f0 0x7fa54006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:10.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.564+0000 7fa561e00640 1 --2- 172.21.15.47:0/1763999860 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa54006c8f0 0x7fa54006edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa550006fd0 tx=0x7fa550008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:10.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.567+0000 7fa556000640 1 -- 172.21.15.47:0/1763999860 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa55804b030 con 0x7fa55c15e630 2024-05-27T10:53:10.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:10.815+0000 7fa563200640 1 -- 172.21.15.47:0/1763999860 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa55c0b1db0 con 0x7fa55c15e630 2024-05-27T10:53:11.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.304+0000 7fa556000640 1 -- 172.21.15.47:0/1763999860 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fa55807aba0 con 0x7fa55c15e630 2024-05-27T10:53:11.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.307+0000 7fa563200640 1 -- 172.21.15.47:0/1763999860 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa54006c8f0 msgr2=0x7fa54006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:11.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.307+0000 7fa563200640 1 --2- 172.21.15.47:0/1763999860 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa54006c8f0 0x7fa54006edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa550006fd0 tx=0x7fa550008040 comp rx=0 tx=0).stop 2024-05-27T10:53:11.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.307+0000 7fa563200640 1 -- 172.21.15.47:0/1763999860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa55c15e630 msgr2=0x7fa55c15d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:11.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.307+0000 7fa563200640 1 --2- 172.21.15.47:0/1763999860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa55c15e630 0x7fa55c15d530 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa558009f70 tx=0x7fa558004a40 comp rx=0 tx=0).stop 2024-05-27T10:53:11.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.308+0000 7fa563200640 1 -- 172.21.15.47:0/1763999860 shutdown_connections 2024-05-27T10:53:11.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.308+0000 7fa563200640 1 --2- 172.21.15.47:0/1763999860 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa54006c8f0 0x7fa54006edb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:11.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.308+0000 7fa563200640 1 --2- 172.21.15.47:0/1763999860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa55c15e630 0x7fa55c15d530 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:11.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.308+0000 7fa563200640 1 --2- 172.21.15.47:0/1763999860 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa55c0cfde0 0x7fa55c0b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:11.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.308+0000 7fa563200640 1 --2- 172.21.15.47:0/1763999860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa55c0b6670 0x7fa55c1553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:11.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.308+0000 7fa563200640 1 -- 172.21.15.47:0/1763999860 >> 172.21.15.47:0/1763999860 conn(0x7fa55c08bfd0 msgr2=0x7fa55c0b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:11.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.308+0000 7fa563200640 1 -- 172.21.15.47:0/1763999860 shutdown_connections 2024-05-27T10:53:11.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.308+0000 7fa563200640 1 -- 172.21.15.47:0/1763999860 wait complete. 2024-05-27T10:53:11.329 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-27T10:53:11.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.548+0000 7f80ff200640 1 Processor -- start 2024-05-27T10:53:11.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.549+0000 7f80ff200640 1 -- start start 2024-05-27T10:53:11.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.550+0000 7f80ff200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f81000d0f60 0x7f81000d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:11.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.550+0000 7f80ff200640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f81000d3060 0x7f81000d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:11.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.550+0000 7f80ff200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81000d25e0 con 0x7f810015e8d0 2024-05-27T10:53:11.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.550+0000 7f80ff200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f810015ecb0 con 0x7f81000d0f60 2024-05-27T10:53:11.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.550+0000 7f80ff200640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f810006d360 con 0x7f81000d3060 2024-05-27T10:53:11.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.551+0000 7f80fd400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f81000d0f60 0x7f81000d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:11.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.551+0000 7f80fd400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f81000d0f60 0x7f81000d13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51952/0 (socket says 172.21.15.47:51952) 2024-05-27T10:53:11.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.551+0000 7f80fd400640 1 -- 172.21.15.47:0/1331427407 learned_addr learned my addr 172.21.15.47:0/1331427407 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:11.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.551+0000 7f80fde00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f810015e8d0 0x7f810006cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35242/0 (socket says 172.21.15.47:35242) 2024-05-27T10:53:11.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.551+0000 7f80fe800640 1 --2- 172.21.15.47:0/1331427407 >> v2:172.21.15.53:3300/0 conn(0x7f81000d3060 0x7f81000d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:11.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.551+0000 7f80fd400640 1 -- 172.21.15.47:0/1331427407 >> v2:172.21.15.53:3300/0 conn(0x7f81000d3060 msgr2=0x7f81000d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:11.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.551+0000 7f80fd400640 1 --2- 172.21.15.47:0/1331427407 >> v2:172.21.15.53:3300/0 conn(0x7f81000d3060 0x7f81000d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:11.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.551+0000 7f80fd400640 1 -- 172.21.15.47:0/1331427407 >> v1:172.21.15.47:6789/0 conn(0x7f810015e8d0 legacy=0x7f810006cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:11.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.551+0000 7f80fd400640 1 -- 172.21.15.47:0/1331427407 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81000cfa20 con 0x7f81000d0f60 2024-05-27T10:53:11.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.551+0000 7f80fe800640 1 --2- 172.21.15.47:0/1331427407 >> v2:172.21.15.53:3300/0 conn(0x7f81000d3060 0x7f81000d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:11.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.552+0000 7f80fd400640 1 --2- 172.21.15.47:0/1331427407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81000d0f60 0x7f81000d13c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f81000a23f0 tx=0x7f80e802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac7568a3ee840a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:11.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.553+0000 7f80fca00640 1 -- 172.21.15.47:0/1331427407 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e80325f0 con 0x7f81000d0f60 2024-05-27T10:53:11.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.553+0000 7f80fca00640 1 -- 172.21.15.47:0/1331427407 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80e8032790 con 0x7f81000d0f60 2024-05-27T10:53:11.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.553+0000 7f80fca00640 1 -- 172.21.15.47:0/1331427407 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8032b60 con 0x7f81000d0f60 2024-05-27T10:53:11.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.553+0000 7f80ff200640 1 -- 172.21.15.47:0/1331427407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81000d0f60 msgr2=0x7f81000d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:11.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.553+0000 7f80ff200640 1 --2- 172.21.15.47:0/1331427407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81000d0f60 0x7f81000d13c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f81000a23f0 tx=0x7f80e802a780 comp rx=0 tx=0).stop 2024-05-27T10:53:11.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.553+0000 7f80ff200640 1 -- 172.21.15.47:0/1331427407 shutdown_connections 2024-05-27T10:53:11.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.553+0000 7f80ff200640 1 --2- 172.21.15.47:0/1331427407 >> v2:172.21.15.53:3300/0 conn(0x7f81000d3060 0x7f81000d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:11.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.553+0000 7f80ff200640 1 --2- 172.21.15.47:0/1331427407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81000d0f60 0x7f81000d13c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:11.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.553+0000 7f80ff200640 1 -- 172.21.15.47:0/1331427407 >> 172.21.15.47:0/1331427407 conn(0x7f810008bfd0 msgr2=0x7f810009d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:11.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.554+0000 7f80ff200640 1 -- 172.21.15.47:0/1331427407 shutdown_connections 2024-05-27T10:53:11.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.554+0000 7f80ff200640 1 -- 172.21.15.47:0/1331427407 wait complete. 2024-05-27T10:53:11.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.555+0000 7f80ff200640 1 Processor -- start 2024-05-27T10:53:11.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.556+0000 7f80ff200640 1 -- start start 2024-05-27T10:53:11.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.556+0000 7f80ff200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81000d0f60 0x7f8100144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:11.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.556+0000 7f80ff200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f81000d3060 0x7f8100144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:11.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.556+0000 7f80ff200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f810015e8d0 0x7f8100145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:11.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.556+0000 7f80ff200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f81000d2bd0 con 0x7f810015e8d0 2024-05-27T10:53:11.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.556+0000 7f80ff200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f81000cffe0 con 0x7f81000d0f60 2024-05-27T10:53:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.556+0000 7f80ff200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f81000d2860 con 0x7f81000d3060 2024-05-27T10:53:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.557+0000 7f80fe800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f810015e8d0 0x7f8100145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.557+0000 7f80fe800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f810015e8d0 0x7f8100145080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51968/0 (socket says 172.21.15.47:51968) 2024-05-27T10:53:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.557+0000 7f80fe800640 1 -- 172.21.15.47:0/2720986618 learned_addr learned my addr 172.21.15.47:0/2720986618 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.557+0000 7f80fd400640 1 --2- 172.21.15.47:0/2720986618 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f81000d3060 0x7f8100144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.557+0000 7f80fde00640 1 --2- 172.21.15.47:0/2720986618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81000d0f60 0x7f8100144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.557+0000 7f80fe800640 1 -- 172.21.15.47:0/2720986618 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f81000d3060 msgr2=0x7f8100144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.557+0000 7f80fe800640 1 --2- 172.21.15.47:0/2720986618 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f81000d3060 0x7f8100144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.557+0000 7f80fe800640 1 -- 172.21.15.47:0/2720986618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81000d0f60 msgr2=0x7f8100144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.557+0000 7f80fe800640 1 --2- 172.21.15.47:0/2720986618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81000d0f60 0x7f8100144600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.557+0000 7f80fe800640 1 -- 172.21.15.47:0/2720986618 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81001f4840 con 0x7f810015e8d0 2024-05-27T10:53:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.558+0000 7f80fe800640 1 --2- 172.21.15.47:0/2720986618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f810015e8d0 0x7f8100145080 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f80f800c7f0 tx=0x7f80f800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:11.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.558+0000 7f80f6000640 1 -- 172.21.15.47:0/2720986618 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f8015070 con 0x7f810015e8d0 2024-05-27T10:53:11.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.558+0000 7f80f6000640 1 -- 172.21.15.47:0/2720986618 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f8007820 con 0x7f810015e8d0 2024-05-27T10:53:11.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.558+0000 7f80f6000640 1 -- 172.21.15.47:0/2720986618 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f8007c50 con 0x7f810015e8d0 2024-05-27T10:53:11.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.558+0000 7f80ff200640 1 -- 172.21.15.47:0/2720986618 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8100161d00 con 0x7f810015e8d0 2024-05-27T10:53:11.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.558+0000 7f80ff200640 1 -- 172.21.15.47:0/2720986618 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f810015f0e0 con 0x7f810015e8d0 2024-05-27T10:53:11.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.560+0000 7f80ff200640 1 -- 172.21.15.47:0/2720986618 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81000690f0 con 0x7f810015e8d0 2024-05-27T10:53:11.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.561+0000 7f80f6000640 1 -- 172.21.15.47:0/2720986618 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f80f8018070 con 0x7f810015e8d0 2024-05-27T10:53:11.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.562+0000 7f80f6000640 1 --2- 172.21.15.47:0/2720986618 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f80dc06c8f0 0x7f80dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:11.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.562+0000 7f80f6000640 1 -- 172.21.15.47:0/2720986618 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5911+0+0 (secure 0 0 0) 0x7f80f808bd90 con 0x7f810015e8d0 2024-05-27T10:53:11.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.562+0000 7f80fde00640 1 --2- 172.21.15.47:0/2720986618 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f80dc06c8f0 0x7f80dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:11.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.563+0000 7f80fde00640 1 --2- 172.21.15.47:0/2720986618 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f80dc06c8f0 0x7f80dc06edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f80f0000f60 tx=0x7f80f0007cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:11.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.566+0000 7f80f6000640 1 -- 172.21.15.47:0/2720986618 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f80f805a0f0 con 0x7f810015e8d0 2024-05-27T10:53:11.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:11.775+0000 7f80ff200640 1 -- 172.21.15.47:0/2720986618 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f810006ca30 con 0x7f810015e8d0 2024-05-27T10:53:12.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.725+0000 7f80f6000640 1 -- 172.21.15.47:0/2720986618 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) ==== 181+0+0 (secure 0 0 0) 0x7f80f80599f0 con 0x7f810015e8d0 2024-05-27T10:53:12.723 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' removed 2024-05-27T10:53:12.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.729+0000 7f80ff200640 1 -- 172.21.15.47:0/2720986618 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f80dc06c8f0 msgr2=0x7f80dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:12.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.729+0000 7f80ff200640 1 --2- 172.21.15.47:0/2720986618 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f80dc06c8f0 0x7f80dc06edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f80f0000f60 tx=0x7f80f0007cc0 comp rx=0 tx=0).stop 2024-05-27T10:53:12.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.729+0000 7f80ff200640 1 -- 172.21.15.47:0/2720986618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f810015e8d0 msgr2=0x7f8100145080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:12.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.729+0000 7f80ff200640 1 --2- 172.21.15.47:0/2720986618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f810015e8d0 0x7f8100145080 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f80f800c7f0 tx=0x7f80f800ccb0 comp rx=0 tx=0).stop 2024-05-27T10:53:12.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.729+0000 7f80ff200640 1 -- 172.21.15.47:0/2720986618 shutdown_connections 2024-05-27T10:53:12.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.729+0000 7f80ff200640 1 --2- 172.21.15.47:0/2720986618 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f80dc06c8f0 0x7f80dc06edb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:12.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.729+0000 7f80ff200640 1 --2- 172.21.15.47:0/2720986618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f810015e8d0 0x7f8100145080 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:12.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.729+0000 7f80ff200640 1 --2- 172.21.15.47:0/2720986618 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f81000d3060 0x7f8100144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:12.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.729+0000 7f80ff200640 1 --2- 172.21.15.47:0/2720986618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81000d0f60 0x7f8100144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:12.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.729+0000 7f80ff200640 1 -- 172.21.15.47:0/2720986618 >> 172.21.15.47:0/2720986618 conn(0x7f810008bfd0 msgr2=0x7f81000b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:12.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.730+0000 7f80ff200640 1 -- 172.21.15.47:0/2720986618 shutdown_connections 2024-05-27T10:53:12.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.732+0000 7f80ff200640 1 -- 172.21.15.47:0/2720986618 wait complete. 2024-05-27T10:53:12.755 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-27T10:53:12.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.965+0000 7efe3f000640 1 Processor -- start 2024-05-27T10:53:12.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.965+0000 7efe3f000640 1 -- start start 2024-05-27T10:53:12.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.967+0000 7efe3f000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efe38163920 0x7efe380b3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:12.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.967+0000 7efe3f000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe380b36a0 0x7efe380ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:12.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.967+0000 7efe3f000640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe38166750 con 0x7efe380cd330 2024-05-27T10:53:12.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.967+0000 7efe3f000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7efe380b4db0 con 0x7efe38163920 2024-05-27T10:53:12.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.967+0000 7efe3f000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7efe380cd780 con 0x7efe380b36a0 2024-05-27T10:53:12.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.967+0000 7efe3dc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efe38163920 0x7efe380b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:12.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.968+0000 7efe3dc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efe38163920 0x7efe380b3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51972/0 (socket says 172.21.15.47:51972) 2024-05-27T10:53:12.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.968+0000 7efe3dc00640 1 -- 172.21.15.47:0/873755829 learned_addr learned my addr 172.21.15.47:0/873755829 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:12.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.968+0000 7efe3d200640 1 --2- 172.21.15.47:0/873755829 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe380b36a0 0x7efe380ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:12.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.968+0000 7efe3dc00640 1 -- 172.21.15.47:0/873755829 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe380b36a0 msgr2=0x7efe380ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:12.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.968+0000 7efe3dc00640 1 --2- 172.21.15.47:0/873755829 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe380b36a0 0x7efe380ccdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:12.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.968+0000 7efe3dc00640 1 -- 172.21.15.47:0/873755829 >> v1:172.21.15.53:6789/0 conn(0x7efe380cd330 legacy=0x7efe3806eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:12.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.968+0000 7efe3dc00640 1 -- 172.21.15.47:0/873755829 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe38166a30 con 0x7efe38163920 2024-05-27T10:53:12.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.969+0000 7efe3dc00640 1 --2- 172.21.15.47:0/873755829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe38163920 0x7efe380b3160 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009870 tx=0x7efe2c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1849ef6edae55da7 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:12.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.970+0000 7efe37e00640 1 -- 172.21.15.47:0/873755829 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c037070 con 0x7efe38163920 2024-05-27T10:53:12.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.970+0000 7efe37e00640 1 -- 172.21.15.47:0/873755829 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe2c032440 con 0x7efe38163920 2024-05-27T10:53:12.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.970+0000 7efe37e00640 1 -- 172.21.15.47:0/873755829 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c032810 con 0x7efe38163920 2024-05-27T10:53:12.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.970+0000 7efe3f000640 1 -- 172.21.15.47:0/873755829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe38163920 msgr2=0x7efe380b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:12.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.970+0000 7efe3f000640 1 --2- 172.21.15.47:0/873755829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe38163920 0x7efe380b3160 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009870 tx=0x7efe2c02a210 comp rx=0 tx=0).stop 2024-05-27T10:53:12.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.970+0000 7efe3f000640 1 -- 172.21.15.47:0/873755829 shutdown_connections 2024-05-27T10:53:12.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.970+0000 7efe3f000640 1 --2- 172.21.15.47:0/873755829 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe380b36a0 0x7efe380ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:12.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.970+0000 7efe3f000640 1 --2- 172.21.15.47:0/873755829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe38163920 0x7efe380b3160 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:12.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.970+0000 7efe3f000640 1 -- 172.21.15.47:0/873755829 >> 172.21.15.47:0/873755829 conn(0x7efe3806bb20 msgr2=0x7efe3806bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:12.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.970+0000 7efe3f000640 1 -- 172.21.15.47:0/873755829 shutdown_connections 2024-05-27T10:53:12.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.971+0000 7efe3f000640 1 -- 172.21.15.47:0/873755829 wait complete. 2024-05-27T10:53:12.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.972+0000 7efe3f000640 1 Processor -- start 2024-05-27T10:53:12.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.972+0000 7efe3f000640 1 -- start start 2024-05-27T10:53:12.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.973+0000 7efe3f000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe380b36a0 0x7efe3809a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:12.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.973+0000 7efe3f000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe380cd330 0x7efe3809d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:12.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.973+0000 7efe3f000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe38163920 0x7efe38155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:12.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.974+0000 7efe3f000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efe38166ff0 con 0x7efe380cd330 2024-05-27T10:53:12.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.974+0000 7efe3f000640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efe38166500 con 0x7efe380b36a0 2024-05-27T10:53:12.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.974+0000 7efe3f000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7efe381672d0 con 0x7efe38163920 2024-05-27T10:53:12.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.974+0000 7efe3d200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe380cd330 0x7efe3809d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:12.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.974+0000 7efe3d200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe380cd330 0x7efe3809d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51980/0 (socket says 172.21.15.47:51980) 2024-05-27T10:53:12.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.974+0000 7efe3d200640 1 -- 172.21.15.47:0/4108794957 learned_addr learned my addr 172.21.15.47:0/4108794957 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:12.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.974+0000 7efe3dc00640 1 --2- 172.21.15.47:0/4108794957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe380b36a0 0x7efe3809a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:12.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.974+0000 7efe3e600640 1 --2- 172.21.15.47:0/4108794957 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe38163920 0x7efe38155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:12.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.974+0000 7efe3d200640 1 -- 172.21.15.47:0/4108794957 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe38163920 msgr2=0x7efe38155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:12.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.974+0000 7efe3d200640 1 --2- 172.21.15.47:0/4108794957 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe38163920 0x7efe38155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:12.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.974+0000 7efe3d200640 1 -- 172.21.15.47:0/4108794957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe380b36a0 msgr2=0x7efe3809a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:12.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.974+0000 7efe3d200640 1 --2- 172.21.15.47:0/4108794957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe380b36a0 0x7efe3809a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:12.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.974+0000 7efe3d200640 1 -- 172.21.15.47:0/4108794957 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe38162b20 con 0x7efe380cd330 2024-05-27T10:53:12.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.974+0000 7efe3e600640 1 --2- 172.21.15.47:0/4108794957 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe38163920 0x7efe38155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:12.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.974+0000 7efe3dc00640 1 --2- 172.21.15.47:0/4108794957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe380b36a0 0x7efe3809a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:53:12.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.975+0000 7efe3d200640 1 --2- 172.21.15.47:0/4108794957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe380cd330 0x7efe3809d080 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efe2400d830 tx=0x7efe2400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:12.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.975+0000 7efe35600640 1 -- 172.21.15.47:0/4108794957 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2400b6c0 con 0x7efe380cd330 2024-05-27T10:53:12.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.975+0000 7efe35600640 1 -- 172.21.15.47:0/4108794957 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe24019070 con 0x7efe380cd330 2024-05-27T10:53:12.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.975+0000 7efe35600640 1 -- 172.21.15.47:0/4108794957 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2400ba80 con 0x7efe380cd330 2024-05-27T10:53:12.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.975+0000 7efe3f000640 1 -- 172.21.15.47:0/4108794957 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe38155a70 con 0x7efe380cd330 2024-05-27T10:53:12.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.975+0000 7efe3f000640 1 -- 172.21.15.47:0/4108794957 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe3809da20 con 0x7efe380cd330 2024-05-27T10:53:12.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.976+0000 7efe3f000640 1 -- 172.21.15.47:0/4108794957 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe380689e0 con 0x7efe380cd330 2024-05-27T10:53:12.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.977+0000 7efe35600640 1 -- 172.21.15.47:0/4108794957 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efe2401e460 con 0x7efe380cd330 2024-05-27T10:53:12.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.978+0000 7efe35600640 1 --2- 172.21.15.47:0/4108794957 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7efe1806c8f0 0x7efe1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:12.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.978+0000 7efe35600640 1 -- 172.21.15.47:0/4108794957 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5473+0+0 (secure 0 0 0) 0x7efe2408c0f0 con 0x7efe380cd330 2024-05-27T10:53:12.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.979+0000 7efe3dc00640 1 --2- 172.21.15.47:0/4108794957 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7efe1806c8f0 0x7efe1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:12.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.979+0000 7efe3dc00640 1 --2- 172.21.15.47:0/4108794957 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7efe1806c8f0 0x7efe1806edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efe2c034000 tx=0x7efe2c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:12.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:12.984+0000 7efe35600640 1 -- 172.21.15.47:0/4108794957 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efe38162b20 con 0x7efe380cd330 2024-05-27T10:53:13.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:13.191+0000 7efe3f000640 1 -- 172.21.15.47:0/4108794957 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7efe3806e3c0 con 0x7efe380cd330 2024-05-27T10:53:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:13.736+0000 7efe35600640 1 -- 172.21.15.47:0/4108794957 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) ==== 169+0+0 (secure 0 0 0) 0x7efe2405a5f0 con 0x7efe380cd330 2024-05-27T10:53:13.735 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' removed 2024-05-27T10:53:13.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:13.740+0000 7efe3f000640 1 -- 172.21.15.47:0/4108794957 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7efe1806c8f0 msgr2=0x7efe1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:13.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:13.740+0000 7efe3f000640 1 --2- 172.21.15.47:0/4108794957 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7efe1806c8f0 0x7efe1806edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efe2c034000 tx=0x7efe2c02e000 comp rx=0 tx=0).stop 2024-05-27T10:53:13.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:13.740+0000 7efe3f000640 1 -- 172.21.15.47:0/4108794957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe380cd330 msgr2=0x7efe3809d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:13.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:13.740+0000 7efe3f000640 1 --2- 172.21.15.47:0/4108794957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe380cd330 0x7efe3809d080 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efe2400d830 tx=0x7efe2400dcf0 comp rx=0 tx=0).stop 2024-05-27T10:53:13.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:13.740+0000 7efe3f000640 1 -- 172.21.15.47:0/4108794957 shutdown_connections 2024-05-27T10:53:13.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:13.740+0000 7efe3f000640 1 --2- 172.21.15.47:0/4108794957 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7efe1806c8f0 0x7efe1806edb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:13.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:13.740+0000 7efe3f000640 1 --2- 172.21.15.47:0/4108794957 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe38163920 0x7efe38155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:13.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:13.740+0000 7efe3f000640 1 --2- 172.21.15.47:0/4108794957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe380cd330 0x7efe3809d080 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:13.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:13.740+0000 7efe3f000640 1 --2- 172.21.15.47:0/4108794957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe380b36a0 0x7efe3809a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:13.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:13.740+0000 7efe3f000640 1 -- 172.21.15.47:0/4108794957 >> 172.21.15.47:0/4108794957 conn(0x7efe3806bb20 msgr2=0x7efe38163d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:13.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:13.741+0000 7efe3f000640 1 -- 172.21.15.47:0/4108794957 shutdown_connections 2024-05-27T10:53:13.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:13.742+0000 7efe3f000640 1 -- 172.21.15.47:0/4108794957 wait complete. 2024-05-27T10:53:13.769 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-27T10:53:13.769 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-27T10:53:13.770 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-27T10:53:13.770 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T10:53:13.770 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-27T10:53:13.770 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-27T10:53:13.770 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-27T10:53:13.770 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T10:53:13.771 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-27T10:53:13.771 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-27T10:53:13.771 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-27T10:53:13.771 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T10:53:13.771 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-27T10:53:13.771 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-27T10:53:13.771 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-27T10:53:13.771 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T10:53:13.792 INFO:tasks.ceph.mds.a:Stopped 2024-05-27T10:53:13.792 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-27T10:53:13.793 INFO:tasks.ceph.mds.c:Stopped 2024-05-27T10:53:13.793 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-27T10:53:13.795 INFO:tasks.ceph.mds.b:Stopped 2024-05-27T10:53:13.795 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-27T10:53:13.796 INFO:tasks.ceph.mds.d:Stopped 2024-05-27T10:53:13.796 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-27T10:53:13.839 INFO:tasks.ceph.mds.a:Started 2024-05-27T10:53:13.840 DEBUG:teuthology.parallel:result is None 2024-05-27T10:53:13.843 INFO:tasks.ceph.mds.b:Started 2024-05-27T10:53:13.843 DEBUG:teuthology.parallel:result is None 2024-05-27T10:53:13.846 INFO:tasks.ceph.mds.c:Started 2024-05-27T10:53:13.846 DEBUG:teuthology.parallel:result is None 2024-05-27T10:53:13.849 INFO:tasks.ceph.mds.d:Started 2024-05-27T10:53:13.849 DEBUG:teuthology.parallel:result is None 2024-05-27T10:53:13.850 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-27T10:53:14.002 INFO:tasks.ceph.mds.a.smithi047.stdout:starting mds.a at 2024-05-27T10:53:14.004 INFO:tasks.ceph.mds.c.smithi047.stdout:starting mds.c at 2024-05-27T10:53:14.009 INFO:tasks.ceph.mds.b.smithi053.stdout:starting mds.b at 2024-05-27T10:53:14.013 INFO:tasks.ceph.mds.d.smithi053.stdout:starting mds.d at 2024-05-27T10:53:14.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.045+0000 7f7c33400640 1 Processor -- start 2024-05-27T10:53:14.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.045+0000 7f7c33400640 1 -- start start 2024-05-27T10:53:14.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.047+0000 7f7c33400640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7c2c15a1c0 0x7f7c2c0cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:14.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.047+0000 7f7c33400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c2c15d2f0 0x7f7c2c072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:14.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.047+0000 7f7c33400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c2c15a5a0 con 0x7f7c2c071d10 2024-05-27T10:53:14.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.047+0000 7f7c33400640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f7c2c0726c0 con 0x7f7c2c15a1c0 2024-05-27T10:53:14.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.047+0000 7f7c33400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f7c2c06f2f0 con 0x7f7c2c15d2f0 2024-05-27T10:53:14.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.047+0000 7f7c23e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f7c2c071d10 0x7f7c2c15cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35260/0 (socket says 172.21.15.47:35260) 2024-05-27T10:53:14.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.047+0000 7f7c23e00640 1 -- 172.21.15.47:0/4120877607 learned_addr learned my addr 172.21.15.47:0/4120877607 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:14.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.047+0000 7f7c30a00640 1 --2- 172.21.15.47:0/4120877607 >> v2:172.21.15.53:3300/0 conn(0x7f7c2c15a1c0 0x7f7c2c0cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:14.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.047+0000 7f7c31400640 1 --2- 172.21.15.47:0/4120877607 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c2c15d2f0 0x7f7c2c072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:14.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.048+0000 7f7c30a00640 1 -- 172.21.15.47:0/4120877607 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c2c15d2f0 msgr2=0x7f7c2c072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:14.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.048+0000 7f7c30a00640 1 --2- 172.21.15.47:0/4120877607 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c2c15d2f0 0x7f7c2c072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:14.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.048+0000 7f7c30a00640 1 -- 172.21.15.47:0/4120877607 >> v1:172.21.15.47:6789/0 conn(0x7f7c2c071d10 legacy=0x7f7c2c15cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:14.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.048+0000 7f7c2be00640 1 -- 172.21.15.47:0/4120877607 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3174479976 0 0) 0x7f7c2c15a5a0 con 0x7f7c2c071d10 2024-05-27T10:53:14.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.048+0000 7f7c30a00640 1 -- 172.21.15.47:0/4120877607 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2c15daa0 con 0x7f7c2c15a1c0 2024-05-27T10:53:14.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.049+0000 7f7c30a00640 1 --2- 172.21.15.47:0/4120877607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c15a1c0 0x7f7c2c0cda00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0097a0 tx=0x7f7c1c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a72b56f980181a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:14.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.049+0000 7f7c2be00640 1 -- 172.21.15.47:0/4120877607 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c037070 con 0x7f7c2c15a1c0 2024-05-27T10:53:14.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.049+0000 7f7c2be00640 1 -- 172.21.15.47:0/4120877607 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c1c032440 con 0x7f7c2c15a1c0 2024-05-27T10:53:14.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.049+0000 7f7c2be00640 1 -- 172.21.15.47:0/4120877607 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c032810 con 0x7f7c2c15a1c0 2024-05-27T10:53:14.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.050+0000 7f7c33400640 1 -- 172.21.15.47:0/4120877607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c15a1c0 msgr2=0x7f7c2c0cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:14.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.050+0000 7f7c33400640 1 --2- 172.21.15.47:0/4120877607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c15a1c0 0x7f7c2c0cda00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0097a0 tx=0x7f7c1c02a180 comp rx=0 tx=0).stop 2024-05-27T10:53:14.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.050+0000 7f7c33400640 1 -- 172.21.15.47:0/4120877607 shutdown_connections 2024-05-27T10:53:14.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.050+0000 7f7c33400640 1 --2- 172.21.15.47:0/4120877607 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c2c15d2f0 0x7f7c2c072180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:14.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.050+0000 7f7c33400640 1 --2- 172.21.15.47:0/4120877607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c15a1c0 0x7f7c2c0cda00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:14.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.050+0000 7f7c33400640 1 -- 172.21.15.47:0/4120877607 >> 172.21.15.47:0/4120877607 conn(0x7f7c2c06b940 msgr2=0x7f7c2c06bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:14.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.050+0000 7f7c33400640 1 -- 172.21.15.47:0/4120877607 shutdown_connections 2024-05-27T10:53:14.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.050+0000 7f7c33400640 1 -- 172.21.15.47:0/4120877607 wait complete. 2024-05-27T10:53:14.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.051+0000 7f7c33400640 1 Processor -- start 2024-05-27T10:53:14.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.052+0000 7f7c33400640 1 -- start start 2024-05-27T10:53:14.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.053+0000 7f7c33400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c2c071d10 0x7f7c2c153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:14.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.053+0000 7f7c33400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c2c15a1c0 0x7f7c2c0b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:14.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.053+0000 7f7c33400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c15d2f0 0x7f7c2c0ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:14.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.053+0000 7f7c33400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c0cd200 con 0x7f7c2c15a1c0 2024-05-27T10:53:14.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.053+0000 7f7c33400640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c0ccf20 con 0x7f7c2c15d2f0 2024-05-27T10:53:14.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.053+0000 7f7c33400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f7c2c0cd4e0 con 0x7f7c2c071d10 2024-05-27T10:53:14.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.053+0000 7f7c23e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c2c15a1c0 0x7f7c2c0b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:14.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.053+0000 7f7c23e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c2c15a1c0 0x7f7c2c0b17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52024/0 (socket says 172.21.15.47:52024) 2024-05-27T10:53:14.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.053+0000 7f7c23e00640 1 -- 172.21.15.47:0/4120355271 learned_addr learned my addr 172.21.15.47:0/4120355271 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:14.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.053+0000 7f7c30a00640 1 --2- 172.21.15.47:0/4120355271 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c2c071d10 0x7f7c2c153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:14.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.053+0000 7f7c31400640 1 --2- 172.21.15.47:0/4120355271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c15d2f0 0x7f7c2c0ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:14.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.053+0000 7f7c23e00640 1 -- 172.21.15.47:0/4120355271 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c2c071d10 msgr2=0x7f7c2c153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:14.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.053+0000 7f7c23e00640 1 --2- 172.21.15.47:0/4120355271 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c2c071d10 0x7f7c2c153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:14.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.054+0000 7f7c23e00640 1 -- 172.21.15.47:0/4120355271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c15d2f0 msgr2=0x7f7c2c0ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:14.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.054+0000 7f7c23e00640 1 --2- 172.21.15.47:0/4120355271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c15d2f0 0x7f7c2c0ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:14.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.054+0000 7f7c23e00640 1 -- 172.21.15.47:0/4120355271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2c0b2510 con 0x7f7c2c15a1c0 2024-05-27T10:53:14.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.054+0000 7f7c23e00640 1 --2- 172.21.15.47:0/4120355271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c2c15a1c0 0x7f7c2c0b17a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400c490 tx=0x7f7c1400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:14.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.054+0000 7f7c29600640 1 -- 172.21.15.47:0/4120355271 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c14005ce0 con 0x7f7c2c15a1c0 2024-05-27T10:53:14.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.054+0000 7f7c29600640 1 -- 172.21.15.47:0/4120355271 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c14007070 con 0x7f7c2c15a1c0 2024-05-27T10:53:14.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.054+0000 7f7c29600640 1 -- 172.21.15.47:0/4120355271 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c14007460 con 0x7f7c2c15a1c0 2024-05-27T10:53:14.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.054+0000 7f7c33400640 1 -- 172.21.15.47:0/4120355271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c2c0b27f0 con 0x7f7c2c15a1c0 2024-05-27T10:53:14.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.054+0000 7f7c33400640 1 -- 172.21.15.47:0/4120355271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c2c0b2db0 con 0x7f7c2c15a1c0 2024-05-27T10:53:14.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.055+0000 7f7c33400640 1 -- 172.21.15.47:0/4120355271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c2c0737e0 con 0x7f7c2c15a1c0 2024-05-27T10:53:14.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.057+0000 7f7c29600640 1 -- 172.21.15.47:0/4120355271 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7c14007600 con 0x7f7c2c15a1c0 2024-05-27T10:53:14.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.058+0000 7f7c29600640 1 --2- 172.21.15.47:0/4120355271 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7c0806c8f0 0x7f7c0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:14.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.058+0000 7f7c29600640 1 -- 172.21.15.47:0/4120355271 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4943+0+0 (secure 0 0 0) 0x7f7c1408b2e0 con 0x7f7c2c15a1c0 2024-05-27T10:53:14.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.058+0000 7f7c30a00640 1 --2- 172.21.15.47:0/4120355271 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7c0806c8f0 0x7f7c0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:14.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.059+0000 7f7c30a00640 1 --2- 172.21.15.47:0/4120355271 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7c0806c8f0 0x7f7c0806edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c034000 tx=0x7f7c1c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:14.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.063+0000 7f7c29600640 1 -- 172.21.15.47:0/4120355271 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7c14059450 con 0x7f7c2c15a1c0 2024-05-27T10:53:14.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.283+0000 7f7c33400640 1 -- 172.21.15.47:0/4120355271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7c2c04fdc0 con 0x7f7c2c15a1c0 2024-05-27T10:53:14.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.759+0000 7f7c29600640 1 -- 172.21.15.47:0/4120355271 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) ==== 97+0+0 (secure 0 0 0) 0x7f7c1405d750 con 0x7f7c2c15a1c0 2024-05-27T10:53:14.757 INFO:teuthology.orchestra.run.smithi047.stderr: removed all blocklist entries 2024-05-27T10:53:14.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.762+0000 7f7c33400640 1 -- 172.21.15.47:0/4120355271 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7c0806c8f0 msgr2=0x7f7c0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:14.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.762+0000 7f7c33400640 1 --2- 172.21.15.47:0/4120355271 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7c0806c8f0 0x7f7c0806edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c034000 tx=0x7f7c1c02e000 comp rx=0 tx=0).stop 2024-05-27T10:53:14.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.762+0000 7f7c33400640 1 -- 172.21.15.47:0/4120355271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c2c15a1c0 msgr2=0x7f7c2c0b17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:14.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.762+0000 7f7c33400640 1 --2- 172.21.15.47:0/4120355271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c2c15a1c0 0x7f7c2c0b17a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400c490 tx=0x7f7c1400c950 comp rx=0 tx=0).stop 2024-05-27T10:53:14.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.763+0000 7f7c33400640 1 -- 172.21.15.47:0/4120355271 shutdown_connections 2024-05-27T10:53:14.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.763+0000 7f7c33400640 1 --2- 172.21.15.47:0/4120355271 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7c0806c8f0 0x7f7c0806edb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:14.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.763+0000 7f7c33400640 1 --2- 172.21.15.47:0/4120355271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c15d2f0 0x7f7c2c0ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:14.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.763+0000 7f7c33400640 1 --2- 172.21.15.47:0/4120355271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c2c15a1c0 0x7f7c2c0b17a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:14.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.763+0000 7f7c33400640 1 --2- 172.21.15.47:0/4120355271 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c2c071d10 0x7f7c2c153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:14.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.763+0000 7f7c33400640 1 -- 172.21.15.47:0/4120355271 >> 172.21.15.47:0/4120355271 conn(0x7f7c2c06b940 msgr2=0x7f7c2c0af4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:14.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.763+0000 7f7c33400640 1 -- 172.21.15.47:0/4120355271 shutdown_connections 2024-05-27T10:53:14.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.763+0000 7f7c33400640 1 -- 172.21.15.47:0/4120355271 wait complete. 2024-05-27T10:53:14.784 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-27T10:53:14.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.996+0000 7fa854600640 1 Processor -- start 2024-05-27T10:53:14.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.996+0000 7fa854600640 1 -- start start 2024-05-27T10:53:14.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.998+0000 7fa854600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa84c15c840 0x7fa84c0d0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:14.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.998+0000 7fa854600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa84c160140 con 0x7fa84c15c460 2024-05-27T10:53:14.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.998+0000 7fa854600640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa84c160420 con 0x7fa84c0d0c40 2024-05-27T10:53:14.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.998+0000 7fa854600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa84c160700 con 0x7fa84c15c840 2024-05-27T10:53:14.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.998+0000 7fa851200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa84c15c840 0x7fa84c0d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:14.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.998+0000 7fa851c00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa84c15c460 0x7fa84c0ad300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35276/0 (socket says 172.21.15.47:35276) 2024-05-27T10:53:14.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.998+0000 7fa851200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa84c15c840 0x7fa84c0d0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52028/0 (socket says 172.21.15.47:52028) 2024-05-27T10:53:14.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.998+0000 7fa851c00640 1 -- 172.21.15.47:0/2521834725 learned_addr learned my addr 172.21.15.47:0/2521834725 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:14.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.999+0000 7fa851200640 1 -- 172.21.15.47:0/2521834725 >> v1:172.21.15.53:6789/0 conn(0x7fa84c0d0c40 legacy=0x7fa84c06def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:14.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.999+0000 7fa851200640 1 -- 172.21.15.47:0/2521834725 >> v1:172.21.15.47:6789/0 conn(0x7fa84c15c460 legacy=0x7fa84c0ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:14.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:14.999+0000 7fa851200640 1 -- 172.21.15.47:0/2521834725 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84c1609e0 con 0x7fa84c15c840 2024-05-27T10:53:14.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.000+0000 7fa851200640 1 --2- 172.21.15.47:0/2521834725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa84c15c840 0x7fa84c0d0700 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa8380097a0 tx=0x7fa83802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a696d250d53ab4d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:14.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.000+0000 7fa84be00640 1 -- 172.21.15.47:0/2521834725 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838037070 con 0x7fa84c15c840 2024-05-27T10:53:14.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.000+0000 7fa84be00640 1 -- 172.21.15.47:0/2521834725 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa838032440 con 0x7fa84c15c840 2024-05-27T10:53:14.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.000+0000 7fa84be00640 1 -- 172.21.15.47:0/2521834725 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838032810 con 0x7fa84c15c840 2024-05-27T10:53:14.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.001+0000 7fa854600640 1 -- 172.21.15.47:0/2521834725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa84c15c840 msgr2=0x7fa84c0d0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:14.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.001+0000 7fa854600640 1 --2- 172.21.15.47:0/2521834725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa84c15c840 0x7fa84c0d0700 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa8380097a0 tx=0x7fa83802a1e0 comp rx=0 tx=0).stop 2024-05-27T10:53:14.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.001+0000 7fa854600640 1 -- 172.21.15.47:0/2521834725 shutdown_connections 2024-05-27T10:53:14.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.001+0000 7fa854600640 1 --2- 172.21.15.47:0/2521834725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa84c15c840 0x7fa84c0d0700 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:14.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.001+0000 7fa854600640 1 -- 172.21.15.47:0/2521834725 >> 172.21.15.47:0/2521834725 conn(0x7fa84c06bd60 msgr2=0x7fa84c06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:14.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.001+0000 7fa854600640 1 -- 172.21.15.47:0/2521834725 shutdown_connections 2024-05-27T10:53:14.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.001+0000 7fa854600640 1 -- 172.21.15.47:0/2521834725 wait complete. 2024-05-27T10:53:15.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.003+0000 7fa854600640 1 Processor -- start 2024-05-27T10:53:15.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.004+0000 7fa854600640 1 -- start start 2024-05-27T10:53:15.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.004+0000 7fa854600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa84c0d0c40 0x7fa84c1f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:15.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.005+0000 7fa854600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84c15c460 0x7fa84c15cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:15.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.005+0000 7fa854600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa84c15c840 0x7fa84c15d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.005+0000 7fa854600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c0ada10 con 0x7fa84c15c840 2024-05-27T10:53:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.005+0000 7fa854600640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c160fa0 con 0x7fa84c15c460 2024-05-27T10:53:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.005+0000 7fa854600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fa84c0adb90 con 0x7fa84c0d0c40 2024-05-27T10:53:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.005+0000 7fa852600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa84c15c840 0x7fa84c15d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.005+0000 7fa852600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa84c15c840 0x7fa84c15d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52040/0 (socket says 172.21.15.47:52040) 2024-05-27T10:53:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.005+0000 7fa852600640 1 -- 172.21.15.47:0/2899521248 learned_addr learned my addr 172.21.15.47:0/2899521248 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.005+0000 7fa851200640 1 --2- 172.21.15.47:0/2899521248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84c15c460 0x7fa84c15cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.005+0000 7fa851c00640 1 --2- 172.21.15.47:0/2899521248 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa84c0d0c40 0x7fa84c1f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.005+0000 7fa852600640 1 -- 172.21.15.47:0/2899521248 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa84c0d0c40 msgr2=0x7fa84c1f49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.005+0000 7fa852600640 1 --2- 172.21.15.47:0/2899521248 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa84c0d0c40 0x7fa84c1f49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.005+0000 7fa852600640 1 -- 172.21.15.47:0/2899521248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84c15c460 msgr2=0x7fa84c15cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.005+0000 7fa852600640 1 --2- 172.21.15.47:0/2899521248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84c15c460 0x7fa84c15cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.005+0000 7fa852600640 1 -- 172.21.15.47:0/2899521248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84c072b10 con 0x7fa84c15c840 2024-05-27T10:53:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.006+0000 7fa852600640 1 --2- 172.21.15.47:0/2899521248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa84c15c840 0x7fa84c15d290 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa84400c780 tx=0x7fa84400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:15.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.006+0000 7fa849600640 1 -- 172.21.15.47:0/2899521248 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa844004b60 con 0x7fa84c15c840 2024-05-27T10:53:15.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.006+0000 7fa849600640 1 -- 172.21.15.47:0/2899521248 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa844004d00 con 0x7fa84c15c840 2024-05-27T10:53:15.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.006+0000 7fa849600640 1 -- 172.21.15.47:0/2899521248 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84400aa90 con 0x7fa84c15c840 2024-05-27T10:53:15.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.006+0000 7fa854600640 1 -- 172.21.15.47:0/2899521248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa84c072df0 con 0x7fa84c15c840 2024-05-27T10:53:15.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.006+0000 7fa854600640 1 -- 172.21.15.47:0/2899521248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa84c0733b0 con 0x7fa84c15c840 2024-05-27T10:53:15.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.007+0000 7fa854600640 1 -- 172.21.15.47:0/2899521248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa84c0689e0 con 0x7fa84c15c840 2024-05-27T10:53:15.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.008+0000 7fa849600640 1 -- 172.21.15.47:0/2899521248 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa84400ac30 con 0x7fa84c15c840 2024-05-27T10:53:15.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.009+0000 7fa849600640 1 --2- 172.21.15.47:0/2899521248 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa82c06c920 0x7fa82c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:15.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.010+0000 7fa849600640 1 -- 172.21.15.47:0/2899521248 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fa84408bb20 con 0x7fa84c15c840 2024-05-27T10:53:15.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.010+0000 7fa851c00640 1 --2- 172.21.15.47:0/2899521248 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa82c06c920 0x7fa82c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:15.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.010+0000 7fa851c00640 1 --2- 172.21.15.47:0/2899521248 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa82c06c920 0x7fa82c06ede0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa840000f60 tx=0x7fa840009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:15.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.014+0000 7fa849600640 1 -- 172.21.15.47:0/2899521248 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa844020070 con 0x7fa84c15c840 2024-05-27T10:53:15.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.296+0000 7fa854600640 1 -- 172.21.15.47:0/2899521248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa84c15a8e0 con 0x7fa84c15c840 2024-05-27T10:53:15.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.297+0000 7fa849600640 1 -- 172.21.15.47:0/2899521248 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v5) ==== 80+0+6645 (secure 0 0 0) 0x7fa84405a200 con 0x7fa84c15c840 2024-05-27T10:53:15.295 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:53:15.296 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-27T10:53:15.296 INFO:teuthology.orchestra.run.smithi047.stdout: "auth_dump": [ 2024-05-27T10:53:15.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.296 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mds.a", 2024-05-27T10:53:15.296 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCYZVRmRmmoNxAAnqRGqe8Rxaxo7Q8DOZyL/A==", 2024-05-27T10:53:15.296 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.296 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-05-27T10:53:15.296 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow *", 2024-05-27T10:53:15.296 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow *", 2024-05-27T10:53:15.296 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-05-27T10:53:15.296 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.297 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mds.b", 2024-05-27T10:53:15.297 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCZZVRmppWrGxAAanXJemXM5rsgpO6D8JUFFQ==", 2024-05-27T10:53:15.297 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.297 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-05-27T10:53:15.297 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow *", 2024-05-27T10:53:15.297 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow *", 2024-05-27T10:53:15.297 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-05-27T10:53:15.297 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.297 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mds.c", 2024-05-27T10:53:15.298 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCZZVRm9TAJDBAAgWfHXoTcy2zciuIRtzHCFw==", 2024-05-27T10:53:15.298 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.298 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-05-27T10:53:15.298 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow *", 2024-05-27T10:53:15.298 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow *", 2024-05-27T10:53:15.298 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-05-27T10:53:15.298 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.299 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mds.d", 2024-05-27T10:53:15.299 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCZZVRmJfsgKhAAqp0oyT4bCZbqcYNq9zqZBA==", 2024-05-27T10:53:15.299 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.299 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-05-27T10:53:15.299 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow *", 2024-05-27T10:53:15.299 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow *", 2024-05-27T10:53:15.299 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-05-27T10:53:15.299 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.299 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.0", 2024-05-27T10:53:15.299 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCcZVRm4NuYAxAAbmP/dIm3zajYYoiQq4xBFw==", 2024-05-27T10:53:15.299 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.300 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-05-27T10:53:15.300 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-05-27T10:53:15.300 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-05-27T10:53:15.300 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.300 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.1", 2024-05-27T10:53:15.300 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCfZVRmazX2HhAAzn/4yh5abte+C8ebrcfUbQ==", 2024-05-27T10:53:15.300 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.301 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-05-27T10:53:15.301 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-05-27T10:53:15.301 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-05-27T10:53:15.301 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.301 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.2", 2024-05-27T10:53:15.301 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCjZVRmZm4MABAA4xyGBD69eJpzDODw73/W9Q==", 2024-05-27T10:53:15.301 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.301 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-05-27T10:53:15.301 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-05-27T10:53:15.301 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-05-27T10:53:15.301 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.302 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.3", 2024-05-27T10:53:15.302 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCmZVRmjBo/DBAAOtRkD5ZbdSpN/2wRsVI/Pw==", 2024-05-27T10:53:15.302 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.302 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-05-27T10:53:15.302 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-05-27T10:53:15.302 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-05-27T10:53:15.302 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.302 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.4", 2024-05-27T10:53:15.302 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCqZVRmeF+1MxAA7tJ52QAExiUyvZaa2tqMGw==", 2024-05-27T10:53:15.303 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.303 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-05-27T10:53:15.303 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-05-27T10:53:15.303 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-05-27T10:53:15.303 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.303 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.5", 2024-05-27T10:53:15.303 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCuZVRm1nOrExAAqRI1SHaPcpG+7HZoHHJzmA==", 2024-05-27T10:53:15.303 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.303 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-05-27T10:53:15.303 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-05-27T10:53:15.303 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-05-27T10:53:15.304 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.304 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.6", 2024-05-27T10:53:15.304 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCxZVRmHOBBHhAAaRyVvwmjCkPhF5LIy3fY5A==", 2024-05-27T10:53:15.304 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.304 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-05-27T10:53:15.304 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-05-27T10:53:15.304 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-05-27T10:53:15.304 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.305 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.7", 2024-05-27T10:53:15.305 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQC0ZVRmpEwvORAAPcWxyiWm3RwP4QsMw8Xf8w==", 2024-05-27T10:53:15.305 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.305 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-05-27T10:53:15.305 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-05-27T10:53:15.305 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-05-27T10:53:15.305 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.305 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.0", 2024-05-27T10:53:15.305 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCZZVRmP5XbNxAAeV5NQPfMMD+N/fXyt5+LnA==", 2024-05-27T10:53:15.305 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.306 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-05-27T10:53:15.306 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow r", 2024-05-27T10:53:15.306 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow rw", 2024-05-27T10:53:15.306 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow rwx" 2024-05-27T10:53:15.306 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.306 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.1", 2024-05-27T10:53:15.306 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCaZVRma+T3DxAAlBm/6sMK0QgrD2s03+yeCA==", 2024-05-27T10:53:15.306 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.306 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-05-27T10:53:15.306 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow r", 2024-05-27T10:53:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow rw", 2024-05-27T10:53:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow rwx" 2024-05-27T10:53:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.2", 2024-05-27T10:53:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCaZVRmra/3BRAAJx7p//5bMn44mA+yPASYGA==", 2024-05-27T10:53:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-05-27T10:53:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow r", 2024-05-27T10:53:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow rw", 2024-05-27T10:53:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow rwx" 2024-05-27T10:53:15.307 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.3", 2024-05-27T10:53:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCaZVRmyM2rGhAA9qvq+Nhb8oWUyfefyzowjQ==", 2024-05-27T10:53:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-05-27T10:53:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow r", 2024-05-27T10:53:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow rw", 2024-05-27T10:53:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow rwx" 2024-05-27T10:53:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.admin", 2024-05-27T10:53:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCXZVRmBcVmMBAA+p9QHYgEFQnJTQNJd3srag==", 2024-05-27T10:53:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow *", 2024-05-27T10:53:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow *", 2024-05-27T10:53:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow *", 2024-05-27T10:53:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-05-27T10:53:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.bootstrap-mds", 2024-05-27T10:53:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQC9ZVRmwYUZMhAAAqK00PGT1UCtLJeuHRUPwA==", 2024-05-27T10:53:15.309 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile bootstrap-mds" 2024-05-27T10:53:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.bootstrap-mgr", 2024-05-27T10:53:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQC9ZVRmcZAZMhAAFlJolcGGzEE7MEzDKlKYlQ==", 2024-05-27T10:53:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-27T10:53:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.bootstrap-osd", 2024-05-27T10:53:15.310 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQC9ZVRmEZkZMhAAo5QC2e/whuZeqHYZbhBHuw==", 2024-05-27T10:53:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile bootstrap-osd" 2024-05-27T10:53:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.bootstrap-rbd", 2024-05-27T10:53:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQC9ZVRmZqEZMhAAyDDdWwlhJ0h6/m9UM6wnyw==", 2024-05-27T10:53:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-27T10:53:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-27T10:53:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQC9ZVRm/KwZMhAArjZGoJoW1Ug6A1ay0eJ03g==", 2024-05-27T10:53:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-27T10:53:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.bootstrap-rgw", 2024-05-27T10:53:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQC9ZVRmxbUZMhAAmX69sitEDnizdldmB4FpKQ==", 2024-05-27T10:53:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-27T10:53:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mgr.x", 2024-05-27T10:53:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCYZVRmS2j2LBAAn0nAIQG7Zv98B+uk2pzspA==", 2024-05-27T10:53:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow *", 2024-05-27T10:53:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile mgr", 2024-05-27T10:53:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-05-27T10:53:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mgr.y", 2024-05-27T10:53:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCYZVRmlXnjIRAACcK2hOezvwAF4s/oVTHfkw==", 2024-05-27T10:53:15.313 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-05-27T10:53:15.314 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow *", 2024-05-27T10:53:15.314 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile mgr", 2024-05-27T10:53:15.314 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-05-27T10:53:15.314 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.314 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:15.314 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-05-27T10:53:15.314 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-27T10:53:15.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.300+0000 7fa854600640 1 -- 172.21.15.47:0/2899521248 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa82c06c920 msgr2=0x7fa82c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:15.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.300+0000 7fa854600640 1 --2- 172.21.15.47:0/2899521248 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa82c06c920 0x7fa82c06ede0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa840000f60 tx=0x7fa840009040 comp rx=0 tx=0).stop 2024-05-27T10:53:15.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.300+0000 7fa854600640 1 -- 172.21.15.47:0/2899521248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa84c15c840 msgr2=0x7fa84c15d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:15.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.300+0000 7fa854600640 1 --2- 172.21.15.47:0/2899521248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa84c15c840 0x7fa84c15d290 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa84400c780 tx=0x7fa84400cc40 comp rx=0 tx=0).stop 2024-05-27T10:53:15.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.301+0000 7fa854600640 1 -- 172.21.15.47:0/2899521248 shutdown_connections 2024-05-27T10:53:15.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.301+0000 7fa854600640 1 --2- 172.21.15.47:0/2899521248 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa82c06c920 0x7fa82c06ede0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:15.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.301+0000 7fa854600640 1 --2- 172.21.15.47:0/2899521248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa84c15c840 0x7fa84c15d290 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:15.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.301+0000 7fa854600640 1 --2- 172.21.15.47:0/2899521248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84c15c460 0x7fa84c15cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:15.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.301+0000 7fa854600640 1 --2- 172.21.15.47:0/2899521248 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa84c0d0c40 0x7fa84c1f49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:15.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.301+0000 7fa854600640 1 -- 172.21.15.47:0/2899521248 >> 172.21.15.47:0/2899521248 conn(0x7fa84c06bd60 msgr2=0x7fa84c0cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:15.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.301+0000 7fa854600640 1 -- 172.21.15.47:0/2899521248 shutdown_connections 2024-05-27T10:53:15.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.301+0000 7fa854600640 1 -- 172.21.15.47:0/2899521248 wait complete. 2024-05-27T10:53:15.318 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-27T10:53:15.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.536+0000 7f71e3200640 1 Processor -- start 2024-05-27T10:53:15.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.537+0000 7f71e3200640 1 -- start start 2024-05-27T10:53:15.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.538+0000 7f71e3200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f71e406d240 0x7f71e406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:15.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.538+0000 7f71e3200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71e40cebc0 con 0x7f71e415eaa0 2024-05-27T10:53:15.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.538+0000 7f71e3200640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71e406db60 con 0x7f71e406ca40 2024-05-27T10:53:15.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.538+0000 7f71e3200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f71e40cf4b0 con 0x7f71e406d240 2024-05-27T10:53:15.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.538+0000 7f71e1400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f71e415eaa0 0x7f71e40cf940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35278/0 (socket says 172.21.15.47:35278) 2024-05-27T10:53:15.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.539+0000 7f71e1400640 1 -- 172.21.15.47:0/2009203425 learned_addr learned my addr 172.21.15.47:0/2009203425 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:15.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.539+0000 7f71e1e00640 1 --2- 172.21.15.47:0/2009203425 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f71e406d240 0x7f71e406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:15.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.539+0000 7f71e0a00640 1 -- 172.21.15.47:0/2009203425 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3006859443 0 0) 0x7f71e40cebc0 con 0x7f71e415eaa0 2024-05-27T10:53:15.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.539+0000 7f71e0a00640 1 -- 172.21.15.47:0/2009203425 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71c4003520 con 0x7f71e415eaa0 2024-05-27T10:53:15.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.539+0000 7f71e0a00640 1 -- 172.21.15.47:0/2009203425 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 6526514 0 0) 0x7f71c4003520 con 0x7f71e415eaa0 2024-05-27T10:53:15.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.539+0000 7f71e0a00640 1 -- 172.21.15.47:0/2009203425 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f71e406d240 msgr2=0x7f71e406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:15.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.539+0000 7f71e0a00640 1 --2- 172.21.15.47:0/2009203425 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f71e406d240 0x7f71e406d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:15.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.539+0000 7f71e0a00640 1 -- 172.21.15.47:0/2009203425 >> v1:172.21.15.53:6789/0 conn(0x7f71e406ca40 legacy=0x7f71e40d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:15.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.539+0000 7f71e0a00640 1 -- 172.21.15.47:0/2009203425 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e40cee60 con 0x7f71e415eaa0 2024-05-27T10:53:15.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.540+0000 7f71e0a00640 1 -- 172.21.15.47:0/2009203425 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f71cc001b90 con 0x7f71e415eaa0 2024-05-27T10:53:15.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.540+0000 7f71e0a00640 1 -- 172.21.15.47:0/2009203425 >> v1:172.21.15.47:6789/0 conn(0x7f71e415eaa0 legacy=0x7f71e40cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:15.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.540+0000 7f71e0a00640 1 --2- 172.21.15.47:0/2009203425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71c40039e0 0x7f71c4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:15.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.540+0000 7f71e0a00640 1 --2- 172.21.15.47:0/2009203425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71c4004800 0x7f71c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:15.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.540+0000 7f71e0a00640 1 --2- 172.21.15.47:0/2009203425 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f71e406d240 0x7f71c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:15.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.540+0000 7f71e0a00640 1 -- 172.21.15.47:0/2009203425 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f71e40cf4b0 con 0x7f71c40039e0 2024-05-27T10:53:15.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.540+0000 7f71e0a00640 1 -- 172.21.15.47:0/2009203425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f71c400baa0 con 0x7f71c4004800 2024-05-27T10:53:15.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.540+0000 7f71e0a00640 1 -- 172.21.15.47:0/2009203425 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f71c400bca0 con 0x7f71e406d240 2024-05-27T10:53:15.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.540+0000 7f71e1e00640 1 --2- 172.21.15.47:0/2009203425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71c40039e0 0x7f71c4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:15.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.540+0000 7f71e1e00640 1 -- 172.21.15.47:0/2009203425 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f71e406d240 msgr2=0x7f71c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:15.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.540+0000 7f71e1e00640 1 --2- 172.21.15.47:0/2009203425 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f71e406d240 0x7f71c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:15.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.540+0000 7f71e1e00640 1 -- 172.21.15.47:0/2009203425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71c4004800 msgr2=0x7f71c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:15.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.540+0000 7f71e1e00640 1 --2- 172.21.15.47:0/2009203425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71c4004800 0x7f71c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:15.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.540+0000 7f71e1e00640 1 -- 172.21.15.47:0/2009203425 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c4003520 con 0x7f71c40039e0 2024-05-27T10:53:15.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.541+0000 7f71e1e00640 1 --2- 172.21.15.47:0/2009203425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71c40039e0 0x7f71c4003e00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009a90 tx=0x7f71c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d19e9670c249e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:15.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.542+0000 7f71e0a00640 1 -- 172.21.15.47:0/2009203425 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d4036070 con 0x7f71c40039e0 2024-05-27T10:53:15.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.542+0000 7f71e0a00640 1 -- 172.21.15.47:0/2009203425 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71d4031400 con 0x7f71c40039e0 2024-05-27T10:53:15.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.542+0000 7f71e0a00640 1 -- 172.21.15.47:0/2009203425 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d4009690 con 0x7f71c40039e0 2024-05-27T10:53:15.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.542+0000 7f71e3200640 1 -- 172.21.15.47:0/2009203425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71c40039e0 msgr2=0x7f71c4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:15.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.542+0000 7f71e3200640 1 --2- 172.21.15.47:0/2009203425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71c40039e0 0x7f71c4003e00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009a90 tx=0x7f71c4005830 comp rx=0 tx=0).stop 2024-05-27T10:53:15.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.542+0000 7f71e2800640 1 -- 172.21.15.47:0/2009203425 reap_dead start 2024-05-27T10:53:15.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.542+0000 7f71e3200640 1 -- 172.21.15.47:0/2009203425 shutdown_connections 2024-05-27T10:53:15.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.542+0000 7f71e3200640 1 -- 172.21.15.47:0/2009203425 >> 172.21.15.47:0/2009203425 conn(0x7f71e408bfd0 msgr2=0x7f71e40d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:15.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.542+0000 7f71e3200640 1 -- 172.21.15.47:0/2009203425 shutdown_connections 2024-05-27T10:53:15.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.543+0000 7f71e3200640 1 -- 172.21.15.47:0/2009203425 wait complete. 2024-05-27T10:53:15.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.544+0000 7f71e3200640 1 Processor -- start 2024-05-27T10:53:15.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.544+0000 7f71e3200640 1 -- start start 2024-05-27T10:53:15.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.545+0000 7f71e3200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71c40039e0 0x7f71e41f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:15.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.545+0000 7f71e3200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f71e414b490 0x7f71e4160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:15.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.545+0000 7f71e3200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71e41f7cf0 0x7f71e41f81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:15.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.545+0000 7f71e3200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f71e40b10a0 con 0x7f71e41f7cf0 2024-05-27T10:53:15.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.545+0000 7f71e3200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f71e406cf40 con 0x7f71c40039e0 2024-05-27T10:53:15.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.545+0000 7f71e3200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f71e40b1220 con 0x7f71e414b490 2024-05-27T10:53:15.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.546+0000 7f71e2800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71e41f7cf0 0x7f71e41f81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:15.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.546+0000 7f71e2800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71e41f7cf0 0x7f71e41f81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52058/0 (socket says 172.21.15.47:52058) 2024-05-27T10:53:15.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.546+0000 7f71e2800640 1 -- 172.21.15.47:0/4275276461 learned_addr learned my addr 172.21.15.47:0/4275276461 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:15.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.546+0000 7f71e1e00640 1 --2- 172.21.15.47:0/4275276461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71c40039e0 0x7f71e41f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:15.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.546+0000 7f71e1400640 1 --2- 172.21.15.47:0/4275276461 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f71e414b490 0x7f71e4160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:15.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.546+0000 7f71e2800640 1 -- 172.21.15.47:0/4275276461 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f71e414b490 msgr2=0x7f71e4160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:15.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.546+0000 7f71e2800640 1 --2- 172.21.15.47:0/4275276461 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f71e414b490 0x7f71e4160cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:15.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.546+0000 7f71e2800640 1 -- 172.21.15.47:0/4275276461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71c40039e0 msgr2=0x7f71e41f5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:15.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.546+0000 7f71e2800640 1 --2- 172.21.15.47:0/4275276461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71c40039e0 0x7f71e41f5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:15.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.546+0000 7f71e2800640 1 -- 172.21.15.47:0/4275276461 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e4161df0 con 0x7f71e41f7cf0 2024-05-27T10:53:15.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.546+0000 7f71e2800640 1 --2- 172.21.15.47:0/4275276461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71e41f7cf0 0x7f71e41f81a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f71e406ce70 tx=0x7f71dc00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:15.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.547+0000 7f71da000640 1 -- 172.21.15.47:0/4275276461 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc007480 con 0x7f71e41f7cf0 2024-05-27T10:53:15.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.547+0000 7f71da000640 1 -- 172.21.15.47:0/4275276461 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71dc0057c0 con 0x7f71e41f7cf0 2024-05-27T10:53:15.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.547+0000 7f71da000640 1 -- 172.21.15.47:0/4275276461 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc007640 con 0x7f71e41f7cf0 2024-05-27T10:53:15.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.547+0000 7f71e3200640 1 -- 172.21.15.47:0/4275276461 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71e40b8270 con 0x7f71e41f7cf0 2024-05-27T10:53:15.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.547+0000 7f71e3200640 1 -- 172.21.15.47:0/4275276461 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e4161830 con 0x7f71e41f7cf0 2024-05-27T10:53:15.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.548+0000 7f71e3200640 1 -- 172.21.15.47:0/4275276461 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71e40b8440 con 0x7f71e41f7cf0 2024-05-27T10:53:15.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.549+0000 7f71da000640 1 -- 172.21.15.47:0/4275276461 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f71dc011070 con 0x7f71e41f7cf0 2024-05-27T10:53:15.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.551+0000 7f71da000640 1 --2- 172.21.15.47:0/4275276461 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f71c006c8f0 0x7f71c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:15.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.551+0000 7f71da000640 1 -- 172.21.15.47:0/4275276461 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f71dc08ab20 con 0x7f71e41f7cf0 2024-05-27T10:53:15.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.551+0000 7f71e1e00640 1 --2- 172.21.15.47:0/4275276461 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f71c006c8f0 0x7f71c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:15.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.552+0000 7f71e1e00640 1 --2- 172.21.15.47:0/4275276461 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f71c006c8f0 0x7f71c006edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f71d4033000 tx=0x7f71d4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:15.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.555+0000 7f71da000640 1 -- 172.21.15.47:0/4275276461 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f71dc019060 con 0x7f71e41f7cf0 2024-05-27T10:53:15.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.849+0000 7f71e3200640 1 -- 172.21.15.47:0/4275276461 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f71e404fce0 con 0x7f71e41f7cf0 2024-05-27T10:53:15.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.853+0000 7f71da000640 1 -- 172.21.15.47:0/4275276461 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f71dc059290 con 0x7f71e41f7cf0 2024-05-27T10:53:15.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.856+0000 7f71e3200640 1 -- 172.21.15.47:0/4275276461 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f71c006c8f0 msgr2=0x7f71c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:15.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.856+0000 7f71e3200640 1 --2- 172.21.15.47:0/4275276461 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f71c006c8f0 0x7f71c006edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f71d4033000 tx=0x7f71d4008030 comp rx=0 tx=0).stop 2024-05-27T10:53:15.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.856+0000 7f71e3200640 1 -- 172.21.15.47:0/4275276461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71e41f7cf0 msgr2=0x7f71e41f81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:15.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.856+0000 7f71e3200640 1 --2- 172.21.15.47:0/4275276461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71e41f7cf0 0x7f71e41f81a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f71e406ce70 tx=0x7f71dc00c820 comp rx=0 tx=0).stop 2024-05-27T10:53:15.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.856+0000 7f71e3200640 1 -- 172.21.15.47:0/4275276461 shutdown_connections 2024-05-27T10:53:15.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.856+0000 7f71e3200640 1 --2- 172.21.15.47:0/4275276461 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f71c006c8f0 0x7f71c006edb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:15.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.856+0000 7f71e3200640 1 --2- 172.21.15.47:0/4275276461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71e41f7cf0 0x7f71e41f81a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:15.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.856+0000 7f71e3200640 1 --2- 172.21.15.47:0/4275276461 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f71e414b490 0x7f71e4160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:15.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.856+0000 7f71e3200640 1 --2- 172.21.15.47:0/4275276461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71c40039e0 0x7f71e41f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:15.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.856+0000 7f71e3200640 1 -- 172.21.15.47:0/4275276461 >> 172.21.15.47:0/4275276461 conn(0x7f71e408bfd0 msgr2=0x7f71e40b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:15.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.857+0000 7f71e3200640 1 -- 172.21.15.47:0/4275276461 shutdown_connections 2024-05-27T10:53:15.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:15.857+0000 7f71e3200640 1 -- 172.21.15.47:0/4275276461 wait complete. 2024-05-27T10:53:15.873 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-27T10:53:16.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.089+0000 7f0d6a400640 1 Processor -- start 2024-05-27T10:53:16.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.089+0000 7f0d6a400640 1 -- start start 2024-05-27T10:53:16.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.091+0000 7f0d6a400640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0d64072420 0x7f0d640cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:16.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.091+0000 7f0d6a400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d6415a5a0 con 0x7f0d6415cbe0 2024-05-27T10:53:16.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.091+0000 7f0d6a400640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d6415daa0 con 0x7f0d6415a1c0 2024-05-27T10:53:16.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.091+0000 7f0d6a400640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f0d6406f2f0 con 0x7f0d64072420 2024-05-27T10:53:16.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.091+0000 7f0d63e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f0d6415cbe0 0x7f0d6406da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35288/0 (socket says 172.21.15.47:35288) 2024-05-27T10:53:16.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.091+0000 7f0d63e00640 1 -- 172.21.15.47:0/2355918859 learned_addr learned my addr 172.21.15.47:0/2355918859 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:16.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.092+0000 7f0d5be00640 1 --2- 172.21.15.47:0/2355918859 >> v2:172.21.15.53:3300/0 conn(0x7f0d64072420 0x7f0d640cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:16.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.092+0000 7f0d62a00640 1 -- 172.21.15.47:0/2355918859 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1321985560 0 0) 0x7f0d6415a5a0 con 0x7f0d6415cbe0 2024-05-27T10:53:16.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.092+0000 7f0d62a00640 1 -- 172.21.15.47:0/2355918859 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d48003520 con 0x7f0d6415cbe0 2024-05-27T10:53:16.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.092+0000 7f0d62a00640 1 -- 172.21.15.47:0/2355918859 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1721051367 0 0) 0x7f0d48003520 con 0x7f0d6415cbe0 2024-05-27T10:53:16.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.092+0000 7f0d62a00640 1 -- 172.21.15.47:0/2355918859 >> v2:172.21.15.53:3300/0 conn(0x7f0d64072420 msgr2=0x7f0d640cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:16.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.092+0000 7f0d62a00640 1 --2- 172.21.15.47:0/2355918859 >> v2:172.21.15.53:3300/0 conn(0x7f0d64072420 0x7f0d640cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.092+0000 7f0d62a00640 1 -- 172.21.15.47:0/2355918859 >> v1:172.21.15.53:6789/0 conn(0x7f0d6415a1c0 legacy=0x7f0d64071d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:16.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.092+0000 7f0d62a00640 1 -- 172.21.15.47:0/2355918859 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d6415d7c0 con 0x7f0d6415cbe0 2024-05-27T10:53:16.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.092+0000 7f0d62a00640 1 -- 172.21.15.47:0/2355918859 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f0d5c0019f0 con 0x7f0d6415cbe0 2024-05-27T10:53:16.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.092+0000 7f0d62a00640 1 -- 172.21.15.47:0/2355918859 >> v1:172.21.15.47:6789/0 conn(0x7f0d6415cbe0 legacy=0x7f0d6406da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:16.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.093+0000 7f0d62a00640 1 --2- 172.21.15.47:0/2355918859 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0d480039b0 0x7f0d48003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:16.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.093+0000 7f0d62a00640 1 --2- 172.21.15.47:0/2355918859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d48004800 0x7f0d48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:16.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.093+0000 7f0d62a00640 1 --2- 172.21.15.47:0/2355918859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d480051c0 0x7f0d4800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:16.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.093+0000 7f0d62a00640 1 -- 172.21.15.47:0/2355918859 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4800c030 con 0x7f0d480051c0 2024-05-27T10:53:16.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.093+0000 7f0d62a00640 1 -- 172.21.15.47:0/2355918859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4800c1e0 con 0x7f0d48004800 2024-05-27T10:53:16.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.093+0000 7f0d62a00640 1 -- 172.21.15.47:0/2355918859 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f0d4800c3e0 con 0x7f0d480039b0 2024-05-27T10:53:16.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.093+0000 7f0d63e00640 1 --2- 172.21.15.47:0/2355918859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d480051c0 0x7f0d4800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:16.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.093+0000 7f0d63400640 1 --2- 172.21.15.47:0/2355918859 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0d480039b0 0x7f0d48003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:16.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.093+0000 7f0d5be00640 1 --2- 172.21.15.47:0/2355918859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d48004800 0x7f0d48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:16.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.093+0000 7f0d63e00640 1 -- 172.21.15.47:0/2355918859 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0d480039b0 msgr2=0x7f0d48003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:16.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.093+0000 7f0d63e00640 1 --2- 172.21.15.47:0/2355918859 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0d480039b0 0x7f0d48003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.093+0000 7f0d63e00640 1 -- 172.21.15.47:0/2355918859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d48004800 msgr2=0x7f0d48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:16.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.093+0000 7f0d63e00640 1 --2- 172.21.15.47:0/2355918859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d48004800 0x7f0d48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.094+0000 7f0d63e00640 1 -- 172.21.15.47:0/2355918859 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d48003520 con 0x7f0d480051c0 2024-05-27T10:53:16.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.094+0000 7f0d5be00640 1 --2- 172.21.15.47:0/2355918859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d48004800 0x7f0d48004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:16.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.094+0000 7f0d63e00640 1 -- 172.21.15.47:0/2355918859 reap_dead start 2024-05-27T10:53:16.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.095+0000 7f0d63e00640 1 --2- 172.21.15.47:0/2355918859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d480051c0 0x7f0d4800b9c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c00a440 tx=0x7f0d48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53d09815f856f27 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:16.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.095+0000 7f0d62a00640 1 -- 172.21.15.47:0/2355918859 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c00a480 con 0x7f0d480051c0 2024-05-27T10:53:16.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.095+0000 7f0d62a00640 1 -- 172.21.15.47:0/2355918859 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d5c033070 con 0x7f0d480051c0 2024-05-27T10:53:16.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.095+0000 7f0d62a00640 1 -- 172.21.15.47:0/2355918859 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c038690 con 0x7f0d480051c0 2024-05-27T10:53:16.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.096+0000 7f0d6a400640 1 -- 172.21.15.47:0/2355918859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d480051c0 msgr2=0x7f0d4800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:16.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.096+0000 7f0d6a400640 1 --2- 172.21.15.47:0/2355918859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d480051c0 0x7f0d4800b9c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c00a440 tx=0x7f0d48005830 comp rx=0 tx=0).stop 2024-05-27T10:53:16.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.096+0000 7f0d6a400640 1 -- 172.21.15.47:0/2355918859 shutdown_connections 2024-05-27T10:53:16.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.096+0000 7f0d6a400640 1 --2- 172.21.15.47:0/2355918859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d480051c0 0x7f0d4800b9c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.096+0000 7f0d6a400640 1 -- 172.21.15.47:0/2355918859 >> 172.21.15.47:0/2355918859 conn(0x7f0d6406b940 msgr2=0x7f0d6406bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:16.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.096+0000 7f0d6a400640 1 -- 172.21.15.47:0/2355918859 shutdown_connections 2024-05-27T10:53:16.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.096+0000 7f0d6a400640 1 -- 172.21.15.47:0/2355918859 wait complete. 2024-05-27T10:53:16.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.098+0000 7f0d6a400640 1 Processor -- start 2024-05-27T10:53:16.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.098+0000 7f0d6a400640 1 -- start start 2024-05-27T10:53:16.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.099+0000 7f0d6a400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d480051c0 0x7f0d641f8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:16.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.099+0000 7f0d6a400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d64156400 0x7f0d64156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:16.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.099+0000 7f0d6a400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0d64153950 0x7f0d64153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:16.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.099+0000 7f0d6a400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0d640cd4e0 con 0x7f0d64156400 2024-05-27T10:53:16.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.099+0000 7f0d6a400640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0d640cd200 con 0x7f0d480051c0 2024-05-27T10:53:16.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.099+0000 7f0d6a400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f0d640cda00 con 0x7f0d64153950 2024-05-27T10:53:16.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.100+0000 7f0d5be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d64156400 0x7f0d64156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:16.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.100+0000 7f0d5be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d64156400 0x7f0d64156880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52072/0 (socket says 172.21.15.47:52072) 2024-05-27T10:53:16.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.100+0000 7f0d5be00640 1 -- 172.21.15.47:0/464329373 learned_addr learned my addr 172.21.15.47:0/464329373 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:16.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.100+0000 7f0d63400640 1 --2- 172.21.15.47:0/464329373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d480051c0 0x7f0d641f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:16.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.100+0000 7f0d5be00640 1 -- 172.21.15.47:0/464329373 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0d64153950 msgr2=0x7f0d64153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:16.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.100+0000 7f0d5be00640 1 --2- 172.21.15.47:0/464329373 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0d64153950 0x7f0d64153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.100+0000 7f0d5be00640 1 -- 172.21.15.47:0/464329373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d480051c0 msgr2=0x7f0d641f8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:16.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.100+0000 7f0d5be00640 1 --2- 172.21.15.47:0/464329373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d480051c0 0x7f0d641f8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.100+0000 7f0d5be00640 1 -- 172.21.15.47:0/464329373 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d64156ea0 con 0x7f0d64156400 2024-05-27T10:53:16.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.100+0000 7f0d5be00640 1 --2- 172.21.15.47:0/464329373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d64156400 0x7f0d64156880 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0108f0 tx=0x7f0d4c010db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:16.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.101+0000 7f0d5b400640 1 -- 172.21.15.47:0/464329373 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c00f040 con 0x7f0d64156400 2024-05-27T10:53:16.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.101+0000 7f0d5b400640 1 -- 172.21.15.47:0/464329373 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d4c00eb60 con 0x7f0d64156400 2024-05-27T10:53:16.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.101+0000 7f0d5b400640 1 -- 172.21.15.47:0/464329373 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c01c400 con 0x7f0d64156400 2024-05-27T10:53:16.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.101+0000 7f0d6a400640 1 -- 172.21.15.47:0/464329373 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d64157180 con 0x7f0d64156400 2024-05-27T10:53:16.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.101+0000 7f0d6a400640 1 -- 172.21.15.47:0/464329373 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d641f8770 con 0x7f0d64156400 2024-05-27T10:53:16.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.102+0000 7f0d6a400640 1 -- 172.21.15.47:0/464329373 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d6404fdc0 con 0x7f0d64156400 2024-05-27T10:53:16.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.103+0000 7f0d5b400640 1 -- 172.21.15.47:0/464329373 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d4c01c5a0 con 0x7f0d64156400 2024-05-27T10:53:16.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.104+0000 7f0d5b400640 1 --2- 172.21.15.47:0/464329373 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f0d4006c920 0x7f0d4006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:16.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.104+0000 7f0d5b400640 1 -- 172.21.15.47:0/464329373 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f0d4c08bee0 con 0x7f0d64156400 2024-05-27T10:53:16.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.104+0000 7f0d63400640 1 --2- 172.21.15.47:0/464329373 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f0d4006c920 0x7f0d4006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:16.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.105+0000 7f0d63400640 1 --2- 172.21.15.47:0/464329373 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f0d4006c920 0x7f0d4006ede0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0d54000c00 tx=0x7f0d54009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:16.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.109+0000 7f0d5b400640 1 -- 172.21.15.47:0/464329373 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0d4c018030 con 0x7f0d64156400 2024-05-27T10:53:16.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.387+0000 7f0d6a400640 1 -- 172.21.15.47:0/464329373 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f0d640737c0 con 0x7f0d64156400 2024-05-27T10:53:16.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.391+0000 7f0d5b400640 1 -- 172.21.15.47:0/464329373 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f0d4c05a5c0 con 0x7f0d64156400 2024-05-27T10:53:16.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.394+0000 7f0d6a400640 1 -- 172.21.15.47:0/464329373 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f0d4006c920 msgr2=0x7f0d4006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:16.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.394+0000 7f0d6a400640 1 --2- 172.21.15.47:0/464329373 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f0d4006c920 0x7f0d4006ede0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0d54000c00 tx=0x7f0d54009040 comp rx=0 tx=0).stop 2024-05-27T10:53:16.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.394+0000 7f0d6a400640 1 -- 172.21.15.47:0/464329373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d64156400 msgr2=0x7f0d64156880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:16.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.394+0000 7f0d6a400640 1 --2- 172.21.15.47:0/464329373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d64156400 0x7f0d64156880 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0108f0 tx=0x7f0d4c010db0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.394+0000 7f0d6a400640 1 -- 172.21.15.47:0/464329373 shutdown_connections 2024-05-27T10:53:16.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.394+0000 7f0d6a400640 1 --2- 172.21.15.47:0/464329373 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f0d4006c920 0x7f0d4006ede0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.394+0000 7f0d6a400640 1 --2- 172.21.15.47:0/464329373 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0d64153950 0x7f0d64153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.394+0000 7f0d6a400640 1 --2- 172.21.15.47:0/464329373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d64156400 0x7f0d64156880 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.394+0000 7f0d6a400640 1 --2- 172.21.15.47:0/464329373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d480051c0 0x7f0d641f8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.394+0000 7f0d6a400640 1 -- 172.21.15.47:0/464329373 >> 172.21.15.47:0/464329373 conn(0x7f0d6406b940 msgr2=0x7f0d640cc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:16.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.394+0000 7f0d6a400640 1 -- 172.21.15.47:0/464329373 shutdown_connections 2024-05-27T10:53:16.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.394+0000 7f0d6a400640 1 -- 172.21.15.47:0/464329373 wait complete. 2024-05-27T10:53:16.410 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-27T10:53:16.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.610+0000 7f99dce00640 1 Processor -- start 2024-05-27T10:53:16.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.611+0000 7f99dce00640 1 -- start start 2024-05-27T10:53:16.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.612+0000 7f99dce00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f99d815c420 0x7f99d8071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:16.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.612+0000 7f99dce00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f99d80b4ab0 0x7f99d80d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:16.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.612+0000 7f99dce00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f99d8073c50 0x7f99d80d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:16.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.612+0000 7f99dce00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f99d80afc90 con 0x7f99d815c420 2024-05-27T10:53:16.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.612+0000 7f99dce00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f99d815c800 con 0x7f99d80b4ab0 2024-05-27T10:53:16.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.612+0000 7f99dce00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f99d80ad2e0 con 0x7f99d8073c50 2024-05-27T10:53:16.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.612+0000 7f99d7400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f99d815c420 0x7f99d8071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:16.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.612+0000 7f99d7400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f99d815c420 0x7f99d8071fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52086/0 (socket says 172.21.15.47:52086) 2024-05-27T10:53:16.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.612+0000 7f99d7400640 1 -- 172.21.15.47:0/1651854422 learned_addr learned my addr 172.21.15.47:0/1651854422 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:16.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.613+0000 7f99d7400640 1 -- 172.21.15.47:0/1651854422 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f99d8073c50 msgr2=0x7f99d80d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:16.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.613+0000 7f99d7400640 1 --2- 172.21.15.47:0/1651854422 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f99d8073c50 0x7f99d80d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.613+0000 7f99d7400640 1 -- 172.21.15.47:0/1651854422 >> v2:172.21.15.53:3300/0 conn(0x7f99d80b4ab0 msgr2=0x7f99d80d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:16.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.613+0000 7f99d7400640 1 --2- 172.21.15.47:0/1651854422 >> v2:172.21.15.53:3300/0 conn(0x7f99d80b4ab0 0x7f99d80d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.613+0000 7f99d7400640 1 -- 172.21.15.47:0/1651854422 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d80ad5c0 con 0x7f99d815c420 2024-05-27T10:53:16.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.613+0000 7f99d7400640 1 --2- 172.21.15.47:0/1651854422 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d815c420 0x7f99d8071fc0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f99d806c8e0 tx=0x7f99c802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db4ef44acbedfaa server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:16.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.614+0000 7f99d6a00640 1 -- 172.21.15.47:0/1651854422 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8037070 con 0x7f99d815c420 2024-05-27T10:53:16.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.614+0000 7f99d6a00640 1 -- 172.21.15.47:0/1651854422 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c8032440 con 0x7f99d815c420 2024-05-27T10:53:16.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.614+0000 7f99d6a00640 1 -- 172.21.15.47:0/1651854422 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8032810 con 0x7f99d815c420 2024-05-27T10:53:16.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.614+0000 7f99dce00640 1 -- 172.21.15.47:0/1651854422 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d815c420 msgr2=0x7f99d8071fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:16.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.614+0000 7f99dce00640 1 --2- 172.21.15.47:0/1651854422 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d815c420 0x7f99d8071fc0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f99d806c8e0 tx=0x7f99c802a140 comp rx=0 tx=0).stop 2024-05-27T10:53:16.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.614+0000 7f99dce00640 1 -- 172.21.15.47:0/1651854422 shutdown_connections 2024-05-27T10:53:16.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.614+0000 7f99dce00640 1 --2- 172.21.15.47:0/1651854422 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f99d8073c50 0x7f99d80d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.614+0000 7f99dce00640 1 --2- 172.21.15.47:0/1651854422 >> v2:172.21.15.53:3300/0 conn(0x7f99d80b4ab0 0x7f99d80d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.614+0000 7f99dce00640 1 --2- 172.21.15.47:0/1651854422 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d815c420 0x7f99d8071fc0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.614+0000 7f99dce00640 1 -- 172.21.15.47:0/1651854422 >> 172.21.15.47:0/1651854422 conn(0x7f99d806bb20 msgr2=0x7f99d806bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:16.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.615+0000 7f99dce00640 1 -- 172.21.15.47:0/1651854422 shutdown_connections 2024-05-27T10:53:16.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.615+0000 7f99dce00640 1 -- 172.21.15.47:0/1651854422 wait complete. 2024-05-27T10:53:16.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.616+0000 7f99dce00640 1 Processor -- start 2024-05-27T10:53:16.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.616+0000 7f99dce00640 1 -- start start 2024-05-27T10:53:16.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.617+0000 7f99dce00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d8073c50 0x7f99d81f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:16.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.617+0000 7f99dce00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f99d80b4ab0 0x7f99d81f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:16.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.617+0000 7f99dce00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d815c420 0x7f99d8157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:16.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.617+0000 7f99dce00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f99d80af8f0 con 0x7f99d8073c50 2024-05-27T10:53:16.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.617+0000 7f99dce00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f99d80ad8a0 con 0x7f99d815c420 2024-05-27T10:53:16.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.617+0000 7f99dce00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f99d80afa70 con 0x7f99d80b4ab0 2024-05-27T10:53:16.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.617+0000 7f99d7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d8073c50 0x7f99d81f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:16.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.618+0000 7f99d7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d8073c50 0x7f99d81f43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52088/0 (socket says 172.21.15.47:52088) 2024-05-27T10:53:16.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.618+0000 7f99d7400640 1 -- 172.21.15.47:0/2525711084 learned_addr learned my addr 172.21.15.47:0/2525711084 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:16.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.618+0000 7f99cfe00640 1 --2- 172.21.15.47:0/2525711084 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f99d80b4ab0 0x7f99d81f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:16.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.618+0000 7f99d7400640 1 -- 172.21.15.47:0/2525711084 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f99d80b4ab0 msgr2=0x7f99d81f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:16.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.618+0000 7f99d7400640 1 --2- 172.21.15.47:0/2525711084 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f99d80b4ab0 0x7f99d81f4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.618+0000 7f99d7400640 1 -- 172.21.15.47:0/2525711084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d815c420 msgr2=0x7f99d8157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:16.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.618+0000 7f99d7e00640 1 --2- 172.21.15.47:0/2525711084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d815c420 0x7f99d8157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:16.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.618+0000 7f99d7400640 1 --2- 172.21.15.47:0/2525711084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d815c420 0x7f99d8157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.618+0000 7f99d7400640 1 -- 172.21.15.47:0/2525711084 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d806eb80 con 0x7f99d8073c50 2024-05-27T10:53:16.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.618+0000 7f99d7400640 1 --2- 172.21.15.47:0/2525711084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d8073c50 0x7f99d81f43f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f99c8000c00 tx=0x7f99c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:16.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.619+0000 7f99cf400640 1 -- 172.21.15.47:0/2525711084 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8041070 con 0x7f99d8073c50 2024-05-27T10:53:16.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.619+0000 7f99cf400640 1 -- 172.21.15.47:0/2525711084 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c803c870 con 0x7f99d8073c50 2024-05-27T10:53:16.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.619+0000 7f99cf400640 1 -- 172.21.15.47:0/2525711084 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8037040 con 0x7f99d8073c50 2024-05-27T10:53:16.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.619+0000 7f99dce00640 1 -- 172.21.15.47:0/2525711084 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d806ee60 con 0x7f99d8073c50 2024-05-27T10:53:16.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.619+0000 7f99dce00640 1 -- 172.21.15.47:0/2525711084 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d806f420 con 0x7f99d8073c50 2024-05-27T10:53:16.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.620+0000 7f99dce00640 1 -- 172.21.15.47:0/2525711084 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99d80681e0 con 0x7f99d8073c50 2024-05-27T10:53:16.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.621+0000 7f99cf400640 1 -- 172.21.15.47:0/2525711084 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f99c8044070 con 0x7f99d8073c50 2024-05-27T10:53:16.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.622+0000 7f99cf400640 1 --2- 172.21.15.47:0/2525711084 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f99b406c920 0x7f99b406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:16.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.622+0000 7f99cf400640 1 -- 172.21.15.47:0/2525711084 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f99c80ac490 con 0x7f99d8073c50 2024-05-27T10:53:16.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.622+0000 7f99cfe00640 1 --2- 172.21.15.47:0/2525711084 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f99b406c920 0x7f99b406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:16.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.623+0000 7f99cfe00640 1 --2- 172.21.15.47:0/2525711084 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f99b406c920 0x7f99b406ede0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f99d80b20e0 tx=0x7f99c0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:16.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.626+0000 7f99cf400640 1 -- 172.21.15.47:0/2525711084 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f99d80681e0 con 0x7f99d8073c50 2024-05-27T10:53:16.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.892+0000 7f99dce00640 1 -- 172.21.15.47:0/2525711084 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f99d804fce0 con 0x7f99d8073c50 2024-05-27T10:53:16.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.897+0000 7f99cf400640 1 -- 172.21.15.47:0/2525711084 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f99c807ad20 con 0x7f99d8073c50 2024-05-27T10:53:16.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.900+0000 7f99dce00640 1 -- 172.21.15.47:0/2525711084 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f99b406c920 msgr2=0x7f99b406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:16.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.900+0000 7f99dce00640 1 --2- 172.21.15.47:0/2525711084 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f99b406c920 0x7f99b406ede0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f99d80b20e0 tx=0x7f99c0008040 comp rx=0 tx=0).stop 2024-05-27T10:53:16.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.900+0000 7f99dce00640 1 -- 172.21.15.47:0/2525711084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d8073c50 msgr2=0x7f99d81f43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:16.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.900+0000 7f99dce00640 1 --2- 172.21.15.47:0/2525711084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d8073c50 0x7f99d81f43f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f99c8000c00 tx=0x7f99c80046c0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.900+0000 7f99dce00640 1 -- 172.21.15.47:0/2525711084 shutdown_connections 2024-05-27T10:53:16.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.900+0000 7f99dce00640 1 --2- 172.21.15.47:0/2525711084 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f99b406c920 0x7f99b406ede0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.900+0000 7f99dce00640 1 --2- 172.21.15.47:0/2525711084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d815c420 0x7f99d8157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.900+0000 7f99dce00640 1 --2- 172.21.15.47:0/2525711084 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f99d80b4ab0 0x7f99d81f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.900+0000 7f99dce00640 1 --2- 172.21.15.47:0/2525711084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d8073c50 0x7f99d81f43f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:16.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.900+0000 7f99dce00640 1 -- 172.21.15.47:0/2525711084 >> 172.21.15.47:0/2525711084 conn(0x7f99d806bb20 msgr2=0x7f99d815e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:16.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.900+0000 7f99dce00640 1 -- 172.21.15.47:0/2525711084 shutdown_connections 2024-05-27T10:53:16.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:16.900+0000 7f99dce00640 1 -- 172.21.15.47:0/2525711084 wait complete. 2024-05-27T10:53:16.917 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-27T10:53:17.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.128+0000 7fcbe3e00640 1 Processor -- start 2024-05-27T10:53:17.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.129+0000 7fcbe3e00640 1 -- start start 2024-05-27T10:53:17.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.130+0000 7fcbe3e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcbe415b380 0x7fcbe40d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:17.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.130+0000 7fcbe3e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcbe40d08a0 0x7fcbe406e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:17.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.130+0000 7fcbe3e00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcbe406ebd0 0x7fcbe40b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:17.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.130+0000 7fcbe3e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fcbe40adcc0 con 0x7fcbe40d08a0 2024-05-27T10:53:17.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.130+0000 7fcbe3e00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fcbe406ff20 con 0x7fcbe406ebd0 2024-05-27T10:53:17.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.130+0000 7fcbe3e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe40d0ce0 con 0x7fcbe415b380 2024-05-27T10:53:17.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.131+0000 7fcbdbe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcbe40d08a0 0x7fcbe406e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:17.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.131+0000 7fcbdbe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcbe40d08a0 0x7fcbe406e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52094/0 (socket says 172.21.15.47:52094) 2024-05-27T10:53:17.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.131+0000 7fcbdbe00640 1 -- 172.21.15.47:0/2835625333 learned_addr learned my addr 172.21.15.47:0/2835625333 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:17.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.131+0000 7fcbe3400640 1 --2- 172.21.15.47:0/2835625333 >> v2:172.21.15.53:3300/0 conn(0x7fcbe406ebd0 0x7fcbe40b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:17.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.131+0000 7fcbe2a00640 1 --2- 172.21.15.47:0/2835625333 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcbe415b380 0x7fcbe40d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:17.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.131+0000 7fcbdbe00640 1 -- 172.21.15.47:0/2835625333 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcbe415b380 msgr2=0x7fcbe40d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:17.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.131+0000 7fcbdbe00640 1 --2- 172.21.15.47:0/2835625333 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcbe415b380 0x7fcbe40d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.131+0000 7fcbdbe00640 1 -- 172.21.15.47:0/2835625333 >> v2:172.21.15.53:3300/0 conn(0x7fcbe406ebd0 msgr2=0x7fcbe40b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:17.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.131+0000 7fcbdbe00640 1 --2- 172.21.15.47:0/2835625333 >> v2:172.21.15.53:3300/0 conn(0x7fcbe406ebd0 0x7fcbe40b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.131+0000 7fcbdbe00640 1 -- 172.21.15.47:0/2835625333 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe406f3a0 con 0x7fcbe40d08a0 2024-05-27T10:53:17.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.132+0000 7fcbdbe00640 1 --2- 172.21.15.47:0/2835625333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe40d08a0 0x7fcbe406e690 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcbe406e5a0 tx=0x7fcbcc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa960599347c066 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:17.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.133+0000 7fcbe2000640 1 -- 172.21.15.47:0/2835625333 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc037070 con 0x7fcbe40d08a0 2024-05-27T10:53:17.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.133+0000 7fcbe2000640 1 -- 172.21.15.47:0/2835625333 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbcc032440 con 0x7fcbe40d08a0 2024-05-27T10:53:17.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.133+0000 7fcbe2000640 1 -- 172.21.15.47:0/2835625333 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc032810 con 0x7fcbe40d08a0 2024-05-27T10:53:17.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.133+0000 7fcbe3e00640 1 -- 172.21.15.47:0/2835625333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe40d08a0 msgr2=0x7fcbe406e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:17.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.133+0000 7fcbe3e00640 1 --2- 172.21.15.47:0/2835625333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe40d08a0 0x7fcbe406e690 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcbe406e5a0 tx=0x7fcbcc02a140 comp rx=0 tx=0).stop 2024-05-27T10:53:17.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.133+0000 7fcbe3e00640 1 -- 172.21.15.47:0/2835625333 shutdown_connections 2024-05-27T10:53:17.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.133+0000 7fcbe3e00640 1 --2- 172.21.15.47:0/2835625333 >> v2:172.21.15.53:3300/0 conn(0x7fcbe406ebd0 0x7fcbe40b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.133+0000 7fcbe3e00640 1 --2- 172.21.15.47:0/2835625333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe40d08a0 0x7fcbe406e690 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.133+0000 7fcbe3e00640 1 --2- 172.21.15.47:0/2835625333 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcbe415b380 0x7fcbe40d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.133+0000 7fcbe3e00640 1 -- 172.21.15.47:0/2835625333 >> 172.21.15.47:0/2835625333 conn(0x7fcbe406bb20 msgr2=0x7fcbe406bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:17.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.133+0000 7fcbe3e00640 1 -- 172.21.15.47:0/2835625333 shutdown_connections 2024-05-27T10:53:17.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.133+0000 7fcbe3e00640 1 -- 172.21.15.47:0/2835625333 wait complete. 2024-05-27T10:53:17.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.135+0000 7fcbe3e00640 1 Processor -- start 2024-05-27T10:53:17.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.135+0000 7fcbe3e00640 1 -- start start 2024-05-27T10:53:17.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.136+0000 7fcbe3e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcbe406ebd0 0x7fcbe41f0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:17.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.136+0000 7fcbe3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe40d08a0 0x7fcbe4099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:17.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.136+0000 7fcbe3e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbe415b380 0x7fcbe4159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:17.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.136+0000 7fcbe3e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe406fc40 con 0x7fcbe40d08a0 2024-05-27T10:53:17.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.136+0000 7fcbe3e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe406f960 con 0x7fcbe415b380 2024-05-27T10:53:17.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.136+0000 7fcbe3e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe406f020 con 0x7fcbe406ebd0 2024-05-27T10:53:17.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.137+0000 7fcbdbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe40d08a0 0x7fcbe4099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:17.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.137+0000 7fcbdbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe40d08a0 0x7fcbe4099a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52096/0 (socket says 172.21.15.47:52096) 2024-05-27T10:53:17.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.137+0000 7fcbdbe00640 1 -- 172.21.15.47:0/68254665 learned_addr learned my addr 172.21.15.47:0/68254665 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:17.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.137+0000 7fcbe2a00640 1 --2- 172.21.15.47:0/68254665 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcbe406ebd0 0x7fcbe41f0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:17.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.137+0000 7fcbe3400640 1 --2- 172.21.15.47:0/68254665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbe415b380 0x7fcbe4159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:17.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.137+0000 7fcbdbe00640 1 -- 172.21.15.47:0/68254665 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcbe406ebd0 msgr2=0x7fcbe41f0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:17.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.137+0000 7fcbdbe00640 1 --2- 172.21.15.47:0/68254665 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcbe406ebd0 0x7fcbe41f0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.137+0000 7fcbdbe00640 1 -- 172.21.15.47:0/68254665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbe415b380 msgr2=0x7fcbe4159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:17.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.137+0000 7fcbdbe00640 1 --2- 172.21.15.47:0/68254665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbe415b380 0x7fcbe4159100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.137+0000 7fcbdbe00640 1 -- 172.21.15.47:0/68254665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe415e5b0 con 0x7fcbe40d08a0 2024-05-27T10:53:17.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.137+0000 7fcbe3400640 1 --2- 172.21.15.47:0/68254665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbe415b380 0x7fcbe4159100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:17.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.138+0000 7fcbdbe00640 1 --2- 172.21.15.47:0/68254665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe40d08a0 0x7fcbe4099a90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc02a180 tx=0x7fcbcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:17.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.138+0000 7fcbdaa00640 1 -- 172.21.15.47:0/68254665 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc041020 con 0x7fcbe40d08a0 2024-05-27T10:53:17.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.138+0000 7fcbdaa00640 1 -- 172.21.15.47:0/68254665 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbcc0306c0 con 0x7fcbe40d08a0 2024-05-27T10:53:17.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.138+0000 7fcbdaa00640 1 -- 172.21.15.47:0/68254665 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc037040 con 0x7fcbe40d08a0 2024-05-27T10:53:17.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.138+0000 7fcbe3e00640 1 -- 172.21.15.47:0/68254665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe41f4060 con 0x7fcbe40d08a0 2024-05-27T10:53:17.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.138+0000 7fcbe3e00640 1 -- 172.21.15.47:0/68254665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe41f0280 con 0x7fcbe40d08a0 2024-05-27T10:53:17.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.140+0000 7fcbe3e00640 1 -- 172.21.15.47:0/68254665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe404fce0 con 0x7fcbe40d08a0 2024-05-27T10:53:17.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.141+0000 7fcbdaa00640 1 -- 172.21.15.47:0/68254665 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcbcc044020 con 0x7fcbe40d08a0 2024-05-27T10:53:17.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.141+0000 7fcbdaa00640 1 --2- 172.21.15.47:0/68254665 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fcbc006c8f0 0x7fcbc006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:17.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.142+0000 7fcbdaa00640 1 -- 172.21.15.47:0/68254665 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fcbcc0abf50 con 0x7fcbe40d08a0 2024-05-27T10:53:17.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.142+0000 7fcbe2a00640 1 --2- 172.21.15.47:0/68254665 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fcbc006c8f0 0x7fcbc006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.143+0000 7fcbe2a00640 1 --2- 172.21.15.47:0/68254665 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fcbc006c8f0 0x7fcbc006edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4142130 tx=0x7fcbd4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:17.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.147+0000 7fcbdaa00640 1 -- 172.21.15.47:0/68254665 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcbcc04b030 con 0x7fcbe40d08a0 2024-05-27T10:53:17.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.419+0000 7fcbe3e00640 1 -- 172.21.15.47:0/68254665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fcbe40b0430 con 0x7fcbe40d08a0 2024-05-27T10:53:17.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.424+0000 7fcbdaa00640 1 -- 172.21.15.47:0/68254665 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7fcbcc07a6c0 con 0x7fcbe40d08a0 2024-05-27T10:53:17.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.426+0000 7fcbe3e00640 1 -- 172.21.15.47:0/68254665 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fcbc006c8f0 msgr2=0x7fcbc006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:17.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.426+0000 7fcbe3e00640 1 --2- 172.21.15.47:0/68254665 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fcbc006c8f0 0x7fcbc006edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4142130 tx=0x7fcbd4008040 comp rx=0 tx=0).stop 2024-05-27T10:53:17.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.426+0000 7fcbe3e00640 1 -- 172.21.15.47:0/68254665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe40d08a0 msgr2=0x7fcbe4099a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:17.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.426+0000 7fcbe3e00640 1 --2- 172.21.15.47:0/68254665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe40d08a0 0x7fcbe4099a90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc02a180 tx=0x7fcbcc0046c0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.427+0000 7fcbe3e00640 1 -- 172.21.15.47:0/68254665 shutdown_connections 2024-05-27T10:53:17.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.427+0000 7fcbe3e00640 1 --2- 172.21.15.47:0/68254665 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fcbc006c8f0 0x7fcbc006edb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.427+0000 7fcbe3e00640 1 --2- 172.21.15.47:0/68254665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbe415b380 0x7fcbe4159100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.427+0000 7fcbe3e00640 1 --2- 172.21.15.47:0/68254665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe40d08a0 0x7fcbe4099a90 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.427+0000 7fcbe3e00640 1 --2- 172.21.15.47:0/68254665 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcbe406ebd0 0x7fcbe41f0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.427+0000 7fcbe3e00640 1 -- 172.21.15.47:0/68254665 >> 172.21.15.47:0/68254665 conn(0x7fcbe406bb20 msgr2=0x7fcbe40cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:17.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.427+0000 7fcbe3e00640 1 -- 172.21.15.47:0/68254665 shutdown_connections 2024-05-27T10:53:17.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.427+0000 7fcbe3e00640 1 -- 172.21.15.47:0/68254665 wait complete. 2024-05-27T10:53:17.442 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-27T10:53:17.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.641+0000 7f72df000640 1 Processor -- start 2024-05-27T10:53:17.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.641+0000 7f72df000640 1 -- start start 2024-05-27T10:53:17.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.643+0000 7f72df000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f72d815c420 0x7f72d8071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:17.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.643+0000 7f72df000640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f72d80b4ab0 0x7f72d80d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:17.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.643+0000 7f72df000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f72d8073c50 0x7f72d80d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:17.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.643+0000 7f72df000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f72d80afc90 con 0x7f72d8073c50 2024-05-27T10:53:17.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.643+0000 7f72df000640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f72d815c800 con 0x7f72d80b4ab0 2024-05-27T10:53:17.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.643+0000 7f72df000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f72d80ad2e0 con 0x7f72d815c420 2024-05-27T10:53:17.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.644+0000 7f72de600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f72d8073c50 0x7f72d80d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:17.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.644+0000 7f72de600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f72d8073c50 0x7f72d80d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52106/0 (socket says 172.21.15.47:52106) 2024-05-27T10:53:17.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.644+0000 7f72de600640 1 -- 172.21.15.47:0/2907250545 learned_addr learned my addr 172.21.15.47:0/2907250545 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:17.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.644+0000 7f72dd200640 1 --2- 172.21.15.47:0/2907250545 >> v2:172.21.15.53:3300/0 conn(0x7f72d80b4ab0 0x7f72d80d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:17.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.644+0000 7f72ddc00640 1 --2- 172.21.15.47:0/2907250545 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f72d815c420 0x7f72d8071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:17.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.644+0000 7f72de600640 1 -- 172.21.15.47:0/2907250545 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f72d815c420 msgr2=0x7f72d8071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:17.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.644+0000 7f72de600640 1 --2- 172.21.15.47:0/2907250545 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f72d815c420 0x7f72d8071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.644+0000 7f72de600640 1 -- 172.21.15.47:0/2907250545 >> v2:172.21.15.53:3300/0 conn(0x7f72d80b4ab0 msgr2=0x7f72d80d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:17.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.644+0000 7f72de600640 1 --2- 172.21.15.47:0/2907250545 >> v2:172.21.15.53:3300/0 conn(0x7f72d80b4ab0 0x7f72d80d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.644+0000 7f72de600640 1 -- 172.21.15.47:0/2907250545 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d80ad5c0 con 0x7f72d8073c50 2024-05-27T10:53:17.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.645+0000 7f72de600640 1 --2- 172.21.15.47:0/2907250545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72d8073c50 0x7f72d80d08a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f72d80718a0 tx=0x7f72d002a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8673b06d10bb1bf7 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:17.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.646+0000 7f72d7e00640 1 -- 172.21.15.47:0/2907250545 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d0036070 con 0x7f72d8073c50 2024-05-27T10:53:17.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.646+0000 7f72d7e00640 1 -- 172.21.15.47:0/2907250545 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d0031600 con 0x7f72d8073c50 2024-05-27T10:53:17.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.646+0000 7f72d7e00640 1 -- 172.21.15.47:0/2907250545 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d00319d0 con 0x7f72d8073c50 2024-05-27T10:53:17.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.646+0000 7f72df000640 1 -- 172.21.15.47:0/2907250545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72d8073c50 msgr2=0x7f72d80d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:17.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.646+0000 7f72df000640 1 --2- 172.21.15.47:0/2907250545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72d8073c50 0x7f72d80d08a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f72d80718a0 tx=0x7f72d002a600 comp rx=0 tx=0).stop 2024-05-27T10:53:17.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.646+0000 7f72df000640 1 -- 172.21.15.47:0/2907250545 shutdown_connections 2024-05-27T10:53:17.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.646+0000 7f72df000640 1 --2- 172.21.15.47:0/2907250545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72d8073c50 0x7f72d80d08a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.646+0000 7f72df000640 1 --2- 172.21.15.47:0/2907250545 >> v2:172.21.15.53:3300/0 conn(0x7f72d80b4ab0 0x7f72d80d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.646+0000 7f72df000640 1 --2- 172.21.15.47:0/2907250545 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f72d815c420 0x7f72d8071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.646+0000 7f72df000640 1 -- 172.21.15.47:0/2907250545 >> 172.21.15.47:0/2907250545 conn(0x7f72d806bb20 msgr2=0x7f72d806bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:17.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.646+0000 7f72df000640 1 -- 172.21.15.47:0/2907250545 shutdown_connections 2024-05-27T10:53:17.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.646+0000 7f72df000640 1 -- 172.21.15.47:0/2907250545 wait complete. 2024-05-27T10:53:17.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.648+0000 7f72df000640 1 Processor -- start 2024-05-27T10:53:17.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.648+0000 7f72df000640 1 -- start start 2024-05-27T10:53:17.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.649+0000 7f72df000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72d8073c50 0x7f72d8159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:17.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.649+0000 7f72df000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f72d80b4ab0 0x7f72d8155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:17.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.649+0000 7f72df000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72d815c420 0x7f72d815fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:17.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.649+0000 7f72df000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f72d80af8f0 con 0x7f72d815c420 2024-05-27T10:53:17.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.649+0000 7f72df000640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f72d80ad8a0 con 0x7f72d8073c50 2024-05-27T10:53:17.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.649+0000 7f72df000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f72d80afa70 con 0x7f72d80b4ab0 2024-05-27T10:53:17.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.649+0000 7f72de600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72d815c420 0x7f72d815fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:17.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.649+0000 7f72de600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72d815c420 0x7f72d815fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52108/0 (socket says 172.21.15.47:52108) 2024-05-27T10:53:17.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.649+0000 7f72de600640 1 -- 172.21.15.47:0/1051397218 learned_addr learned my addr 172.21.15.47:0/1051397218 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:17.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.650+0000 7f72de600640 1 -- 172.21.15.47:0/1051397218 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f72d80b4ab0 msgr2=0x7f72d8155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:17.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.650+0000 7f72de600640 1 --2- 172.21.15.47:0/1051397218 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f72d80b4ab0 0x7f72d8155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.650+0000 7f72ddc00640 1 --2- 172.21.15.47:0/1051397218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72d8073c50 0x7f72d8159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:17.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.650+0000 7f72de600640 1 -- 172.21.15.47:0/1051397218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72d8073c50 msgr2=0x7f72d8159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:17.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.650+0000 7f72de600640 1 --2- 172.21.15.47:0/1051397218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72d8073c50 0x7f72d8159530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.650+0000 7f72de600640 1 -- 172.21.15.47:0/1051397218 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d8158770 con 0x7f72d815c420 2024-05-27T10:53:17.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.650+0000 7f72de600640 1 --2- 172.21.15.47:0/1051397218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72d815c420 0x7f72d815fd50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009f40 tx=0x7f72d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:17.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.650+0000 7f72d5600640 1 -- 172.21.15.47:0/1051397218 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d0036050 con 0x7f72d815c420 2024-05-27T10:53:17.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.650+0000 7f72d5600640 1 -- 172.21.15.47:0/1051397218 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d0042070 con 0x7f72d815c420 2024-05-27T10:53:17.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.650+0000 7f72df000640 1 -- 172.21.15.47:0/1051397218 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d8158a50 con 0x7f72d815c420 2024-05-27T10:53:17.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.651+0000 7f72d5600640 1 -- 172.21.15.47:0/1051397218 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d0009510 con 0x7f72d815c420 2024-05-27T10:53:17.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.651+0000 7f72df000640 1 -- 172.21.15.47:0/1051397218 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d8159010 con 0x7f72d815c420 2024-05-27T10:53:17.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.652+0000 7f72df000640 1 -- 172.21.15.47:0/1051397218 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72d804fce0 con 0x7f72d815c420 2024-05-27T10:53:17.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.653+0000 7f72d5600640 1 -- 172.21.15.47:0/1051397218 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f72d0007c30 con 0x7f72d815c420 2024-05-27T10:53:17.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.653+0000 7f72d5600640 1 --2- 172.21.15.47:0/1051397218 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f72b806c8f0 0x7f72b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:17.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.654+0000 7f72d5600640 1 -- 172.21.15.47:0/1051397218 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f72d00ac830 con 0x7f72d815c420 2024-05-27T10:53:17.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.654+0000 7f72ddc00640 1 --2- 172.21.15.47:0/1051397218 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f72b806c8f0 0x7f72b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:17.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.655+0000 7f72ddc00640 1 --2- 172.21.15.47:0/1051397218 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f72b806c8f0 0x7f72b806edb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f72cc006fd0 tx=0x7f72cc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:17.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.658+0000 7f72d5600640 1 -- 172.21.15.47:0/1051397218 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f72d002ae20 con 0x7f72d815c420 2024-05-27T10:53:17.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.926+0000 7f72df000640 1 -- 172.21.15.47:0/1051397218 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f72d81591e0 con 0x7f72d815c420 2024-05-27T10:53:17.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.930+0000 7f72d5600640 1 -- 172.21.15.47:0/1051397218 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v10) ==== 97+0+0 (secure 0 0 0) 0x7f72d007af10 con 0x7f72d815c420 2024-05-27T10:53:17.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.933+0000 7f72df000640 1 -- 172.21.15.47:0/1051397218 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f72b806c8f0 msgr2=0x7f72b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:17.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.933+0000 7f72df000640 1 --2- 172.21.15.47:0/1051397218 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f72b806c8f0 0x7f72b806edb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f72cc006fd0 tx=0x7f72cc008040 comp rx=0 tx=0).stop 2024-05-27T10:53:17.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.933+0000 7f72df000640 1 -- 172.21.15.47:0/1051397218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72d815c420 msgr2=0x7f72d815fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:17.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.933+0000 7f72df000640 1 --2- 172.21.15.47:0/1051397218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72d815c420 0x7f72d815fd50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009f40 tx=0x7f72d0004a40 comp rx=0 tx=0).stop 2024-05-27T10:53:17.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.933+0000 7f72df000640 1 -- 172.21.15.47:0/1051397218 shutdown_connections 2024-05-27T10:53:17.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.933+0000 7f72df000640 1 --2- 172.21.15.47:0/1051397218 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f72b806c8f0 0x7f72b806edb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.933+0000 7f72df000640 1 --2- 172.21.15.47:0/1051397218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72d815c420 0x7f72d815fd50 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.933+0000 7f72df000640 1 --2- 172.21.15.47:0/1051397218 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f72d80b4ab0 0x7f72d8155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.933+0000 7f72df000640 1 --2- 172.21.15.47:0/1051397218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72d8073c50 0x7f72d8159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:17.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.933+0000 7f72df000640 1 -- 172.21.15.47:0/1051397218 >> 172.21.15.47:0/1051397218 conn(0x7f72d806bb20 msgr2=0x7f72d815e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:17.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.933+0000 7f72df000640 1 -- 172.21.15.47:0/1051397218 shutdown_connections 2024-05-27T10:53:17.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:17.933+0000 7f72df000640 1 -- 172.21.15.47:0/1051397218 wait complete. 2024-05-27T10:53:17.948 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-27T10:53:18.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.156+0000 7fc77dc00640 1 Processor -- start 2024-05-27T10:53:18.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.156+0000 7fc77dc00640 1 -- start start 2024-05-27T10:53:18.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.158+0000 7fc77dc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc77806d240 0x7fc77806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:18.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.158+0000 7fc77dc00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7780cebc0 con 0x7fc77806ca40 2024-05-27T10:53:18.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.158+0000 7fc77dc00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77806db60 con 0x7fc77815eaa0 2024-05-27T10:53:18.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.158+0000 7fc77dc00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc7780cf4b0 con 0x7fc77806d240 2024-05-27T10:53:18.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.158+0000 7fc777e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc77806d240 0x7fc77806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:18.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.158+0000 7fc77d200640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc77806ca40 0x7fc7780d0050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35298/0 (socket says 172.21.15.47:35298) 2024-05-27T10:53:18.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.158+0000 7fc77d200640 1 -- 172.21.15.47:0/2426756817 learned_addr learned my addr 172.21.15.47:0/2426756817 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:18.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.159+0000 7fc776a00640 1 -- 172.21.15.47:0/2426756817 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1686319142 0 0) 0x7fc7780cebc0 con 0x7fc77806ca40 2024-05-27T10:53:18.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.159+0000 7fc776a00640 1 -- 172.21.15.47:0/2426756817 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc75c003520 con 0x7fc77806ca40 2024-05-27T10:53:18.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.159+0000 7fc777e00640 1 -- 172.21.15.47:0/2426756817 >> v1:172.21.15.53:6789/0 conn(0x7fc77815eaa0 legacy=0x7fc7780cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:18.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.159+0000 7fc777e00640 1 -- 172.21.15.47:0/2426756817 >> v1:172.21.15.47:6789/0 conn(0x7fc77806ca40 legacy=0x7fc7780d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:18.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.159+0000 7fc777e00640 1 -- 172.21.15.47:0/2426756817 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7780cee60 con 0x7fc77806d240 2024-05-27T10:53:18.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.160+0000 7fc777e00640 1 --2- 172.21.15.47:0/2426756817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc77806d240 0x7fc77806d620 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc7680097a0 tx=0x7fc76802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435a1c2f14797e45 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:18.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.160+0000 7fc776a00640 1 -- 172.21.15.47:0/2426756817 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc768037070 con 0x7fc77806d240 2024-05-27T10:53:18.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.160+0000 7fc776a00640 1 -- 172.21.15.47:0/2426756817 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc768032440 con 0x7fc77806d240 2024-05-27T10:53:18.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.160+0000 7fc776a00640 1 -- 172.21.15.47:0/2426756817 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc768032810 con 0x7fc77806d240 2024-05-27T10:53:18.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.161+0000 7fc77dc00640 1 -- 172.21.15.47:0/2426756817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc77806d240 msgr2=0x7fc77806d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:18.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.161+0000 7fc77dc00640 1 --2- 172.21.15.47:0/2426756817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc77806d240 0x7fc77806d620 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc7680097a0 tx=0x7fc76802a230 comp rx=0 tx=0).stop 2024-05-27T10:53:18.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.161+0000 7fc77dc00640 1 -- 172.21.15.47:0/2426756817 shutdown_connections 2024-05-27T10:53:18.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.161+0000 7fc77dc00640 1 --2- 172.21.15.47:0/2426756817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc77806d240 0x7fc77806d620 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:18.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.161+0000 7fc77dc00640 1 -- 172.21.15.47:0/2426756817 >> 172.21.15.47:0/2426756817 conn(0x7fc77808bfd0 msgr2=0x7fc7780d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:18.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.161+0000 7fc77dc00640 1 -- 172.21.15.47:0/2426756817 shutdown_connections 2024-05-27T10:53:18.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.161+0000 7fc77dc00640 1 -- 172.21.15.47:0/2426756817 wait complete. 2024-05-27T10:53:18.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.162+0000 7fc77dc00640 1 Processor -- start 2024-05-27T10:53:18.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.163+0000 7fc77dc00640 1 -- start start 2024-05-27T10:53:18.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.163+0000 7fc77dc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc77806ca40 0x7fc7780c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:18.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.164+0000 7fc77dc00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc77806d240 0x7fc7780b9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:18.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.164+0000 7fc77dc00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc77815eaa0 0x7fc7781555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:18.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.164+0000 7fc77dc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc7780b10a0 con 0x7fc77806ca40 2024-05-27T10:53:18.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.164+0000 7fc77dc00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc77806cf40 con 0x7fc77815eaa0 2024-05-27T10:53:18.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.164+0000 7fc77dc00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc7780b1220 con 0x7fc77806d240 2024-05-27T10:53:18.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.164+0000 7fc777e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc77806ca40 0x7fc7780c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:18.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.164+0000 7fc777e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc77806ca40 0x7fc7780c94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52118/0 (socket says 172.21.15.47:52118) 2024-05-27T10:53:18.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.164+0000 7fc777e00640 1 -- 172.21.15.47:0/2190011941 learned_addr learned my addr 172.21.15.47:0/2190011941 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:18.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.164+0000 7fc777e00640 1 -- 172.21.15.47:0/2190011941 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc77806d240 msgr2=0x7fc7780b9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:18.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.164+0000 7fc777e00640 1 --2- 172.21.15.47:0/2190011941 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc77806d240 0x7fc7780b9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:18.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.164+0000 7fc777e00640 1 -- 172.21.15.47:0/2190011941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc77815eaa0 msgr2=0x7fc7781555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:18.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.164+0000 7fc777e00640 1 --2- 172.21.15.47:0/2190011941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc77815eaa0 0x7fc7781555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:18.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.164+0000 7fc777e00640 1 -- 172.21.15.47:0/2190011941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7780c86f0 con 0x7fc77806ca40 2024-05-27T10:53:18.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.164+0000 7fc777e00640 1 --2- 172.21.15.47:0/2190011941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc77806ca40 0x7fc7780c94b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc7680098c0 tx=0x7fc7680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:18.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.165+0000 7fc76fe00640 1 -- 172.21.15.47:0/2190011941 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc768037040 con 0x7fc77806ca40 2024-05-27T10:53:18.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.165+0000 7fc76fe00640 1 -- 172.21.15.47:0/2190011941 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc768030500 con 0x7fc77806ca40 2024-05-27T10:53:18.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.165+0000 7fc76fe00640 1 -- 172.21.15.47:0/2190011941 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7680308d0 con 0x7fc77806ca40 2024-05-27T10:53:18.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.165+0000 7fc77dc00640 1 -- 172.21.15.47:0/2190011941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7780c89d0 con 0x7fc77806ca40 2024-05-27T10:53:18.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.165+0000 7fc77dc00640 1 -- 172.21.15.47:0/2190011941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7780b9e60 con 0x7fc77806ca40 2024-05-27T10:53:18.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.166+0000 7fc77dc00640 1 -- 172.21.15.47:0/2190011941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7780d0820 con 0x7fc77806ca40 2024-05-27T10:53:18.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.167+0000 7fc76fe00640 1 -- 172.21.15.47:0/2190011941 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc768044020 con 0x7fc77806ca40 2024-05-27T10:53:18.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.168+0000 7fc76fe00640 1 --2- 172.21.15.47:0/2190011941 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc75806c8f0 0x7fc75806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:18.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.168+0000 7fc76fe00640 1 -- 172.21.15.47:0/2190011941 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fc7680aba70 con 0x7fc77806ca40 2024-05-27T10:53:18.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.168+0000 7fc777400640 1 --2- 172.21.15.47:0/2190011941 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc75806c8f0 0x7fc75806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:18.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.169+0000 7fc777400640 1 --2- 172.21.15.47:0/2190011941 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc75806c8f0 0x7fc75806edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc764000fb0 tx=0x7fc7640079c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:18.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.172+0000 7fc76fe00640 1 -- 172.21.15.47:0/2190011941 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc7780d0820 con 0x7fc77806ca40 2024-05-27T10:53:18.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.452+0000 7fc77dc00640 1 -- 172.21.15.47:0/2190011941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fc77804fce0 con 0x7fc77806ca40 2024-05-27T10:53:18.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.456+0000 7fc76fe00640 1 -- 172.21.15.47:0/2190011941 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7fc76807a1f0 con 0x7fc77806ca40 2024-05-27T10:53:18.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.459+0000 7fc77dc00640 1 -- 172.21.15.47:0/2190011941 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc75806c8f0 msgr2=0x7fc75806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:18.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.459+0000 7fc77dc00640 1 --2- 172.21.15.47:0/2190011941 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc75806c8f0 0x7fc75806edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc764000fb0 tx=0x7fc7640079c0 comp rx=0 tx=0).stop 2024-05-27T10:53:18.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.459+0000 7fc77dc00640 1 -- 172.21.15.47:0/2190011941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc77806ca40 msgr2=0x7fc7780c94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:18.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.459+0000 7fc77dc00640 1 --2- 172.21.15.47:0/2190011941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc77806ca40 0x7fc7780c94b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc7680098c0 tx=0x7fc7680046c0 comp rx=0 tx=0).stop 2024-05-27T10:53:18.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.459+0000 7fc77dc00640 1 -- 172.21.15.47:0/2190011941 shutdown_connections 2024-05-27T10:53:18.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.459+0000 7fc77dc00640 1 --2- 172.21.15.47:0/2190011941 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc75806c8f0 0x7fc75806edb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:18.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.459+0000 7fc77dc00640 1 --2- 172.21.15.47:0/2190011941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc77815eaa0 0x7fc7781555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:18.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.459+0000 7fc77dc00640 1 --2- 172.21.15.47:0/2190011941 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc77806d240 0x7fc7780b9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:18.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.459+0000 7fc77dc00640 1 --2- 172.21.15.47:0/2190011941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc77806ca40 0x7fc7780c94b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:18.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.459+0000 7fc77dc00640 1 -- 172.21.15.47:0/2190011941 >> 172.21.15.47:0/2190011941 conn(0x7fc77808bfd0 msgr2=0x7fc7780b58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:18.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.459+0000 7fc77dc00640 1 -- 172.21.15.47:0/2190011941 shutdown_connections 2024-05-27T10:53:18.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.459+0000 7fc77dc00640 1 -- 172.21.15.47:0/2190011941 wait complete. 2024-05-27T10:53:18.477 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:53:18.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.692+0000 7fee28a00640 1 Processor -- start 2024-05-27T10:53:18.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.692+0000 7fee28a00640 1 -- start start 2024-05-27T10:53:18.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.693+0000 7fee28a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fee24161ff0 0x7fee240d2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:18.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.693+0000 7fee28a00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fee2406cab0 0x7fee2406cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:18.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.693+0000 7fee28a00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee240d1c10 con 0x7fee240b34c0 2024-05-27T10:53:18.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.693+0000 7fee28a00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fee240d3630 con 0x7fee2406cab0 2024-05-27T10:53:18.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.693+0000 7fee28a00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fee240cf790 con 0x7fee24161ff0 2024-05-27T10:53:18.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.694+0000 7fee21e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fee24161ff0 0x7fee240d2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:18.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.694+0000 7fee21e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fee24161ff0 0x7fee240d2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:48774/0 (socket says 172.21.15.47:48774) 2024-05-27T10:53:18.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.694+0000 7fee21e00640 1 -- 172.21.15.47:0/3053340520 learned_addr learned my addr 172.21.15.47:0/3053340520 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:18.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.694+0000 7fee22800640 1 --2- 172.21.15.47:0/3053340520 >> v2:172.21.15.53:3300/0 conn(0x7fee2406cab0 0x7fee2406cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:18.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.695+0000 7fee21e00640 1 -- 172.21.15.47:0/3053340520 >> v2:172.21.15.53:3300/0 conn(0x7fee2406cab0 msgr2=0x7fee2406cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:18.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.695+0000 7fee21e00640 1 --2- 172.21.15.47:0/3053340520 >> v2:172.21.15.53:3300/0 conn(0x7fee2406cab0 0x7fee2406cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:18.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.695+0000 7fee21e00640 1 -- 172.21.15.47:0/3053340520 >> v1:172.21.15.53:6789/0 conn(0x7fee240b34c0 legacy=0x7fee240d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:18.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.695+0000 7fee21e00640 1 -- 172.21.15.47:0/3053340520 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee240cfa70 con 0x7fee24161ff0 2024-05-27T10:53:18.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.695+0000 7fee22800640 1 --2- 172.21.15.47:0/3053340520 >> v2:172.21.15.53:3300/0 conn(0x7fee2406cab0 0x7fee2406cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:53:18.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.696+0000 7fee21e00640 1 --2- 172.21.15.47:0/3053340520 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fee24161ff0 0x7fee240d2f70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fee14009870 tx=0x7fee1402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3197af2ef47e66c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:18.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.697+0000 7fee21400640 1 -- 172.21.15.47:0/3053340520 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14037070 con 0x7fee24161ff0 2024-05-27T10:53:18.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.697+0000 7fee21400640 1 -- 172.21.15.47:0/3053340520 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee14032440 con 0x7fee24161ff0 2024-05-27T10:53:18.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.697+0000 7fee21400640 1 -- 172.21.15.47:0/3053340520 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14032810 con 0x7fee24161ff0 2024-05-27T10:53:18.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.698+0000 7fee28a00640 1 -- 172.21.15.47:0/3053340520 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fee24161ff0 msgr2=0x7fee240d2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:18.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.698+0000 7fee28a00640 1 --2- 172.21.15.47:0/3053340520 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fee24161ff0 0x7fee240d2f70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fee14009870 tx=0x7fee1402a270 comp rx=0 tx=0).stop 2024-05-27T10:53:18.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.698+0000 7fee28a00640 1 -- 172.21.15.47:0/3053340520 shutdown_connections 2024-05-27T10:53:18.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.698+0000 7fee28a00640 1 --2- 172.21.15.47:0/3053340520 >> v2:172.21.15.53:3300/0 conn(0x7fee2406cab0 0x7fee2406cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:18.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.698+0000 7fee28a00640 1 --2- 172.21.15.47:0/3053340520 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fee24161ff0 0x7fee240d2f70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:18.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.698+0000 7fee28a00640 1 -- 172.21.15.47:0/3053340520 >> 172.21.15.47:0/3053340520 conn(0x7fee2408bfd0 msgr2=0x7fee240d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:18.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.698+0000 7fee28a00640 1 -- 172.21.15.47:0/3053340520 shutdown_connections 2024-05-27T10:53:18.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.698+0000 7fee28a00640 1 -- 172.21.15.47:0/3053340520 wait complete. 2024-05-27T10:53:18.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.700+0000 7fee28a00640 1 Processor -- start 2024-05-27T10:53:18.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.700+0000 7fee28a00640 1 -- start start 2024-05-27T10:53:18.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.701+0000 7fee28a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fee2406cab0 0x7fee240ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:18.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.701+0000 7fee28a00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee240b34c0 0x7fee241593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:18.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.701+0000 7fee28a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee24161ff0 0x7fee240d0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:18.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.701+0000 7fee28a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fee240cf3b0 con 0x7fee24161ff0 2024-05-27T10:53:18.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.701+0000 7fee28a00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fee241623d0 con 0x7fee240b34c0 2024-05-27T10:53:18.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.701+0000 7fee28a00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fee240cf530 con 0x7fee2406cab0 2024-05-27T10:53:18.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.701+0000 7fee22800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee24161ff0 0x7fee240d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:18.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.701+0000 7fee22800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee24161ff0 0x7fee240d0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52126/0 (socket says 172.21.15.47:52126) 2024-05-27T10:53:18.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.701+0000 7fee22800640 1 -- 172.21.15.47:0/2565728479 learned_addr learned my addr 172.21.15.47:0/2565728479 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:18.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.701+0000 7fee21e00640 1 --2- 172.21.15.47:0/2565728479 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fee2406cab0 0x7fee240ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:18.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.702+0000 7fee19400640 1 --2- 172.21.15.47:0/2565728479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee240b34c0 0x7fee241593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:18.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.702+0000 7fee22800640 1 -- 172.21.15.47:0/2565728479 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fee2406cab0 msgr2=0x7fee240ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:18.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.702+0000 7fee22800640 1 --2- 172.21.15.47:0/2565728479 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fee2406cab0 0x7fee240ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:18.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.702+0000 7fee22800640 1 -- 172.21.15.47:0/2565728479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee240b34c0 msgr2=0x7fee241593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:18.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.702+0000 7fee22800640 1 --2- 172.21.15.47:0/2565728479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee240b34c0 0x7fee241593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:18.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.702+0000 7fee22800640 1 -- 172.21.15.47:0/2565728479 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee240cd4d0 con 0x7fee24161ff0 2024-05-27T10:53:18.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.702+0000 7fee19400640 1 --2- 172.21.15.47:0/2565728479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee240b34c0 0x7fee241593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:18.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.702+0000 7fee22800640 1 --2- 172.21.15.47:0/2565728479 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee24161ff0 0x7fee240d0590 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fee1c007df0 tx=0x7fee1c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:18.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.702+0000 7fee1aa00640 1 -- 172.21.15.47:0/2565728479 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c01a070 con 0x7fee24161ff0 2024-05-27T10:53:18.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.702+0000 7fee1aa00640 1 -- 172.21.15.47:0/2565728479 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1c003990 con 0x7fee24161ff0 2024-05-27T10:53:18.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.702+0000 7fee28a00640 1 -- 172.21.15.47:0/2565728479 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee240cd7b0 con 0x7fee24161ff0 2024-05-27T10:53:18.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.702+0000 7fee1aa00640 1 -- 172.21.15.47:0/2565728479 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c003d80 con 0x7fee24161ff0 2024-05-27T10:53:18.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.702+0000 7fee28a00640 1 -- 172.21.15.47:0/2565728479 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee240cdd70 con 0x7fee24161ff0 2024-05-27T10:53:18.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.703+0000 7fee28a00640 1 -- 172.21.15.47:0/2565728479 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee240690f0 con 0x7fee24161ff0 2024-05-27T10:53:18.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.705+0000 7fee1aa00640 1 -- 172.21.15.47:0/2565728479 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fee1c01d070 con 0x7fee24161ff0 2024-05-27T10:53:18.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.706+0000 7fee1aa00640 1 --2- 172.21.15.47:0/2565728479 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fee0006c8f0 0x7fee0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:18.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.706+0000 7fee1aa00640 1 -- 172.21.15.47:0/2565728479 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fee1c08ba60 con 0x7fee24161ff0 2024-05-27T10:53:18.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.706+0000 7fee21e00640 1 --2- 172.21.15.47:0/2565728479 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fee0006c8f0 0x7fee0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:18.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.707+0000 7fee21e00640 1 --2- 172.21.15.47:0/2565728479 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fee0006c8f0 0x7fee0006edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fee14034000 tx=0x7fee1402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:18.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.710+0000 7fee1aa00640 1 -- 172.21.15.47:0/2565728479 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fee1c010070 con 0x7fee24161ff0 2024-05-27T10:53:18.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.924+0000 7fee28a00640 1 -- 172.21.15.47:0/2565728479 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fee240b5a10 con 0x7fee24161ff0 2024-05-27T10:53:18.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.926+0000 7fee1aa00640 1 -- 172.21.15.47:0/2565728479 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+12807 (secure 0 0 0) 0x7fee1c05a1d0 con 0x7fee24161ff0 2024-05-27T10:53:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:53:18.927 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":29,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:53:14.772220+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:53:18.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.929+0000 7fee28a00640 1 -- 172.21.15.47:0/2565728479 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fee0006c8f0 msgr2=0x7fee0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:18.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.929+0000 7fee28a00640 1 --2- 172.21.15.47:0/2565728479 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fee0006c8f0 0x7fee0006edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fee14034000 tx=0x7fee1402e000 comp rx=0 tx=0).stop 2024-05-27T10:53:18.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.929+0000 7fee28a00640 1 -- 172.21.15.47:0/2565728479 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee24161ff0 msgr2=0x7fee240d0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:18.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.929+0000 7fee28a00640 1 --2- 172.21.15.47:0/2565728479 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee24161ff0 0x7fee240d0590 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fee1c007df0 tx=0x7fee1c00d4a0 comp rx=0 tx=0).stop 2024-05-27T10:53:18.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.929+0000 7fee28a00640 1 -- 172.21.15.47:0/2565728479 shutdown_connections 2024-05-27T10:53:18.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.929+0000 7fee28a00640 1 --2- 172.21.15.47:0/2565728479 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fee0006c8f0 0x7fee0006edb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:18.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.929+0000 7fee28a00640 1 --2- 172.21.15.47:0/2565728479 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee24161ff0 0x7fee240d0590 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:18.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.929+0000 7fee28a00640 1 --2- 172.21.15.47:0/2565728479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee240b34c0 0x7fee241593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:18.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.929+0000 7fee28a00640 1 --2- 172.21.15.47:0/2565728479 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fee2406cab0 0x7fee240ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:18.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.929+0000 7fee28a00640 1 -- 172.21.15.47:0/2565728479 >> 172.21.15.47:0/2565728479 conn(0x7fee2408bfd0 msgr2=0x7fee240b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:18.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.929+0000 7fee28a00640 1 -- 172.21.15.47:0/2565728479 shutdown_connections 2024-05-27T10:53:18.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:18.929+0000 7fee28a00640 1 -- 172.21.15.47:0/2565728479 wait complete. 2024-05-27T10:53:18.946 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T10:51:55.073251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T10:53:18.947 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T10:53:19.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.166+0000 7f7c03200640 1 Processor -- start 2024-05-27T10:53:19.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.166+0000 7f7c03200640 1 -- start start 2024-05-27T10:53:19.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.167+0000 7f7c03200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7c0415e6c0 0x7f7c040d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:19.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.167+0000 7f7c03200640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7c04162ef0 0x7f7c040d2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:19.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.167+0000 7f7c03200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c0406cc30 con 0x7f7c04160020 2024-05-27T10:53:19.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.167+0000 7f7c03200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f7c0406d560 con 0x7f7c0415e6c0 2024-05-27T10:53:19.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.167+0000 7f7c03200640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f7c0406cf10 con 0x7f7c04162ef0 2024-05-27T10:53:19.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.168+0000 7f7c01e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7c0415e6c0 0x7f7c040d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:19.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.168+0000 7f7c01e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7c0415e6c0 0x7f7c040d4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52134/0 (socket says 172.21.15.47:52134) 2024-05-27T10:53:19.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.168+0000 7f7c01e00640 1 -- 172.21.15.47:0/930114078 learned_addr learned my addr 172.21.15.47:0/930114078 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:19.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.168+0000 7f7c02800640 1 --1- 172.21.15.47:0/930114078 >> v1:172.21.15.47:6789/0 conn(0x7f7c04160020 0x7f7c040b3040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35306/0 (socket says 172.21.15.47:35306) 2024-05-27T10:53:19.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.168+0000 7f7c01400640 1 --2- 172.21.15.47:0/930114078 >> v2:172.21.15.53:3300/0 conn(0x7f7c04162ef0 0x7f7c040d2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:19.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.168+0000 7f7c01e00640 1 -- 172.21.15.47:0/930114078 >> v2:172.21.15.53:3300/0 conn(0x7f7c04162ef0 msgr2=0x7f7c040d2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:19.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.168+0000 7f7c01e00640 1 --2- 172.21.15.47:0/930114078 >> v2:172.21.15.53:3300/0 conn(0x7f7c04162ef0 0x7f7c040d2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:19.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.168+0000 7f7c01e00640 1 -- 172.21.15.47:0/930114078 >> v1:172.21.15.47:6789/0 conn(0x7f7c04160020 legacy=0x7f7c040b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:19.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.168+0000 7f7c01e00640 1 -- 172.21.15.47:0/930114078 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0406d1f0 con 0x7f7c0415e6c0 2024-05-27T10:53:19.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.169+0000 7f7c01e00640 1 --2- 172.21.15.47:0/930114078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c0415e6c0 0x7f7c040d4bc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7c040d1f80 tx=0x7f7bf402a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1345710a1b1f2f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:19.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.170+0000 7f7c00a00640 1 -- 172.21.15.47:0/930114078 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4037070 con 0x7f7c0415e6c0 2024-05-27T10:53:19.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.170+0000 7f7c00a00640 1 -- 172.21.15.47:0/930114078 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bf4032440 con 0x7f7c0415e6c0 2024-05-27T10:53:19.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.170+0000 7f7c00a00640 1 -- 172.21.15.47:0/930114078 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4032810 con 0x7f7c0415e6c0 2024-05-27T10:53:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.170+0000 7f7c03200640 1 -- 172.21.15.47:0/930114078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c0415e6c0 msgr2=0x7f7c040d4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.170+0000 7f7c03200640 1 --2- 172.21.15.47:0/930114078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c0415e6c0 0x7f7c040d4bc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7c040d1f80 tx=0x7f7bf402a280 comp rx=0 tx=0).stop 2024-05-27T10:53:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.170+0000 7f7c03200640 1 -- 172.21.15.47:0/930114078 shutdown_connections 2024-05-27T10:53:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.170+0000 7f7c03200640 1 --2- 172.21.15.47:0/930114078 >> v2:172.21.15.53:3300/0 conn(0x7f7c04162ef0 0x7f7c040d2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.170+0000 7f7c03200640 1 --2- 172.21.15.47:0/930114078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c0415e6c0 0x7f7c040d4bc0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.170+0000 7f7c03200640 1 -- 172.21.15.47:0/930114078 >> 172.21.15.47:0/930114078 conn(0x7f7c0408bfd0 msgr2=0x7f7c040d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.171+0000 7f7c03200640 1 -- 172.21.15.47:0/930114078 shutdown_connections 2024-05-27T10:53:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.171+0000 7f7c03200640 1 -- 172.21.15.47:0/930114078 wait complete. 2024-05-27T10:53:19.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.172+0000 7f7c03200640 1 Processor -- start 2024-05-27T10:53:19.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.173+0000 7f7c03200640 1 -- start start 2024-05-27T10:53:19.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.173+0000 7f7c03200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c0415e6c0 0x7f7c0414f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:19.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.174+0000 7f7c03200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c04160020 0x7f7c040c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:19.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.174+0000 7f7c03200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c04162ef0 0x7f7c040cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:19.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.174+0000 7f7c03200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7c040d30c0 con 0x7f7c04160020 2024-05-27T10:53:19.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.174+0000 7f7c03200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7c040d2f40 con 0x7f7c04162ef0 2024-05-27T10:53:19.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.174+0000 7f7c03200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f7c040d3240 con 0x7f7c0415e6c0 2024-05-27T10:53:19.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.174+0000 7f7c01400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c04160020 0x7f7c040c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:19.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.174+0000 7f7c01400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c04160020 0x7f7c040c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52136/0 (socket says 172.21.15.47:52136) 2024-05-27T10:53:19.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.174+0000 7f7c01400640 1 -- 172.21.15.47:0/14714035 learned_addr learned my addr 172.21.15.47:0/14714035 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:19.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.174+0000 7f7c01e00640 1 --2- 172.21.15.47:0/14714035 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c0415e6c0 0x7f7c0414f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:19.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.174+0000 7f7c02800640 1 --2- 172.21.15.47:0/14714035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c04162ef0 0x7f7c040cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:19.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.174+0000 7f7c01400640 1 -- 172.21.15.47:0/14714035 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c0415e6c0 msgr2=0x7f7c0414f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:19.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.174+0000 7f7c01400640 1 --2- 172.21.15.47:0/14714035 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c0415e6c0 0x7f7c0414f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:19.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.174+0000 7f7c01400640 1 -- 172.21.15.47:0/14714035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c04162ef0 msgr2=0x7f7c040cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:19.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.174+0000 7f7c01400640 1 --2- 172.21.15.47:0/14714035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c04162ef0 0x7f7c040cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:19.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.174+0000 7f7c01400640 1 -- 172.21.15.47:0/14714035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c040cae60 con 0x7f7c04160020 2024-05-27T10:53:19.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.174+0000 7f7c02800640 1 --2- 172.21.15.47:0/14714035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c04162ef0 0x7f7c040cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:19.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.175+0000 7f7c01400640 1 --2- 172.21.15.47:0/14714035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c04160020 0x7f7c040c7e80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00d620 tx=0x7f7bec00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:19.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.175+0000 7f7bfa000640 1 -- 172.21.15.47:0/14714035 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec00b620 con 0x7f7c04160020 2024-05-27T10:53:19.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.175+0000 7f7bfa000640 1 -- 172.21.15.47:0/14714035 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bec019070 con 0x7f7c04160020 2024-05-27T10:53:19.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.175+0000 7f7bfa000640 1 -- 172.21.15.47:0/14714035 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec00ba00 con 0x7f7c04160020 2024-05-27T10:53:19.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.175+0000 7f7c03200640 1 -- 172.21.15.47:0/14714035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c040ca5c0 con 0x7f7c04160020 2024-05-27T10:53:19.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.175+0000 7f7c03200640 1 -- 172.21.15.47:0/14714035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c040cab80 con 0x7f7c04160020 2024-05-27T10:53:19.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.176+0000 7f7c03200640 1 -- 172.21.15.47:0/14714035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c0404fce0 con 0x7f7c04160020 2024-05-27T10:53:19.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.178+0000 7f7bfa000640 1 -- 172.21.15.47:0/14714035 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7bec00bba0 con 0x7f7c04160020 2024-05-27T10:53:19.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.178+0000 7f7bfa000640 1 --2- 172.21.15.47:0/14714035 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7be006c920 0x7f7be006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:19.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.179+0000 7f7bfa000640 1 -- 172.21.15.47:0/14714035 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f7bec08bc40 con 0x7f7c04160020 2024-05-27T10:53:19.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.179+0000 7f7c01e00640 1 --2- 172.21.15.47:0/14714035 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7be006c920 0x7f7be006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:19.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.179+0000 7f7c01e00640 1 --2- 172.21.15.47:0/14714035 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7be006c920 0x7f7be006ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4034000 tx=0x7f7bf402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:19.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.184+0000 7f7bfa000640 1 -- 172.21.15.47:0/14714035 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7bec05a320 con 0x7f7c04160020 2024-05-27T10:53:19.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.391+0000 7f7c03200640 1 -- 172.21.15.47:0/14714035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7c040d36c0 con 0x7f7c04160020 2024-05-27T10:53:19.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.391+0000 7f7bfa000640 1 -- 172.21.15.47:0/14714035 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f7bec059c20 con 0x7f7c04160020 2024-05-27T10:53:19.389 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-27T10:53:19.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.394+0000 7f7c03200640 1 -- 172.21.15.47:0/14714035 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7be006c920 msgr2=0x7f7be006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:19.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.394+0000 7f7c03200640 1 --2- 172.21.15.47:0/14714035 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7be006c920 0x7f7be006ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4034000 tx=0x7f7bf402e000 comp rx=0 tx=0).stop 2024-05-27T10:53:19.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.394+0000 7f7c03200640 1 -- 172.21.15.47:0/14714035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c04160020 msgr2=0x7f7c040c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:19.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.394+0000 7f7c03200640 1 --2- 172.21.15.47:0/14714035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c04160020 0x7f7c040c7e80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00d620 tx=0x7f7bec00dae0 comp rx=0 tx=0).stop 2024-05-27T10:53:19.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.394+0000 7f7c03200640 1 -- 172.21.15.47:0/14714035 shutdown_connections 2024-05-27T10:53:19.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.394+0000 7f7c03200640 1 --2- 172.21.15.47:0/14714035 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f7be006c920 0x7f7be006ede0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:19.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.394+0000 7f7c03200640 1 --2- 172.21.15.47:0/14714035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c04162ef0 0x7f7c040cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:19.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.394+0000 7f7c03200640 1 --2- 172.21.15.47:0/14714035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c04160020 0x7f7c040c7e80 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:19.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.394+0000 7f7c03200640 1 --2- 172.21.15.47:0/14714035 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c0415e6c0 0x7f7c0414f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:19.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.394+0000 7f7c03200640 1 -- 172.21.15.47:0/14714035 >> 172.21.15.47:0/14714035 conn(0x7f7c0408bfd0 msgr2=0x7f7c040d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:19.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.395+0000 7f7c03200640 1 -- 172.21.15.47:0/14714035 shutdown_connections 2024-05-27T10:53:19.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.395+0000 7f7c03200640 1 -- 172.21.15.47:0/14714035 wait complete. 2024-05-27T10:53:19.410 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-27T10:53:19.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.622+0000 7fc8dda00640 1 Processor -- start 2024-05-27T10:53:19.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.622+0000 7fc8dda00640 1 -- start start 2024-05-27T10:53:19.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.623+0000 7fc8dda00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc8d8072d40 0x7fc8d815f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:19.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.623+0000 7fc8dda00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc8d80d0700 0x7fc8d80d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:19.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.623+0000 7fc8dda00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8d806dd50 con 0x7fc8d806f6c0 2024-05-27T10:53:19.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.623+0000 7fc8dda00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc8d80d1070 con 0x7fc8d8072d40 2024-05-27T10:53:19.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.623+0000 7fc8dda00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fc8d806e030 con 0x7fc8d80d0700 2024-05-27T10:53:19.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.624+0000 7fc8d6000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc8d8072d40 0x7fc8d815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:19.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.624+0000 7fc8d6000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc8d8072d40 0x7fc8d815f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52140/0 (socket says 172.21.15.47:52140) 2024-05-27T10:53:19.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.624+0000 7fc8d6000640 1 -- 172.21.15.47:0/2138394941 learned_addr learned my addr 172.21.15.47:0/2138394941 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:19.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.624+0000 7fc8d7400640 1 --2- 172.21.15.47:0/2138394941 >> v2:172.21.15.53:3300/0 conn(0x7fc8d80d0700 0x7fc8d80d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:19.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.624+0000 7fc8d6000640 1 -- 172.21.15.47:0/2138394941 >> v2:172.21.15.53:3300/0 conn(0x7fc8d80d0700 msgr2=0x7fc8d80d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:19.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.624+0000 7fc8d6000640 1 --2- 172.21.15.47:0/2138394941 >> v2:172.21.15.53:3300/0 conn(0x7fc8d80d0700 0x7fc8d80d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:19.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.624+0000 7fc8d6000640 1 -- 172.21.15.47:0/2138394941 >> v1:172.21.15.53:6789/0 conn(0x7fc8d806f6c0 legacy=0x7fc8d80738f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:19.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.625+0000 7fc8d6000640 1 -- 172.21.15.47:0/2138394941 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d806e310 con 0x7fc8d8072d40 2024-05-27T10:53:19.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.626+0000 7fc8d6000640 1 --2- 172.21.15.47:0/2138394941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8d8072d40 0x7fc8d815f060 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc8d815ba70 tx=0x7fc8c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60ab5bb9a1b4936 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:19.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.626+0000 7fc8d5600640 1 -- 172.21.15.47:0/2138394941 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4037070 con 0x7fc8d8072d40 2024-05-27T10:53:19.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.626+0000 7fc8d5600640 1 -- 172.21.15.47:0/2138394941 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c4032440 con 0x7fc8d8072d40 2024-05-27T10:53:19.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.626+0000 7fc8d5600640 1 -- 172.21.15.47:0/2138394941 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4032810 con 0x7fc8d8072d40 2024-05-27T10:53:19.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.627+0000 7fc8dda00640 1 -- 172.21.15.47:0/2138394941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8d8072d40 msgr2=0x7fc8d815f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:19.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.627+0000 7fc8dda00640 1 --2- 172.21.15.47:0/2138394941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8d8072d40 0x7fc8d815f060 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc8d815ba70 tx=0x7fc8c402a270 comp rx=0 tx=0).stop 2024-05-27T10:53:19.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.627+0000 7fc8dda00640 1 -- 172.21.15.47:0/2138394941 shutdown_connections 2024-05-27T10:53:19.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.627+0000 7fc8dda00640 1 --2- 172.21.15.47:0/2138394941 >> v2:172.21.15.53:3300/0 conn(0x7fc8d80d0700 0x7fc8d80d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:19.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.627+0000 7fc8dda00640 1 --2- 172.21.15.47:0/2138394941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8d8072d40 0x7fc8d815f060 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:19.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.627+0000 7fc8dda00640 1 -- 172.21.15.47:0/2138394941 >> 172.21.15.47:0/2138394941 conn(0x7fc8d806bd60 msgr2=0x7fc8d806c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:19.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.627+0000 7fc8dda00640 1 -- 172.21.15.47:0/2138394941 shutdown_connections 2024-05-27T10:53:19.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.627+0000 7fc8dda00640 1 -- 172.21.15.47:0/2138394941 wait complete. 2024-05-27T10:53:19.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.629+0000 7fc8dda00640 1 Processor -- start 2024-05-27T10:53:19.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.629+0000 7fc8dda00640 1 -- start start 2024-05-27T10:53:19.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.630+0000 7fc8dda00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8d806f6c0 0x7fc8d814b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:19.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.630+0000 7fc8dda00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8d8072d40 0x7fc8d8151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:19.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.630+0000 7fc8dda00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc8d80d0700 0x7fc8d8152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:19.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.630+0000 7fc8dda00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d815bbe0 con 0x7fc8d806f6c0 2024-05-27T10:53:19.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.630+0000 7fc8dda00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d806e8d0 con 0x7fc8d8072d40 2024-05-27T10:53:19.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.630+0000 7fc8dda00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc8d815bd60 con 0x7fc8d80d0700 2024-05-27T10:53:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.630+0000 7fc8d6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8d806f6c0 0x7fc8d814b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.630+0000 7fc8d6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8d806f6c0 0x7fc8d814b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52144/0 (socket says 172.21.15.47:52144) 2024-05-27T10:53:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.630+0000 7fc8d6a00640 1 -- 172.21.15.47:0/2463580620 learned_addr learned my addr 172.21.15.47:0/2463580620 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.630+0000 7fc8d6a00640 1 -- 172.21.15.47:0/2463580620 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc8d80d0700 msgr2=0x7fc8d8152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.630+0000 7fc8d6a00640 1 --2- 172.21.15.47:0/2463580620 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc8d80d0700 0x7fc8d8152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.630+0000 7fc8d6a00640 1 -- 172.21.15.47:0/2463580620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8d8072d40 msgr2=0x7fc8d8151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.630+0000 7fc8d6a00640 1 --2- 172.21.15.47:0/2463580620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8d8072d40 0x7fc8d8151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:19.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.630+0000 7fc8d6a00640 1 -- 172.21.15.47:0/2463580620 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d80c9df0 con 0x7fc8d806f6c0 2024-05-27T10:53:19.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.631+0000 7fc8d6a00640 1 --2- 172.21.15.47:0/2463580620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8d806f6c0 0x7fc8d814b830 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800c450 tx=0x7fc8c800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:19.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.631+0000 7fc8cea00640 1 -- 172.21.15.47:0/2463580620 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8017070 con 0x7fc8d806f6c0 2024-05-27T10:53:19.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.631+0000 7fc8cea00640 1 -- 172.21.15.47:0/2463580620 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c80052d0 con 0x7fc8d806f6c0 2024-05-27T10:53:19.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.631+0000 7fc8cea00640 1 -- 172.21.15.47:0/2463580620 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8003830 con 0x7fc8d806f6c0 2024-05-27T10:53:19.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.631+0000 7fc8dda00640 1 -- 172.21.15.47:0/2463580620 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d80ca070 con 0x7fc8d806f6c0 2024-05-27T10:53:19.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.631+0000 7fc8dda00640 1 -- 172.21.15.47:0/2463580620 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d80ca630 con 0x7fc8d806f6c0 2024-05-27T10:53:19.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.633+0000 7fc8dda00640 1 -- 172.21.15.47:0/2463580620 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d80689e0 con 0x7fc8d806f6c0 2024-05-27T10:53:19.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.634+0000 7fc8cea00640 1 -- 172.21.15.47:0/2463580620 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc8c801a070 con 0x7fc8d806f6c0 2024-05-27T10:53:19.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.634+0000 7fc8cea00640 1 --2- 172.21.15.47:0/2463580620 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc8b806c920 0x7fc8b806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:19.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.634+0000 7fc8cea00640 1 -- 172.21.15.47:0/2463580620 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fc8c808ab00 con 0x7fc8d806f6c0 2024-05-27T10:53:19.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.635+0000 7fc8d6000640 1 --2- 172.21.15.47:0/2463580620 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc8b806c920 0x7fc8b806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:19.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.635+0000 7fc8d6000640 1 --2- 172.21.15.47:0/2463580620 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc8b806c920 0x7fc8b806ede0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4034000 tx=0x7fc8c402c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:19.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.639+0000 7fc8cea00640 1 -- 172.21.15.47:0/2463580620 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc8d80c9df0 con 0x7fc8d806f6c0 2024-05-27T10:53:19.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.845+0000 7fc8dda00640 1 -- 172.21.15.47:0/2463580620 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc8d8072b20 con 0x7fc8d806f6c0 2024-05-27T10:53:19.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.846+0000 7fc8cea00640 1 -- 172.21.15.47:0/2463580620 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) ==== 84+0+65 (secure 0 0 0) 0x7fc8c8059280 con 0x7fc8d806f6c0 2024-05-27T10:53:19.844 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:53:19.844 INFO:teuthology.orchestra.run.smithi047.stdout:[ 2024-05-27T10:53:19.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:19.844 INFO:teuthology.orchestra.run.smithi047.stdout: "poolnum": 1, 2024-05-27T10:53:19.844 INFO:teuthology.orchestra.run.smithi047.stdout: "poolname": ".mgr" 2024-05-27T10:53:19.844 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:19.845 INFO:teuthology.orchestra.run.smithi047.stdout:] 2024-05-27T10:53:19.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.848+0000 7fc8dda00640 1 -- 172.21.15.47:0/2463580620 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc8b806c920 msgr2=0x7fc8b806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:19.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.848+0000 7fc8dda00640 1 --2- 172.21.15.47:0/2463580620 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc8b806c920 0x7fc8b806ede0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4034000 tx=0x7fc8c402c000 comp rx=0 tx=0).stop 2024-05-27T10:53:19.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.848+0000 7fc8dda00640 1 -- 172.21.15.47:0/2463580620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8d806f6c0 msgr2=0x7fc8d814b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:19.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.848+0000 7fc8dda00640 1 --2- 172.21.15.47:0/2463580620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8d806f6c0 0x7fc8d814b830 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800c450 tx=0x7fc8c800c910 comp rx=0 tx=0).stop 2024-05-27T10:53:19.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.849+0000 7fc8dda00640 1 -- 172.21.15.47:0/2463580620 shutdown_connections 2024-05-27T10:53:19.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.849+0000 7fc8dda00640 1 --2- 172.21.15.47:0/2463580620 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fc8b806c920 0x7fc8b806ede0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:19.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.849+0000 7fc8dda00640 1 --2- 172.21.15.47:0/2463580620 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc8d80d0700 0x7fc8d8152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:19.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.849+0000 7fc8dda00640 1 --2- 172.21.15.47:0/2463580620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8d8072d40 0x7fc8d8151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:19.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.849+0000 7fc8dda00640 1 --2- 172.21.15.47:0/2463580620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8d806f6c0 0x7fc8d814b830 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:19.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.849+0000 7fc8dda00640 1 -- 172.21.15.47:0/2463580620 >> 172.21.15.47:0/2463580620 conn(0x7fc8d806bd60 msgr2=0x7fc8d815e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:19.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.849+0000 7fc8dda00640 1 -- 172.21.15.47:0/2463580620 shutdown_connections 2024-05-27T10:53:19.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:19.849+0000 7fc8dda00640 1 -- 172.21.15.47:0/2463580620 wait complete. 2024-05-27T10:53:19.864 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-27T10:53:19.865 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-27T10:53:20.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.085+0000 7f422fe00640 1 Processor -- start 2024-05-27T10:53:20.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.086+0000 7f422fe00640 1 -- start start 2024-05-27T10:53:20.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.087+0000 7f422fe00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f423015e990 0x7f42300d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:20.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.087+0000 7f422fe00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f42300d1210 0x7f42300d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:20.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.087+0000 7f422fe00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42300cefa0 con 0x7f423015e5b0 2024-05-27T10:53:20.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.087+0000 7f422fe00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f42300d1790 con 0x7f42300d1210 2024-05-27T10:53:20.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.087+0000 7f422fe00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f42300cf240 con 0x7f423015e990 2024-05-27T10:53:20.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.088+0000 7f422ea00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f423015e5b0 0x7f42300cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35310/0 (socket says 172.21.15.47:35310) 2024-05-27T10:53:20.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.088+0000 7f422ea00640 1 -- 172.21.15.47:0/4152581172 learned_addr learned my addr 172.21.15.47:0/4152581172 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:20.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.088+0000 7f422e000640 1 --2- 172.21.15.47:0/4152581172 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f423015e990 0x7f42300d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:20.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.088+0000 7f422f400640 1 --2- 172.21.15.47:0/4152581172 >> v2:172.21.15.53:3300/0 conn(0x7f42300d1210 0x7f42300d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:20.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.088+0000 7f422d600640 1 -- 172.21.15.47:0/4152581172 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3678721689 0 0) 0x7f42300cefa0 con 0x7f423015e5b0 2024-05-27T10:53:20.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.088+0000 7f422d600640 1 -- 172.21.15.47:0/4152581172 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4214003520 con 0x7f423015e5b0 2024-05-27T10:53:20.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.089+0000 7f422d600640 1 -- 172.21.15.47:0/4152581172 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3775828703 0 0) 0x7f4214003520 con 0x7f423015e5b0 2024-05-27T10:53:20.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.089+0000 7f422d600640 1 -- 172.21.15.47:0/4152581172 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f423015e990 msgr2=0x7f42300d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:20.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.089+0000 7f422d600640 1 --2- 172.21.15.47:0/4152581172 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f423015e990 0x7f42300d0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:20.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.089+0000 7f422d600640 1 -- 172.21.15.47:0/4152581172 >> v2:172.21.15.53:3300/0 conn(0x7f42300d1210 msgr2=0x7f42300d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:20.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.089+0000 7f422d600640 1 --2- 172.21.15.47:0/4152581172 >> v2:172.21.15.53:3300/0 conn(0x7f42300d1210 0x7f42300d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:20.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.089+0000 7f422d600640 1 -- 172.21.15.47:0/4152581172 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42300cf520 con 0x7f423015e5b0 2024-05-27T10:53:20.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.089+0000 7f422d600640 1 -- 172.21.15.47:0/4152581172 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f4220001690 con 0x7f423015e5b0 2024-05-27T10:53:20.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.089+0000 7f422d600640 1 -- 172.21.15.47:0/4152581172 >> v1:172.21.15.47:6789/0 conn(0x7f423015e5b0 legacy=0x7f42300cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:20.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.089+0000 7f422d600640 1 --2- 172.21.15.47:0/4152581172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42140039b0 0x7f4214003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:20.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.089+0000 7f422d600640 1 --2- 172.21.15.47:0/4152581172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4214004800 0x7f4214004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:20.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.089+0000 7f422d600640 1 --2- 172.21.15.47:0/4152581172 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f423015e990 0x7f42140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:20.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.089+0000 7f422d600640 1 -- 172.21.15.47:0/4152581172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f42300d1790 con 0x7f4214004800 2024-05-27T10:53:20.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.089+0000 7f422d600640 1 -- 172.21.15.47:0/4152581172 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f42300cf240 con 0x7f42140039b0 2024-05-27T10:53:20.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.089+0000 7f422d600640 1 -- 172.21.15.47:0/4152581172 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f421400ba10 con 0x7f423015e990 2024-05-27T10:53:20.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.089+0000 7f422e000640 1 --2- 172.21.15.47:0/4152581172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4214004800 0x7f4214004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:20.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.089+0000 7f422ea00640 1 --2- 172.21.15.47:0/4152581172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42140039b0 0x7f4214003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:20.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.090+0000 7f422f400640 1 --2- 172.21.15.47:0/4152581172 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f423015e990 0x7f42140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:20.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.090+0000 7f422e000640 1 -- 172.21.15.47:0/4152581172 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f423015e990 msgr2=0x7f42140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:20.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.090+0000 7f422e000640 1 --2- 172.21.15.47:0/4152581172 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f423015e990 0x7f42140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:20.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.090+0000 7f422e000640 1 -- 172.21.15.47:0/4152581172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42140039b0 msgr2=0x7f4214003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:20.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.090+0000 7f422e000640 1 --2- 172.21.15.47:0/4152581172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42140039b0 0x7f4214003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:20.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.090+0000 7f422e000640 1 -- 172.21.15.47:0/4152581172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4214003520 con 0x7f4214004800 2024-05-27T10:53:20.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.090+0000 7f422f400640 1 --2- 172.21.15.47:0/4152581172 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f423015e990 0x7f42140051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:20.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.091+0000 7f422e000640 1 --2- 172.21.15.47:0/4152581172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4214004800 0x7f4214004c80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f421c009af0 tx=0x7f4214005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb77d4c882b1af1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:20.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.091+0000 7f422d600640 1 -- 172.21.15.47:0/4152581172 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c036070 con 0x7f4214004800 2024-05-27T10:53:20.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.091+0000 7f422d600640 1 -- 172.21.15.47:0/4152581172 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f421c031400 con 0x7f4214004800 2024-05-27T10:53:20.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.091+0000 7f422d600640 1 -- 172.21.15.47:0/4152581172 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c009690 con 0x7f4214004800 2024-05-27T10:53:20.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.092+0000 7f422fe00640 1 -- 172.21.15.47:0/4152581172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4214004800 msgr2=0x7f4214004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:20.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.092+0000 7f422fe00640 1 --2- 172.21.15.47:0/4152581172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4214004800 0x7f4214004c80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f421c009af0 tx=0x7f4214005830 comp rx=0 tx=0).stop 2024-05-27T10:53:20.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.092+0000 7f422f400640 1 -- 172.21.15.47:0/4152581172 reap_dead start 2024-05-27T10:53:20.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.092+0000 7f422fe00640 1 -- 172.21.15.47:0/4152581172 shutdown_connections 2024-05-27T10:53:20.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.092+0000 7f422fe00640 1 -- 172.21.15.47:0/4152581172 >> 172.21.15.47:0/4152581172 conn(0x7f423009d850 msgr2=0x7f423008bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:20.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.092+0000 7f422fe00640 1 -- 172.21.15.47:0/4152581172 shutdown_connections 2024-05-27T10:53:20.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.092+0000 7f422fe00640 1 -- 172.21.15.47:0/4152581172 wait complete. 2024-05-27T10:53:20.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.094+0000 7f422fe00640 1 Processor -- start 2024-05-27T10:53:20.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.094+0000 7f422fe00640 1 -- start start 2024-05-27T10:53:20.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.095+0000 7f422fe00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4214004800 0x7f42300b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:20.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.095+0000 7f422fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4230148700 0x7f4230148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:20.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.095+0000 7f422fe00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4230160ee0 0x7f4230161340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:20.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.095+0000 7f422fe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f42300d0cd0 con 0x7f4230148700 2024-05-27T10:53:20.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.095+0000 7f422fe00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f42301631a0 con 0x7f4214004800 2024-05-27T10:53:20.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.095+0000 7f422fe00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f42300d0e50 con 0x7f4230160ee0 2024-05-27T10:53:20.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.095+0000 7f422e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4230148700 0x7f4230148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:20.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.095+0000 7f422e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4230148700 0x7f4230148b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52164/0 (socket says 172.21.15.47:52164) 2024-05-27T10:53:20.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.095+0000 7f422e000640 1 -- 172.21.15.47:0/688061356 learned_addr learned my addr 172.21.15.47:0/688061356 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:20.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.096+0000 7f422ea00640 1 --2- 172.21.15.47:0/688061356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4214004800 0x7f42300b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:20.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.096+0000 7f422f400640 1 --2- 172.21.15.47:0/688061356 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4230160ee0 0x7f4230161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:20.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.096+0000 7f422e000640 1 -- 172.21.15.47:0/688061356 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4230160ee0 msgr2=0x7f4230161340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:20.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.096+0000 7f422e000640 1 --2- 172.21.15.47:0/688061356 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4230160ee0 0x7f4230161340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:20.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.096+0000 7f422e000640 1 -- 172.21.15.47:0/688061356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4214004800 msgr2=0x7f42300b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:20.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.096+0000 7f422e000640 1 --2- 172.21.15.47:0/688061356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4214004800 0x7f42300b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:20.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.096+0000 7f422e000640 1 -- 172.21.15.47:0/688061356 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42300c7f00 con 0x7f4230148700 2024-05-27T10:53:20.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.096+0000 7f422e000640 1 --2- 172.21.15.47:0/688061356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4230148700 0x7f4230148b80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f421c000c00 tx=0x7f421c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:20.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.097+0000 7f4226a00640 1 -- 172.21.15.47:0/688061356 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c036070 con 0x7f4230148700 2024-05-27T10:53:20.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.097+0000 7f4226a00640 1 -- 172.21.15.47:0/688061356 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f421c041070 con 0x7f4230148700 2024-05-27T10:53:20.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.097+0000 7f4226a00640 1 -- 172.21.15.47:0/688061356 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c0315b0 con 0x7f4230148700 2024-05-27T10:53:20.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.097+0000 7f422fe00640 1 -- 172.21.15.47:0/688061356 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42300c81e0 con 0x7f4230148700 2024-05-27T10:53:20.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.097+0000 7f422fe00640 1 -- 172.21.15.47:0/688061356 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42300c87a0 con 0x7f4230148700 2024-05-27T10:53:20.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.098+0000 7f422fe00640 1 -- 172.21.15.47:0/688061356 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4230161880 con 0x7f4230148700 2024-05-27T10:53:20.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.099+0000 7f4226a00640 1 -- 172.21.15.47:0/688061356 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f421c031770 con 0x7f4230148700 2024-05-27T10:53:20.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.100+0000 7f4226a00640 1 --2- 172.21.15.47:0/688061356 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f421006c920 0x7f421006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:20.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.100+0000 7f4226a00640 1 -- 172.21.15.47:0/688061356 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f421c0ab600 con 0x7f4230148700 2024-05-27T10:53:20.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.100+0000 7f422ea00640 1 --2- 172.21.15.47:0/688061356 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f421006c920 0x7f421006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:20.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.101+0000 7f422ea00640 1 --2- 172.21.15.47:0/688061356 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f421006c920 0x7f421006ede0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4220000c00 tx=0x7f4220009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:20.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.104+0000 7f4226a00640 1 -- 172.21.15.47:0/688061356 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f421c04a020 con 0x7f4230148700 2024-05-27T10:53:20.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.316+0000 7f422fe00640 1 -- 172.21.15.47:0/688061356 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f423004fce0 con 0x7f4230148700 2024-05-27T10:53:20.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.797+0000 7f4226a00640 1 -- 172.21.15.47:0/688061356 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) ==== 138+0+0 (secure 0 0 0) 0x7f421c079ce0 con 0x7f4230148700 2024-05-27T10:53:20.796 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' created 2024-05-27T10:53:20.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.802+0000 7f422fe00640 1 -- 172.21.15.47:0/688061356 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f421006c920 msgr2=0x7f421006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:20.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.802+0000 7f422fe00640 1 --2- 172.21.15.47:0/688061356 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f421006c920 0x7f421006ede0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4220000c00 tx=0x7f4220009040 comp rx=0 tx=0).stop 2024-05-27T10:53:20.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.802+0000 7f422fe00640 1 -- 172.21.15.47:0/688061356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4230148700 msgr2=0x7f4230148b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:20.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.802+0000 7f422fe00640 1 --2- 172.21.15.47:0/688061356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4230148700 0x7f4230148b80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f421c000c00 tx=0x7f421c004730 comp rx=0 tx=0).stop 2024-05-27T10:53:20.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.802+0000 7f422fe00640 1 -- 172.21.15.47:0/688061356 shutdown_connections 2024-05-27T10:53:20.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.802+0000 7f422fe00640 1 --2- 172.21.15.47:0/688061356 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f421006c920 0x7f421006ede0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:20.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.802+0000 7f422fe00640 1 --2- 172.21.15.47:0/688061356 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4230160ee0 0x7f4230161340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:20.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.802+0000 7f422fe00640 1 --2- 172.21.15.47:0/688061356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4230148700 0x7f4230148b80 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:20.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.802+0000 7f422fe00640 1 --2- 172.21.15.47:0/688061356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4214004800 0x7f42300b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:20.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.802+0000 7f422fe00640 1 -- 172.21.15.47:0/688061356 >> 172.21.15.47:0/688061356 conn(0x7f423009d850 msgr2=0x7f423015c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:20.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.802+0000 7f422fe00640 1 -- 172.21.15.47:0/688061356 shutdown_connections 2024-05-27T10:53:20.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:20.802+0000 7f422fe00640 1 -- 172.21.15.47:0/688061356 wait complete. 2024-05-27T10:53:20.825 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-27T10:53:21.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.032+0000 7f3bc0c00640 1 Processor -- start 2024-05-27T10:53:21.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.032+0000 7f3bc0c00640 1 -- start start 2024-05-27T10:53:21.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.034+0000 7f3bc0c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3bbc09b6c0 0x7f3bbc09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:21.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.034+0000 7f3bc0c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bbc09bc80 con 0x7f3bbc0b1a80 2024-05-27T10:53:21.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.034+0000 7f3bc0c00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bbc15f5a0 con 0x7f3bbc09af80 2024-05-27T10:53:21.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.034+0000 7f3bc0c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3bbc09b3d0 con 0x7f3bbc09b6c0 2024-05-27T10:53:21.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.034+0000 7f3bb9e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f3bbc0b1a80 0x7f3bbc06cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35874/0 (socket says 172.21.15.47:35874) 2024-05-27T10:53:21.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.034+0000 7f3bb9e00640 1 -- 172.21.15.47:0/1802338481 learned_addr learned my addr 172.21.15.47:0/1802338481 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:21.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.035+0000 7f3bb1400640 1 --2- 172.21.15.47:0/1802338481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3bbc09b6c0 0x7f3bbc09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:21.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.035+0000 7f3bb9400640 1 -- 172.21.15.47:0/1802338481 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 951580583 0 0) 0x7f3bbc09bc80 con 0x7f3bbc0b1a80 2024-05-27T10:53:21.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.035+0000 7f3bb9400640 1 -- 172.21.15.47:0/1802338481 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ba0003520 con 0x7f3bbc0b1a80 2024-05-27T10:53:21.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.035+0000 7f3bb9400640 1 -- 172.21.15.47:0/1802338481 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3347308860 0 0) 0x7f3ba0003520 con 0x7f3bbc0b1a80 2024-05-27T10:53:21.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.035+0000 7f3bb9400640 1 -- 172.21.15.47:0/1802338481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3bbc09b6c0 msgr2=0x7f3bbc09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:21.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.035+0000 7f3bb9400640 1 --2- 172.21.15.47:0/1802338481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3bbc09b6c0 0x7f3bbc09aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:21.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.035+0000 7f3bb9400640 1 -- 172.21.15.47:0/1802338481 >> v1:172.21.15.53:6789/0 conn(0x7f3bbc09af80 legacy=0x7f3bbc0d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:21.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.035+0000 7f3bb9400640 1 -- 172.21.15.47:0/1802338481 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bbc15f880 con 0x7f3bbc0b1a80 2024-05-27T10:53:21.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.036+0000 7f3bb9400640 1 -- 172.21.15.47:0/1802338481 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f3bac001670 con 0x7f3bbc0b1a80 2024-05-27T10:53:21.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.036+0000 7f3bb9400640 1 -- 172.21.15.47:0/1802338481 >> v1:172.21.15.47:6789/0 conn(0x7f3bbc0b1a80 legacy=0x7f3bbc06cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:21.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.036+0000 7f3bb9400640 1 --2- 172.21.15.47:0/1802338481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3bbc09b6c0 0x7f3ba00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:21.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.036+0000 7f3bb9400640 1 --2- 172.21.15.47:0/1802338481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ba0003fd0 0x7f3ba0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:21.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.036+0000 7f3bb9400640 1 --2- 172.21.15.47:0/1802338481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba0004d40 0x7f3ba00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:21.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.036+0000 7f3bb9400640 1 -- 172.21.15.47:0/1802338481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3bbc09b3d0 con 0x7f3ba0003fd0 2024-05-27T10:53:21.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.036+0000 7f3bb9400640 1 -- 172.21.15.47:0/1802338481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba000bb80 con 0x7f3ba0004d40 2024-05-27T10:53:21.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.036+0000 7f3bb9400640 1 -- 172.21.15.47:0/1802338481 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3ba000bd80 con 0x7f3bbc09b6c0 2024-05-27T10:53:21.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.036+0000 7f3bb1400640 1 --2- 172.21.15.47:0/1802338481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ba0003fd0 0x7f3ba0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:21.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.037+0000 7f3bb9e00640 1 --2- 172.21.15.47:0/1802338481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3bbc09b6c0 0x7f3ba00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:21.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.037+0000 7f3bb1400640 1 -- 172.21.15.47:0/1802338481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3bbc09b6c0 msgr2=0x7f3ba00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:21.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.037+0000 7f3bba800640 1 --2- 172.21.15.47:0/1802338481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba0004d40 0x7f3ba00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:21.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.037+0000 7f3bb1400640 1 --2- 172.21.15.47:0/1802338481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3bbc09b6c0 0x7f3ba00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:21.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.037+0000 7f3bb1400640 1 -- 172.21.15.47:0/1802338481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba0004d40 msgr2=0x7f3ba00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:21.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.037+0000 7f3bb1400640 1 --2- 172.21.15.47:0/1802338481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba0004d40 0x7f3ba00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:21.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.037+0000 7f3bb1400640 1 -- 172.21.15.47:0/1802338481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba0003520 con 0x7f3ba0003fd0 2024-05-27T10:53:21.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.037+0000 7f3bb9e00640 1 --2- 172.21.15.47:0/1802338481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3bbc09b6c0 0x7f3ba00039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:21.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.037+0000 7f3bba800640 1 --2- 172.21.15.47:0/1802338481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba0004d40 0x7f3ba00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:21.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.038+0000 7f3bb1400640 1 --2- 172.21.15.47:0/1802338481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ba0003fd0 0x7f3ba0004800 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400ba30 tx=0x7f3ba0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7cec123ae9cae43 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:21.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.038+0000 7f3bb9400640 1 -- 172.21.15.47:0/1802338481 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4030070 con 0x7f3ba0003fd0 2024-05-27T10:53:21.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.038+0000 7f3bb9400640 1 -- 172.21.15.47:0/1802338481 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ba402ade0 con 0x7f3ba0003fd0 2024-05-27T10:53:21.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.038+0000 7f3bb9400640 1 -- 172.21.15.47:0/1802338481 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba400b600 con 0x7f3ba0003fd0 2024-05-27T10:53:21.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.039+0000 7f3bc0c00640 1 -- 172.21.15.47:0/1802338481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ba0003fd0 msgr2=0x7f3ba0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:21.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.039+0000 7f3bc0c00640 1 --2- 172.21.15.47:0/1802338481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ba0003fd0 0x7f3ba0004800 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400ba30 tx=0x7f3ba0005830 comp rx=0 tx=0).stop 2024-05-27T10:53:21.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.039+0000 7f3bba800640 1 -- 172.21.15.47:0/1802338481 reap_dead start 2024-05-27T10:53:21.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.039+0000 7f3bc0c00640 1 -- 172.21.15.47:0/1802338481 shutdown_connections 2024-05-27T10:53:21.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.039+0000 7f3bc0c00640 1 -- 172.21.15.47:0/1802338481 >> 172.21.15.47:0/1802338481 conn(0x7f3bbc0b40c0 msgr2=0x7f3bbc0b44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:21.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.039+0000 7f3bc0c00640 1 -- 172.21.15.47:0/1802338481 shutdown_connections 2024-05-27T10:53:21.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.039+0000 7f3bc0c00640 1 -- 172.21.15.47:0/1802338481 wait complete. 2024-05-27T10:53:21.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.041+0000 7f3bc0c00640 1 Processor -- start 2024-05-27T10:53:21.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.041+0000 7f3bc0c00640 1 -- start start 2024-05-27T10:53:21.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.042+0000 7f3bc0c00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba0003fd0 0x7f3bbc15b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:21.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.042+0000 7f3bc0c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bbc15d1c0 0x7f3bbc1f7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:21.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.042+0000 7f3bc0c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3bbc1f8440 0x7f3bbc152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:21.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.042+0000 7f3bc0c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3bbc160080 con 0x7f3bbc15d1c0 2024-05-27T10:53:21.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.042+0000 7f3bc0c00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3bbc15fbf0 con 0x7f3ba0003fd0 2024-05-27T10:53:21.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.042+0000 7f3bc0c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3bbc160200 con 0x7f3bbc1f8440 2024-05-27T10:53:21.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.043+0000 7f3bb1400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bbc15d1c0 0x7f3bbc1f7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:21.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.043+0000 7f3bb1400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bbc15d1c0 0x7f3bbc1f7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54918/0 (socket says 172.21.15.47:54918) 2024-05-27T10:53:21.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.043+0000 7f3bb1400640 1 -- 172.21.15.47:0/2425155707 learned_addr learned my addr 172.21.15.47:0/2425155707 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:21.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.043+0000 7f3bba800640 1 --2- 172.21.15.47:0/2425155707 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3bbc1f8440 0x7f3bbc152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:21.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.043+0000 7f3bb1400640 1 -- 172.21.15.47:0/2425155707 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3bbc1f8440 msgr2=0x7f3bbc152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:21.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.043+0000 7f3bb1400640 1 --2- 172.21.15.47:0/2425155707 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3bbc1f8440 0x7f3bbc152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:21.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.043+0000 7f3bb1400640 1 -- 172.21.15.47:0/2425155707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba0003fd0 msgr2=0x7f3bbc15b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:21.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.043+0000 7f3bb1400640 1 --2- 172.21.15.47:0/2425155707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba0003fd0 0x7f3bbc15b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:21.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.043+0000 7f3bb1400640 1 -- 172.21.15.47:0/2425155707 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bbc15be00 con 0x7f3bbc15d1c0 2024-05-27T10:53:21.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.043+0000 7f3bba800640 1 --2- 172.21.15.47:0/2425155707 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3bbc1f8440 0x7f3bbc152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:21.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.043+0000 7f3bb1400640 1 --2- 172.21.15.47:0/2425155707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bbc15d1c0 0x7f3bbc1f7f00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3ba402a8d0 tx=0x7f3ba40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:21.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.044+0000 7f3bb2a00640 1 -- 172.21.15.47:0/2425155707 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4043030 con 0x7f3bbc15d1c0 2024-05-27T10:53:21.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.044+0000 7f3bb2a00640 1 -- 172.21.15.47:0/2425155707 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ba402abe0 con 0x7f3bbc15d1c0 2024-05-27T10:53:21.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.044+0000 7f3bb2a00640 1 -- 172.21.15.47:0/2425155707 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba400b600 con 0x7f3bbc15d1c0 2024-05-27T10:53:21.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.044+0000 7f3bc0c00640 1 -- 172.21.15.47:0/2425155707 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bbc15c0e0 con 0x7f3bbc15d1c0 2024-05-27T10:53:21.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.044+0000 7f3bc0c00640 1 -- 172.21.15.47:0/2425155707 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bbc15c6a0 con 0x7f3bbc15d1c0 2024-05-27T10:53:21.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.045+0000 7f3bc0c00640 1 -- 172.21.15.47:0/2425155707 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bbc1f8850 con 0x7f3bbc15d1c0 2024-05-27T10:53:21.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.047+0000 7f3bb2a00640 1 -- 172.21.15.47:0/2425155707 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3ba4046070 con 0x7f3bbc15d1c0 2024-05-27T10:53:21.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.048+0000 7f3bb2a00640 1 --2- 172.21.15.47:0/2425155707 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3b9806c920 0x7f3b9806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:21.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.048+0000 7f3bb2a00640 1 -- 172.21.15.47:0/2425155707 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7f3ba40acb50 con 0x7f3bbc15d1c0 2024-05-27T10:53:21.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.048+0000 7f3bb9e00640 1 --2- 172.21.15.47:0/2425155707 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3b9806c920 0x7f3b9806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:21.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.049+0000 7f3bb9e00640 1 --2- 172.21.15.47:0/2425155707 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3b9806c920 0x7f3b9806ede0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc15b580 tx=0x7f3bac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:21.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.052+0000 7f3bb2a00640 1 -- 172.21.15.47:0/2425155707 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3bbc1f8850 con 0x7f3bbc15d1c0 2024-05-27T10:53:21.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.259+0000 7f3bc0c00640 1 -- 172.21.15.47:0/2425155707 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3bbc0a06b0 con 0x7f3bbc15d1c0 2024-05-27T10:53:21.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.812+0000 7f3bb2a00640 1 -- 172.21.15.47:0/2425155707 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) ==== 170+0+0 (secure 0 0 0) 0x7f3ba407b140 con 0x7f3bbc15d1c0 2024-05-27T10:53:21.811 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' created 2024-05-27T10:53:21.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.816+0000 7f3bc0c00640 1 -- 172.21.15.47:0/2425155707 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3b9806c920 msgr2=0x7f3b9806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:21.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.816+0000 7f3bc0c00640 1 --2- 172.21.15.47:0/2425155707 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3b9806c920 0x7f3b9806ede0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc15b580 tx=0x7f3bac009040 comp rx=0 tx=0).stop 2024-05-27T10:53:21.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.816+0000 7f3bc0c00640 1 -- 172.21.15.47:0/2425155707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bbc15d1c0 msgr2=0x7f3bbc1f7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:21.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.816+0000 7f3bc0c00640 1 --2- 172.21.15.47:0/2425155707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bbc15d1c0 0x7f3bbc1f7f00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3ba402a8d0 tx=0x7f3ba40046c0 comp rx=0 tx=0).stop 2024-05-27T10:53:21.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.817+0000 7f3bc0c00640 1 -- 172.21.15.47:0/2425155707 shutdown_connections 2024-05-27T10:53:21.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.817+0000 7f3bc0c00640 1 --2- 172.21.15.47:0/2425155707 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f3b9806c920 0x7f3b9806ede0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:21.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.817+0000 7f3bc0c00640 1 --2- 172.21.15.47:0/2425155707 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3bbc1f8440 0x7f3bbc152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:21.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.817+0000 7f3bc0c00640 1 --2- 172.21.15.47:0/2425155707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bbc15d1c0 0x7f3bbc1f7f00 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:21.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.817+0000 7f3bc0c00640 1 --2- 172.21.15.47:0/2425155707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba0003fd0 0x7f3bbc15b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:21.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.817+0000 7f3bc0c00640 1 -- 172.21.15.47:0/2425155707 >> 172.21.15.47:0/2425155707 conn(0x7f3bbc0b40c0 msgr2=0x7f3bbc070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:21.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.819+0000 7f3bc0c00640 1 -- 172.21.15.47:0/2425155707 shutdown_connections 2024-05-27T10:53:21.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:21.819+0000 7f3bc0c00640 1 -- 172.21.15.47:0/2425155707 wait complete. 2024-05-27T10:53:21.855 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-27T10:53:22.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.039+0000 7fb5d1200640 1 Processor -- start 2024-05-27T10:53:22.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.040+0000 7fb5d1200640 1 -- start start 2024-05-27T10:53:22.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.041+0000 7fb5d1200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb5cc06da80 0x7fb5cc0d0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:22.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.041+0000 7fb5d1200640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb5cc0d0860 0x7fb5cc0ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:22.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.041+0000 7fb5d1200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5cc0d0c70 con 0x7fb5cc15c510 2024-05-27T10:53:22.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.041+0000 7fb5d1200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb5cc0b43e0 con 0x7fb5cc06da80 2024-05-27T10:53:22.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.041+0000 7fb5d1200640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fb5cc0b4620 con 0x7fb5cc0d0860 2024-05-27T10:53:22.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.042+0000 7fb5c3e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb5cc06da80 0x7fb5cc0d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:22.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.042+0000 7fb5c3e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb5cc06da80 0x7fb5cc0d0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54930/0 (socket says 172.21.15.47:54930) 2024-05-27T10:53:22.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.042+0000 7fb5c3e00640 1 -- 172.21.15.47:0/1996510343 learned_addr learned my addr 172.21.15.47:0/1996510343 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:22.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.042+0000 7fb5cb400640 1 --1- 172.21.15.47:0/1996510343 >> v1:172.21.15.47:6789/0 conn(0x7fb5cc15c510 0x7fb5cc0b3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35876/0 (socket says 172.21.15.47:35876) 2024-05-27T10:53:22.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.042+0000 7fb5cbe00640 1 --2- 172.21.15.47:0/1996510343 >> v2:172.21.15.53:3300/0 conn(0x7fb5cc0d0860 0x7fb5cc0ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:22.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.042+0000 7fb5c3e00640 1 -- 172.21.15.47:0/1996510343 >> v2:172.21.15.53:3300/0 conn(0x7fb5cc0d0860 msgr2=0x7fb5cc0ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:22.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.042+0000 7fb5c3e00640 1 --2- 172.21.15.47:0/1996510343 >> v2:172.21.15.53:3300/0 conn(0x7fb5cc0d0860 0x7fb5cc0ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:22.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.042+0000 7fb5c3e00640 1 -- 172.21.15.47:0/1996510343 >> v1:172.21.15.47:6789/0 conn(0x7fb5cc15c510 legacy=0x7fb5cc0b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:22.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.042+0000 7fb5c3e00640 1 -- 172.21.15.47:0/1996510343 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5cc0b4900 con 0x7fb5cc06da80 2024-05-27T10:53:22.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.042+0000 7fb5cbe00640 1 --2- 172.21.15.47:0/1996510343 >> v2:172.21.15.53:3300/0 conn(0x7fb5cc0d0860 0x7fb5cc0ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:22.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.043+0000 7fb5c3e00640 1 --2- 172.21.15.47:0/1996510343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5cc06da80 0x7fb5cc0d0320 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc06df10 tx=0x7fb5b402a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2bd4963a7487981 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:22.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.044+0000 7fb5caa00640 1 -- 172.21.15.47:0/1996510343 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4037070 con 0x7fb5cc06da80 2024-05-27T10:53:22.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.044+0000 7fb5caa00640 1 -- 172.21.15.47:0/1996510343 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b4032440 con 0x7fb5cc06da80 2024-05-27T10:53:22.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.044+0000 7fb5caa00640 1 -- 172.21.15.47:0/1996510343 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4032810 con 0x7fb5cc06da80 2024-05-27T10:53:22.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.044+0000 7fb5d1200640 1 -- 172.21.15.47:0/1996510343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5cc06da80 msgr2=0x7fb5cc0d0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:22.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.044+0000 7fb5d1200640 1 --2- 172.21.15.47:0/1996510343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5cc06da80 0x7fb5cc0d0320 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc06df10 tx=0x7fb5b402a280 comp rx=0 tx=0).stop 2024-05-27T10:53:22.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.044+0000 7fb5d1200640 1 -- 172.21.15.47:0/1996510343 shutdown_connections 2024-05-27T10:53:22.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.044+0000 7fb5d1200640 1 --2- 172.21.15.47:0/1996510343 >> v2:172.21.15.53:3300/0 conn(0x7fb5cc0d0860 0x7fb5cc0ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:22.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.044+0000 7fb5d1200640 1 --2- 172.21.15.47:0/1996510343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5cc06da80 0x7fb5cc0d0320 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:22.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.044+0000 7fb5d1200640 1 -- 172.21.15.47:0/1996510343 >> 172.21.15.47:0/1996510343 conn(0x7fb5cc06bb20 msgr2=0x7fb5cc06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:22.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.044+0000 7fb5d1200640 1 -- 172.21.15.47:0/1996510343 shutdown_connections 2024-05-27T10:53:22.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.045+0000 7fb5d1200640 1 -- 172.21.15.47:0/1996510343 wait complete. 2024-05-27T10:53:22.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.046+0000 7fb5d1200640 1 Processor -- start 2024-05-27T10:53:22.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.046+0000 7fb5d1200640 1 -- start start 2024-05-27T10:53:22.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.047+0000 7fb5d1200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5cc06da80 0x7fb5cc14a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:22.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.047+0000 7fb5d1200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb5cc0d0860 0x7fb5cc154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:22.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.047+0000 7fb5d1200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5cc15c510 0x7fb5cc154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:22.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.047+0000 7fb5d1200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc15c8f0 con 0x7fb5cc06da80 2024-05-27T10:53:22.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.047+0000 7fb5d1200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc0b4ec0 con 0x7fb5cc15c510 2024-05-27T10:53:22.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.047+0000 7fb5d1200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb5cc0cef30 con 0x7fb5cc0d0860 2024-05-27T10:53:22.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.048+0000 7fb5cb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5cc06da80 0x7fb5cc14a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:22.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.048+0000 7fb5cb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5cc06da80 0x7fb5cc14a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54944/0 (socket says 172.21.15.47:54944) 2024-05-27T10:53:22.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.048+0000 7fb5cb400640 1 -- 172.21.15.47:0/1549227640 learned_addr learned my addr 172.21.15.47:0/1549227640 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:22.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.048+0000 7fb5c3e00640 1 --2- 172.21.15.47:0/1549227640 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb5cc0d0860 0x7fb5cc154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:22.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.048+0000 7fb5cb400640 1 -- 172.21.15.47:0/1549227640 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb5cc0d0860 msgr2=0x7fb5cc154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:22.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.048+0000 7fb5cb400640 1 --2- 172.21.15.47:0/1549227640 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb5cc0d0860 0x7fb5cc154350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:22.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.048+0000 7fb5cb400640 1 -- 172.21.15.47:0/1549227640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5cc15c510 msgr2=0x7fb5cc154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:22.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.048+0000 7fb5cb400640 1 --2- 172.21.15.47:0/1549227640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5cc15c510 0x7fb5cc154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:22.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.048+0000 7fb5cb400640 1 -- 172.21.15.47:0/1549227640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5cc154e80 con 0x7fb5cc06da80 2024-05-27T10:53:22.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.048+0000 7fb5cb400640 1 --2- 172.21.15.47:0/1549227640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5cc06da80 0x7fb5cc14a7b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00c3c0 tx=0x7fb5bc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:22.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.049+0000 7fb5c3400640 1 -- 172.21.15.47:0/1549227640 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc0074e0 con 0x7fb5cc06da80 2024-05-27T10:53:22.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.049+0000 7fb5c3400640 1 -- 172.21.15.47:0/1549227640 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5bc007680 con 0x7fb5cc06da80 2024-05-27T10:53:22.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.049+0000 7fb5c3400640 1 -- 172.21.15.47:0/1549227640 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc004a00 con 0x7fb5cc06da80 2024-05-27T10:53:22.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.049+0000 7fb5d1200640 1 -- 172.21.15.47:0/1549227640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5cc155160 con 0x7fb5cc06da80 2024-05-27T10:53:22.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.049+0000 7fb5d1200640 1 -- 172.21.15.47:0/1549227640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5cc155720 con 0x7fb5cc06da80 2024-05-27T10:53:22.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.050+0000 7fb5d1200640 1 -- 172.21.15.47:0/1549227640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5cc04fce0 con 0x7fb5cc06da80 2024-05-27T10:53:22.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.051+0000 7fb5c3400640 1 -- 172.21.15.47:0/1549227640 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb5bc01a020 con 0x7fb5cc06da80 2024-05-27T10:53:22.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.052+0000 7fb5c3400640 1 --2- 172.21.15.47:0/1549227640 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb5a806c8f0 0x7fb5a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:22.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.053+0000 7fb5c3400640 1 -- 172.21.15.47:0/1549227640 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5609+0+0 (secure 0 0 0) 0x7fb5bc08b330 con 0x7fb5cc06da80 2024-05-27T10:53:22.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.053+0000 7fb5c3e00640 1 --2- 172.21.15.47:0/1549227640 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb5a806c8f0 0x7fb5a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:22.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.054+0000 7fb5c3e00640 1 --2- 172.21.15.47:0/1549227640 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb5a806c8f0 0x7fb5a806edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4034000 tx=0x7fb5b402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:22.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.058+0000 7fb5c3400640 1 -- 172.21.15.47:0/1549227640 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb5cc0d0c70 con 0x7fb5cc06da80 2024-05-27T10:53:22.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.307+0000 7fb5d1200640 1 -- 172.21.15.47:0/1549227640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb5cc15bd30 con 0x7fb5cc06da80 2024-05-27T10:53:22.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.817+0000 7fb5c3400640 1 -- 172.21.15.47:0/1549227640 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7fb5bc059720 con 0x7fb5cc06da80 2024-05-27T10:53:22.816 INFO:teuthology.orchestra.run.smithi047.stderr:new fs with metadata pool 4 and data pool 5 2024-05-27T10:53:22.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.821+0000 7fb5d1200640 1 -- 172.21.15.47:0/1549227640 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb5a806c8f0 msgr2=0x7fb5a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:22.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.821+0000 7fb5d1200640 1 --2- 172.21.15.47:0/1549227640 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb5a806c8f0 0x7fb5a806edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4034000 tx=0x7fb5b402e000 comp rx=0 tx=0).stop 2024-05-27T10:53:22.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.821+0000 7fb5d1200640 1 -- 172.21.15.47:0/1549227640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5cc06da80 msgr2=0x7fb5cc14a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:22.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.821+0000 7fb5d1200640 1 --2- 172.21.15.47:0/1549227640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5cc06da80 0x7fb5cc14a7b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00c3c0 tx=0x7fb5bc00c880 comp rx=0 tx=0).stop 2024-05-27T10:53:22.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.821+0000 7fb5d1200640 1 -- 172.21.15.47:0/1549227640 shutdown_connections 2024-05-27T10:53:22.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.821+0000 7fb5d1200640 1 --2- 172.21.15.47:0/1549227640 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb5a806c8f0 0x7fb5a806edb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.821+0000 7fb5d1200640 1 --2- 172.21.15.47:0/1549227640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5cc15c510 0x7fb5cc154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.821+0000 7fb5d1200640 1 --2- 172.21.15.47:0/1549227640 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb5cc0d0860 0x7fb5cc154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.821+0000 7fb5d1200640 1 --2- 172.21.15.47:0/1549227640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5cc06da80 0x7fb5cc14a7b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.821+0000 7fb5d1200640 1 -- 172.21.15.47:0/1549227640 >> 172.21.15.47:0/1549227640 conn(0x7fb5cc06bb20 msgr2=0x7fb5cc0b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:22.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.822+0000 7fb5d1200640 1 -- 172.21.15.47:0/1549227640 shutdown_connections 2024-05-27T10:53:22.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:22.822+0000 7fb5d1200640 1 -- 172.21.15.47:0/1549227640 wait complete. 2024-05-27T10:53:22.859 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:53:23.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.042+0000 7f2bbbe00640 1 Processor -- start 2024-05-27T10:53:23.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.042+0000 7f2bbbe00640 1 -- start start 2024-05-27T10:53:23.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.043+0000 7f2bbbe00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bbc15c420 0x7f2bbc071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:23.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.043+0000 7f2bbbe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2bbc0b4ab0 0x7f2bbc0d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:23.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.043+0000 7f2bbbe00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bbc15c800 con 0x7f2bbc073c50 2024-05-27T10:53:23.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.043+0000 7f2bbbe00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2bbc0afc90 con 0x7f2bbc0b4ab0 2024-05-27T10:53:23.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.043+0000 7f2bbbe00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f2bbc0ad2e0 con 0x7f2bbc15c420 2024-05-27T10:53:23.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.044+0000 7f2bba000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2bbc0b4ab0 0x7f2bbc0d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:23.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.044+0000 7f2bba000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2bbc0b4ab0 0x7f2bbc0d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54954/0 (socket says 172.21.15.47:54954) 2024-05-27T10:53:23.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.044+0000 7f2bba000640 1 -- 172.21.15.47:0/1344374340 learned_addr learned my addr 172.21.15.47:0/1344374340 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:23.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.044+0000 7f2bbaa00640 1 --2- 172.21.15.47:0/1344374340 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bbc15c420 0x7f2bbc071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:23.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.044+0000 7f2bba000640 1 -- 172.21.15.47:0/1344374340 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bbc15c420 msgr2=0x7f2bbc071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:23.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.044+0000 7f2bba000640 1 --2- 172.21.15.47:0/1344374340 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bbc15c420 0x7f2bbc071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.044+0000 7f2bba000640 1 -- 172.21.15.47:0/1344374340 >> v1:172.21.15.53:6789/0 conn(0x7f2bbc073c50 legacy=0x7f2bbc0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:23.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.044+0000 7f2bba000640 1 -- 172.21.15.47:0/1344374340 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bbc0ad5c0 con 0x7f2bbc0b4ab0 2024-05-27T10:53:23.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.046+0000 7f2bba000640 1 --2- 172.21.15.47:0/1344374340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bbc0b4ab0 0x7f2bbc0d0360 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8009870 tx=0x7f2ba802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89042a1cbcc319d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:23.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.046+0000 7f2bb9600640 1 -- 172.21.15.47:0/1344374340 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8037070 con 0x7f2bbc0b4ab0 2024-05-27T10:53:23.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.046+0000 7f2bb9600640 1 -- 172.21.15.47:0/1344374340 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba8032440 con 0x7f2bbc0b4ab0 2024-05-27T10:53:23.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.046+0000 7f2bb9600640 1 -- 172.21.15.47:0/1344374340 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8032810 con 0x7f2bbc0b4ab0 2024-05-27T10:53:23.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.047+0000 7f2bbbe00640 1 -- 172.21.15.47:0/1344374340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bbc0b4ab0 msgr2=0x7f2bbc0d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:23.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.047+0000 7f2bbbe00640 1 --2- 172.21.15.47:0/1344374340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bbc0b4ab0 0x7f2bbc0d0360 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8009870 tx=0x7f2ba802a180 comp rx=0 tx=0).stop 2024-05-27T10:53:23.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.047+0000 7f2bbbe00640 1 -- 172.21.15.47:0/1344374340 shutdown_connections 2024-05-27T10:53:23.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.047+0000 7f2bbbe00640 1 --2- 172.21.15.47:0/1344374340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bbc0b4ab0 0x7f2bbc0d0360 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.047+0000 7f2bbbe00640 1 --2- 172.21.15.47:0/1344374340 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bbc15c420 0x7f2bbc071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.047+0000 7f2bbbe00640 1 -- 172.21.15.47:0/1344374340 >> 172.21.15.47:0/1344374340 conn(0x7f2bbc06bb20 msgr2=0x7f2bbc06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:23.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.047+0000 7f2bbbe00640 1 -- 172.21.15.47:0/1344374340 shutdown_connections 2024-05-27T10:53:23.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.047+0000 7f2bbbe00640 1 -- 172.21.15.47:0/1344374340 wait complete. 2024-05-27T10:53:23.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.049+0000 7f2bbbe00640 1 Processor -- start 2024-05-27T10:53:23.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.049+0000 7f2bbbe00640 1 -- start start 2024-05-27T10:53:23.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.050+0000 7f2bbbe00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bbc073c50 0x7f2bbc14d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:23.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.050+0000 7f2bbbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bbc0b4ab0 0x7f2bbc15d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:23.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.050+0000 7f2bbbe00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bbc15c420 0x7f2bbc0727a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:23.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.050+0000 7f2bbbe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc0af8f0 con 0x7f2bbc0b4ab0 2024-05-27T10:53:23.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.050+0000 7f2bbbe00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc0ad8a0 con 0x7f2bbc15c420 2024-05-27T10:53:23.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.050+0000 7f2bbbe00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f2bbc0afa70 con 0x7f2bbc073c50 2024-05-27T10:53:23.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.050+0000 7f2bba000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bbc0b4ab0 0x7f2bbc15d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:23.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.050+0000 7f2bba000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bbc0b4ab0 0x7f2bbc15d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54968/0 (socket says 172.21.15.47:54968) 2024-05-27T10:53:23.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.050+0000 7f2bba000640 1 -- 172.21.15.47:0/128031226 learned_addr learned my addr 172.21.15.47:0/128031226 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:23.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.051+0000 7f2bbaa00640 1 --2- 172.21.15.47:0/128031226 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bbc073c50 0x7f2bbc14d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:23.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.051+0000 7f2bbb400640 1 --2- 172.21.15.47:0/128031226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bbc15c420 0x7f2bbc0727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:23.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.051+0000 7f2bba000640 1 -- 172.21.15.47:0/128031226 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bbc073c50 msgr2=0x7f2bbc14d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:23.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.051+0000 7f2bba000640 1 --2- 172.21.15.47:0/128031226 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bbc073c50 0x7f2bbc14d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.051+0000 7f2bba000640 1 -- 172.21.15.47:0/128031226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bbc15c420 msgr2=0x7f2bbc0727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:23.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.051+0000 7f2bba000640 1 --2- 172.21.15.47:0/128031226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bbc15c420 0x7f2bbc0727a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.051+0000 7f2bba000640 1 -- 172.21.15.47:0/128031226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bbc15d940 con 0x7f2bbc0b4ab0 2024-05-27T10:53:23.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.051+0000 7f2bbaa00640 1 --2- 172.21.15.47:0/128031226 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bbc073c50 0x7f2bbc14d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:23.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.051+0000 7f2bba000640 1 --2- 172.21.15.47:0/128031226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bbc0b4ab0 0x7f2bbc15d400 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8000c00 tx=0x7f2ba80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:23.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.051+0000 7f2bb2a00640 1 -- 172.21.15.47:0/128031226 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8041020 con 0x7f2bbc0b4ab0 2024-05-27T10:53:23.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.052+0000 7f2bb2a00640 1 -- 172.21.15.47:0/128031226 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba80306c0 con 0x7f2bbc0b4ab0 2024-05-27T10:53:23.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.052+0000 7f2bbbe00640 1 -- 172.21.15.47:0/128031226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bbc15dbe0 con 0x7f2bbc0b4ab0 2024-05-27T10:53:23.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.052+0000 7f2bb2a00640 1 -- 172.21.15.47:0/128031226 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8037040 con 0x7f2bbc0b4ab0 2024-05-27T10:53:23.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.052+0000 7f2bbbe00640 1 -- 172.21.15.47:0/128031226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bbc15e1a0 con 0x7f2bbc0b4ab0 2024-05-27T10:53:23.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.053+0000 7f2bbbe00640 1 -- 172.21.15.47:0/128031226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bbc04fce0 con 0x7f2bbc0b4ab0 2024-05-27T10:53:23.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.054+0000 7f2bb2a00640 1 -- 172.21.15.47:0/128031226 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ba8044020 con 0x7f2bbc0b4ab0 2024-05-27T10:53:23.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.055+0000 7f2bb2a00640 1 --2- 172.21.15.47:0/128031226 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2b9c06c8f0 0x7f2b9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:23.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.055+0000 7f2bb2a00640 1 -- 172.21.15.47:0/128031226 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f2ba80ac030 con 0x7f2bbc0b4ab0 2024-05-27T10:53:23.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.055+0000 7f2bbaa00640 1 --2- 172.21.15.47:0/128031226 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2b9c06c8f0 0x7f2b9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:23.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.056+0000 7f2bbaa00640 1 --2- 172.21.15.47:0/128031226 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2b9c06c8f0 0x7f2b9c06edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2bac006fd0 tx=0x7f2bac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:23.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.059+0000 7f2bb2a00640 1 -- 172.21.15.47:0/128031226 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2ba804b070 con 0x7f2bbc0b4ab0 2024-05-27T10:53:23.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.261+0000 7f2bbbe00640 1 -- 172.21.15.47:0/128031226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2bbc073a30 con 0x7f2bbc0b4ab0 2024-05-27T10:53:23.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.263+0000 7f2bb2a00640 1 -- 172.21.15.47:0/128031226 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16598 (secure 0 0 0) 0x7f2ba807a460 con 0x7f2bbc0b4ab0 2024-05-27T10:53:23.261 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:53:23.261 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":32,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:53:22.309066+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:53:20.334553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-27T10:53:21.277355+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:53:23.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.265+0000 7f2bbbe00640 1 -- 172.21.15.47:0/128031226 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2b9c06c8f0 msgr2=0x7f2b9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:23.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.265+0000 7f2bbbe00640 1 --2- 172.21.15.47:0/128031226 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2b9c06c8f0 0x7f2b9c06edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2bac006fd0 tx=0x7f2bac008040 comp rx=0 tx=0).stop 2024-05-27T10:53:23.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.265+0000 7f2bbbe00640 1 -- 172.21.15.47:0/128031226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bbc0b4ab0 msgr2=0x7f2bbc15d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:23.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.265+0000 7f2bbbe00640 1 --2- 172.21.15.47:0/128031226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bbc0b4ab0 0x7f2bbc15d400 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8000c00 tx=0x7f2ba80046c0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.265+0000 7f2bbbe00640 1 -- 172.21.15.47:0/128031226 shutdown_connections 2024-05-27T10:53:23.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.265+0000 7f2bbbe00640 1 --2- 172.21.15.47:0/128031226 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f2b9c06c8f0 0x7f2b9c06edb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.265+0000 7f2bbbe00640 1 --2- 172.21.15.47:0/128031226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bbc15c420 0x7f2bbc0727a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.265+0000 7f2bbbe00640 1 --2- 172.21.15.47:0/128031226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bbc0b4ab0 0x7f2bbc15d400 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.265+0000 7f2bbbe00640 1 --2- 172.21.15.47:0/128031226 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bbc073c50 0x7f2bbc14d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.265+0000 7f2bbbe00640 1 -- 172.21.15.47:0/128031226 >> 172.21.15.47:0/128031226 conn(0x7f2bbc06bb20 msgr2=0x7f2bbc06f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:23.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.265+0000 7f2bbbe00640 1 -- 172.21.15.47:0/128031226 shutdown_connections 2024-05-27T10:53:23.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.266+0000 7f2bbbe00640 1 -- 172.21.15.47:0/128031226 wait complete. 2024-05-27T10:53:23.282 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:53:23.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.483+0000 7fd786600640 1 Processor -- start 2024-05-27T10:53:23.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.484+0000 7fd786600640 1 -- start start 2024-05-27T10:53:23.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.485+0000 7fd786600640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd78015e8c0 0x7fd78009b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:23.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.485+0000 7fd786600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7800d0a10 con 0x7fd78006db70 2024-05-27T10:53:23.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.485+0000 7fd786600640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7800d0cf0 con 0x7fd7800d0530 2024-05-27T10:53:23.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.485+0000 7fd786600640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fd78009b990 con 0x7fd78015e8c0 2024-05-27T10:53:23.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.486+0000 7fd785c00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd78006db70 0x7fd7800cc940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35884/0 (socket says 172.21.15.47:35884) 2024-05-27T10:53:23.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.486+0000 7fd785c00640 1 -- 172.21.15.47:0/914802414 learned_addr learned my addr 172.21.15.47:0/914802414 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:23.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.486+0000 7fd785200640 1 --2- 172.21.15.47:0/914802414 >> v2:172.21.15.53:3300/0 conn(0x7fd78015e8c0 0x7fd78009b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:23.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.486+0000 7fd77f400640 1 -- 172.21.15.47:0/914802414 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 502196321 0 0) 0x7fd7800d0a10 con 0x7fd78006db70 2024-05-27T10:53:23.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.486+0000 7fd77f400640 1 -- 172.21.15.47:0/914802414 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd768003520 con 0x7fd78006db70 2024-05-27T10:53:23.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.487+0000 7fd77f400640 1 -- 172.21.15.47:0/914802414 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2944195307 0 0) 0x7fd768003520 con 0x7fd78006db70 2024-05-27T10:53:23.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.487+0000 7fd77f400640 1 -- 172.21.15.47:0/914802414 >> v2:172.21.15.53:3300/0 conn(0x7fd78015e8c0 msgr2=0x7fd78009b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:23.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.487+0000 7fd77f400640 1 --2- 172.21.15.47:0/914802414 >> v2:172.21.15.53:3300/0 conn(0x7fd78015e8c0 0x7fd78009b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.487+0000 7fd77f400640 1 -- 172.21.15.47:0/914802414 >> v1:172.21.15.53:6789/0 conn(0x7fd7800d0530 legacy=0x7fd78006d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:23.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.487+0000 7fd77f400640 1 -- 172.21.15.47:0/914802414 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7800d0fd0 con 0x7fd78006db70 2024-05-27T10:53:23.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.487+0000 7fd77f400640 1 -- 172.21.15.47:0/914802414 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7fd7780019f0 con 0x7fd78006db70 2024-05-27T10:53:23.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.487+0000 7fd77f400640 1 -- 172.21.15.47:0/914802414 >> v1:172.21.15.47:6789/0 conn(0x7fd78006db70 legacy=0x7fd7800cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:23.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.487+0000 7fd77f400640 1 --2- 172.21.15.47:0/914802414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7680039b0 0x7fd768003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:23.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.487+0000 7fd77f400640 1 --2- 172.21.15.47:0/914802414 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd768004800 0x7fd768004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:23.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.487+0000 7fd77f400640 1 --2- 172.21.15.47:0/914802414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7680051c0 0x7fd76800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:23.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.487+0000 7fd77f400640 1 -- 172.21.15.47:0/914802414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd78009b990 con 0x7fd7680051c0 2024-05-27T10:53:23.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.487+0000 7fd77f400640 1 -- 172.21.15.47:0/914802414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd76800c060 con 0x7fd7680039b0 2024-05-27T10:53:23.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.487+0000 7fd77f400640 1 -- 172.21.15.47:0/914802414 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd76800c260 con 0x7fd768004800 2024-05-27T10:53:23.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.487+0000 7fd785c00640 1 --2- 172.21.15.47:0/914802414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7680051c0 0x7fd76800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:23.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.487+0000 7fd77fe00640 1 --2- 172.21.15.47:0/914802414 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd768004800 0x7fd768004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:23.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.488+0000 7fd785c00640 1 -- 172.21.15.47:0/914802414 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd768004800 msgr2=0x7fd768004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:23.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.488+0000 7fd785c00640 1 --2- 172.21.15.47:0/914802414 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd768004800 0x7fd768004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.488+0000 7fd785c00640 1 -- 172.21.15.47:0/914802414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7680039b0 msgr2=0x7fd768003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:23.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.488+0000 7fd785c00640 1 --2- 172.21.15.47:0/914802414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7680039b0 0x7fd768003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.488+0000 7fd785c00640 1 -- 172.21.15.47:0/914802414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd768003520 con 0x7fd7680051c0 2024-05-27T10:53:23.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.488+0000 7fd77fe00640 1 --2- 172.21.15.47:0/914802414 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd768004800 0x7fd768004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:23.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.488+0000 7fd785c00640 1 -- 172.21.15.47:0/914802414 reap_dead start 2024-05-27T10:53:23.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.489+0000 7fd785c00640 1 --2- 172.21.15.47:0/914802414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7680051c0 0x7fd76800b9c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd7800c5df0 tx=0x7fd768005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853824f73d276897 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:23.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.489+0000 7fd77f400640 1 -- 172.21.15.47:0/914802414 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77800a4a0 con 0x7fd7680051c0 2024-05-27T10:53:23.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.489+0000 7fd77f400640 1 -- 172.21.15.47:0/914802414 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77802f070 con 0x7fd7680051c0 2024-05-27T10:53:23.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.489+0000 7fd77f400640 1 -- 172.21.15.47:0/914802414 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77802bcb0 con 0x7fd7680051c0 2024-05-27T10:53:23.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.489+0000 7fd786600640 1 -- 172.21.15.47:0/914802414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7680051c0 msgr2=0x7fd76800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:23.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.489+0000 7fd786600640 1 --2- 172.21.15.47:0/914802414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7680051c0 0x7fd76800b9c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd7800c5df0 tx=0x7fd768005830 comp rx=0 tx=0).stop 2024-05-27T10:53:23.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.490+0000 7fd786600640 1 -- 172.21.15.47:0/914802414 shutdown_connections 2024-05-27T10:53:23.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.490+0000 7fd786600640 1 --2- 172.21.15.47:0/914802414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7680051c0 0x7fd76800b9c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.490+0000 7fd786600640 1 -- 172.21.15.47:0/914802414 >> 172.21.15.47:0/914802414 conn(0x7fd7800d22f0 msgr2=0x7fd7800d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:23.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.490+0000 7fd786600640 1 -- 172.21.15.47:0/914802414 shutdown_connections 2024-05-27T10:53:23.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.490+0000 7fd786600640 1 -- 172.21.15.47:0/914802414 wait complete. 2024-05-27T10:53:23.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.491+0000 7fd786600640 1 Processor -- start 2024-05-27T10:53:23.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.492+0000 7fd786600640 1 -- start start 2024-05-27T10:53:23.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.492+0000 7fd786600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd7680051c0 0x7fd78015bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:23.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.492+0000 7fd786600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7800cd9e0 0x7fd78009d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:23.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.492+0000 7fd786600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7800ce840 0x7fd7800cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:23.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.493+0000 7fd786600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd78006ce90 con 0x7fd7800ce840 2024-05-27T10:53:23.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.493+0000 7fd786600640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd7800d1620 con 0x7fd7800cd9e0 2024-05-27T10:53:23.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.493+0000 7fd786600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd78015eca0 con 0x7fd7680051c0 2024-05-27T10:53:23.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.493+0000 7fd785c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7800ce840 0x7fd7800cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:23.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.493+0000 7fd785c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7800ce840 0x7fd7800cbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54992/0 (socket says 172.21.15.47:54992) 2024-05-27T10:53:23.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.493+0000 7fd785c00640 1 -- 172.21.15.47:0/422602588 learned_addr learned my addr 172.21.15.47:0/422602588 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:23.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.493+0000 7fd785200640 1 --2- 172.21.15.47:0/422602588 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd7680051c0 0x7fd78015bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:23.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.493+0000 7fd785c00640 1 -- 172.21.15.47:0/422602588 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd7680051c0 msgr2=0x7fd78015bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:23.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.493+0000 7fd77fe00640 1 --2- 172.21.15.47:0/422602588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7800cd9e0 0x7fd78009d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:23.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.493+0000 7fd785c00640 1 --2- 172.21.15.47:0/422602588 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd7680051c0 0x7fd78015bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.493+0000 7fd785c00640 1 -- 172.21.15.47:0/422602588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7800cd9e0 msgr2=0x7fd78009d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:23.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.493+0000 7fd785c00640 1 --2- 172.21.15.47:0/422602588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7800cd9e0 0x7fd78009d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.493+0000 7fd785c00640 1 -- 172.21.15.47:0/422602588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7800c95c0 con 0x7fd7800ce840 2024-05-27T10:53:23.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.493+0000 7fd785200640 1 --2- 172.21.15.47:0/422602588 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd7680051c0 0x7fd78015bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:23.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.494+0000 7fd785c00640 1 --2- 172.21.15.47:0/422602588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7800ce840 0x7fd7800cbd40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd77800a940 tx=0x7fd77802d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:23.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.494+0000 7fd77cc00640 1 -- 172.21.15.47:0/422602588 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77800a480 con 0x7fd7800ce840 2024-05-27T10:53:23.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.494+0000 7fd77cc00640 1 -- 172.21.15.47:0/422602588 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd778034470 con 0x7fd7800ce840 2024-05-27T10:53:23.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.494+0000 7fd77cc00640 1 -- 172.21.15.47:0/422602588 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd778034860 con 0x7fd7800ce840 2024-05-27T10:53:23.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.494+0000 7fd786600640 1 -- 172.21.15.47:0/422602588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7800c9830 con 0x7fd7800ce840 2024-05-27T10:53:23.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.494+0000 7fd786600640 1 -- 172.21.15.47:0/422602588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7800c9df0 con 0x7fd7800ce840 2024-05-27T10:53:23.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.495+0000 7fd786600640 1 -- 172.21.15.47:0/422602588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd78004fce0 con 0x7fd7800ce840 2024-05-27T10:53:23.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.496+0000 7fd77cc00640 1 -- 172.21.15.47:0/422602588 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd778034a00 con 0x7fd7800ce840 2024-05-27T10:53:23.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.497+0000 7fd77cc00640 1 --2- 172.21.15.47:0/422602588 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd76006c920 0x7fd76006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:23.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.497+0000 7fd77cc00640 1 -- 172.21.15.47:0/422602588 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fd7780abcf0 con 0x7fd7800ce840 2024-05-27T10:53:23.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.497+0000 7fd785200640 1 --2- 172.21.15.47:0/422602588 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd76006c920 0x7fd76006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:23.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.498+0000 7fd785200640 1 --2- 172.21.15.47:0/422602588 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd76006c920 0x7fd76006ede0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd774009a20 tx=0x7fd774008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:23.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.502+0000 7fd77cc00640 1 -- 172.21.15.47:0/422602588 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd778046060 con 0x7fd7800ce840 2024-05-27T10:53:23.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.699+0000 7fd786600640 1 -- 172.21.15.47:0/422602588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd7800c9fc0 con 0x7fd7800ce840 2024-05-27T10:53:23.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.701+0000 7fd77cc00640 1 -- 172.21.15.47:0/422602588 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16598 (secure 0 0 0) 0x7fd77807a080 con 0x7fd7800ce840 2024-05-27T10:53:23.699 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:53:23.699 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":32,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:53:22.309066+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:53:20.334553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-27T10:53:21.277355+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:53:23.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.703+0000 7fd786600640 1 -- 172.21.15.47:0/422602588 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd76006c920 msgr2=0x7fd76006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:23.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.703+0000 7fd786600640 1 --2- 172.21.15.47:0/422602588 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd76006c920 0x7fd76006ede0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd774009a20 tx=0x7fd774008040 comp rx=0 tx=0).stop 2024-05-27T10:53:23.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.703+0000 7fd786600640 1 -- 172.21.15.47:0/422602588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7800ce840 msgr2=0x7fd7800cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:23.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.703+0000 7fd786600640 1 --2- 172.21.15.47:0/422602588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7800ce840 0x7fd7800cbd40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd77800a940 tx=0x7fd77802d070 comp rx=0 tx=0).stop 2024-05-27T10:53:23.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.704+0000 7fd786600640 1 -- 172.21.15.47:0/422602588 shutdown_connections 2024-05-27T10:53:23.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.704+0000 7fd786600640 1 --2- 172.21.15.47:0/422602588 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd76006c920 0x7fd76006ede0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.704+0000 7fd786600640 1 --2- 172.21.15.47:0/422602588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7800ce840 0x7fd7800cbd40 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.704+0000 7fd786600640 1 --2- 172.21.15.47:0/422602588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7800cd9e0 0x7fd78009d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.704+0000 7fd786600640 1 --2- 172.21.15.47:0/422602588 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd7680051c0 0x7fd78015bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.704+0000 7fd786600640 1 -- 172.21.15.47:0/422602588 >> 172.21.15.47:0/422602588 conn(0x7fd7800d22f0 msgr2=0x7fd7800715b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:23.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.704+0000 7fd786600640 1 -- 172.21.15.47:0/422602588 shutdown_connections 2024-05-27T10:53:23.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.704+0000 7fd786600640 1 -- 172.21.15.47:0/422602588 wait complete. 2024-05-27T10:53:23.721 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-27T10:53:23.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.942+0000 7f77d9a00640 1 Processor -- start 2024-05-27T10:53:23.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.942+0000 7f77d9a00640 1 -- start start 2024-05-27T10:53:23.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.944+0000 7f77d9a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77d40d0970 0x7f77d40cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:23.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.944+0000 7f77d9a00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f77d40cc030 0x7f77d40cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:23.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.944+0000 7f77d9a00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77d40ce5c0 con 0x7f77d40d0590 2024-05-27T10:53:23.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.944+0000 7f77d9a00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f77d406da80 con 0x7f77d40cc030 2024-05-27T10:53:23.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.944+0000 7f77d9a00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f77d40ce8a0 con 0x7f77d40d0970 2024-05-27T10:53:23.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.945+0000 7f77cb400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77d40d0970 0x7f77d40cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:23.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.945+0000 7f77cb400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77d40d0970 0x7f77d40cdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:38214/0 (socket says 172.21.15.47:38214) 2024-05-27T10:53:23.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.945+0000 7f77d9000640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f77d40cc030 0x7f77d40cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:23.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.945+0000 7f77d3e00640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f77d40d0590 0x7f77d415c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.47:47128/0 (socket says 172.21.15.47:47128) 2024-05-27T10:53:23.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.945+0000 7f77cb400640 1 -- 172.21.15.47:0/4183898204 learned_addr learned my addr 172.21.15.47:0/4183898204 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:23.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.946+0000 7f77d3400640 1 -- 172.21.15.47:0/4183898204 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1780748549 0 0) 0x7f77d40ce5c0 con 0x7f77d40d0590 2024-05-27T10:53:23.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.946+0000 7f77d3400640 1 -- 172.21.15.47:0/4183898204 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77b8003520 con 0x7f77d40d0590 2024-05-27T10:53:23.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.946+0000 7f77cb400640 1 -- 172.21.15.47:0/4183898204 >> v2:172.21.15.53:3300/0 conn(0x7f77d40cc030 msgr2=0x7f77d40cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:23.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.946+0000 7f77cb400640 1 --2- 172.21.15.47:0/4183898204 >> v2:172.21.15.53:3300/0 conn(0x7f77d40cc030 0x7f77d40cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.946+0000 7f77cb400640 1 -- 172.21.15.47:0/4183898204 >> v1:172.21.15.53:6789/0 conn(0x7f77d40d0590 legacy=0x7f77d415c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:23.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.946+0000 7f77cb400640 1 -- 172.21.15.47:0/4183898204 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d40ceb80 con 0x7f77d40d0970 2024-05-27T10:53:23.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.947+0000 7f77cb400640 1 --2- 172.21.15.47:0/4183898204 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77d40d0970 0x7f77d40cdfe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f77bc00d150 tx=0x7f77bc02c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fce9307fef3d5a8f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:23.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.948+0000 7f77d3400640 1 -- 172.21.15.47:0/4183898204 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc039070 con 0x7f77d40d0970 2024-05-27T10:53:23.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.948+0000 7f77d3400640 1 -- 172.21.15.47:0/4183898204 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77bc009600 con 0x7f77d40d0970 2024-05-27T10:53:23.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.948+0000 7f77d3400640 1 -- 172.21.15.47:0/4183898204 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc0099b0 con 0x7f77d40d0970 2024-05-27T10:53:23.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.948+0000 7f77d9a00640 1 -- 172.21.15.47:0/4183898204 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77d40d0970 msgr2=0x7f77d40cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:23.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.948+0000 7f77d9a00640 1 --2- 172.21.15.47:0/4183898204 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77d40d0970 0x7f77d40cdfe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f77bc00d150 tx=0x7f77bc02c890 comp rx=0 tx=0).stop 2024-05-27T10:53:23.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.948+0000 7f77d9a00640 1 -- 172.21.15.47:0/4183898204 shutdown_connections 2024-05-27T10:53:23.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.948+0000 7f77d9a00640 1 --2- 172.21.15.47:0/4183898204 >> v2:172.21.15.53:3300/0 conn(0x7f77d40cc030 0x7f77d40cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.948+0000 7f77d9a00640 1 --2- 172.21.15.47:0/4183898204 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77d40d0970 0x7f77d40cdfe0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.948+0000 7f77d9a00640 1 -- 172.21.15.47:0/4183898204 >> 172.21.15.47:0/4183898204 conn(0x7f77d406bb20 msgr2=0x7f77d406bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:23.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.949+0000 7f77d9a00640 1 -- 172.21.15.47:0/4183898204 shutdown_connections 2024-05-27T10:53:23.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.949+0000 7f77d9a00640 1 -- 172.21.15.47:0/4183898204 wait complete. 2024-05-27T10:53:23.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.951+0000 7f77d9a00640 1 Processor -- start 2024-05-27T10:53:23.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.951+0000 7f77d9a00640 1 -- start start 2024-05-27T10:53:23.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.952+0000 7f77d9a00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77d40cc030 0x7f77d40b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:23.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.952+0000 7f77d9a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77d40d0590 0x7f77d41f0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:23.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.952+0000 7f77d9a00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77d40d0970 0x7f77d40afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:23.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.952+0000 7f77d9a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f77d4155620 con 0x7f77d40d0590 2024-05-27T10:53:23.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.952+0000 7f77d9a00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f77d41554a0 con 0x7f77d40cc030 2024-05-27T10:53:23.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.952+0000 7f77d9a00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f77d41557a0 con 0x7f77d40d0970 2024-05-27T10:53:23.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.952+0000 7f77cb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77d40d0590 0x7f77d41f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:23.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.953+0000 7f77cb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77d40d0590 0x7f77d41f0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54994/0 (socket says 172.21.15.47:54994) 2024-05-27T10:53:23.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.953+0000 7f77cb400640 1 -- 172.21.15.47:0/3097142941 learned_addr learned my addr 172.21.15.47:0/3097142941 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:23.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.953+0000 7f77d9000640 1 --2- 172.21.15.47:0/3097142941 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77d40d0970 0x7f77d40afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:23.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.953+0000 7f77d3e00640 1 --2- 172.21.15.47:0/3097142941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77d40cc030 0x7f77d40b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:23.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.953+0000 7f77cb400640 1 -- 172.21.15.47:0/3097142941 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77d40d0970 msgr2=0x7f77d40afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:23.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.953+0000 7f77cb400640 1 --2- 172.21.15.47:0/3097142941 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77d40d0970 0x7f77d40afe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.953+0000 7f77cb400640 1 -- 172.21.15.47:0/3097142941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77d40cc030 msgr2=0x7f77d40b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:23.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.953+0000 7f77cb400640 1 --2- 172.21.15.47:0/3097142941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77d40cc030 0x7f77d40b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:23.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.953+0000 7f77cb400640 1 -- 172.21.15.47:0/3097142941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d4071b80 con 0x7f77d40d0590 2024-05-27T10:53:23.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.953+0000 7f77cb400640 1 --2- 172.21.15.47:0/3097142941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77d40d0590 0x7f77d41f0310 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f77bc037040 tx=0x7f77bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:23.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.954+0000 7f77d0c00640 1 -- 172.21.15.47:0/3097142941 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc044070 con 0x7f77d40d0590 2024-05-27T10:53:23.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.954+0000 7f77d0c00640 1 -- 172.21.15.47:0/3097142941 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77bc009c00 con 0x7f77d40d0590 2024-05-27T10:53:23.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.954+0000 7f77d0c00640 1 -- 172.21.15.47:0/3097142941 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc039040 con 0x7f77d40d0590 2024-05-27T10:53:23.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.954+0000 7f77d9a00640 1 -- 172.21.15.47:0/3097142941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d4071e20 con 0x7f77d40d0590 2024-05-27T10:53:23.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.954+0000 7f77d9a00640 1 -- 172.21.15.47:0/3097142941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d40723e0 con 0x7f77d40d0590 2024-05-27T10:53:23.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.956+0000 7f77d9a00640 1 -- 172.21.15.47:0/3097142941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d40681e0 con 0x7f77d40d0590 2024-05-27T10:53:23.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.957+0000 7f77d0c00640 1 -- 172.21.15.47:0/3097142941 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f77bc047070 con 0x7f77d40d0590 2024-05-27T10:53:23.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.958+0000 7f77d0c00640 1 --2- 172.21.15.47:0/3097142941 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f77b006c940 0x7f77b006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:23.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.958+0000 7f77d0c00640 1 -- 172.21.15.47:0/3097142941 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f77bc0ae9f0 con 0x7f77d40d0590 2024-05-27T10:53:23.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.958+0000 7f77d3e00640 1 --2- 172.21.15.47:0/3097142941 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f77b006c940 0x7f77b006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:23.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.958+0000 7f77d3e00640 1 --2- 172.21.15.47:0/3097142941 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f77b006c940 0x7f77b006ee00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f77c4000f60 tx=0x7f77c4007b10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:23.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:23.962+0000 7f77d0c00640 1 -- 172.21.15.47:0/3097142941 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f77d40681e0 con 0x7f77d40d0590 2024-05-27T10:53:24.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:24.210+0000 7f77d9a00640 1 -- 172.21.15.47:0/3097142941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f77d404fce0 con 0x7f77d40d0590 2024-05-27T10:53:24.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:24.856+0000 7f77d0c00640 1 -- 172.21.15.47:0/3097142941 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f77bc07ce10 con 0x7f77d40d0590 2024-05-27T10:53:24.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:24.860+0000 7f77d9a00640 1 -- 172.21.15.47:0/3097142941 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f77b006c940 msgr2=0x7f77b006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:24.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:24.860+0000 7f77d9a00640 1 --2- 172.21.15.47:0/3097142941 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f77b006c940 0x7f77b006ee00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f77c4000f60 tx=0x7f77c4007b10 comp rx=0 tx=0).stop 2024-05-27T10:53:24.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:24.860+0000 7f77d9a00640 1 -- 172.21.15.47:0/3097142941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77d40d0590 msgr2=0x7f77d41f0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:24.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:24.860+0000 7f77d9a00640 1 --2- 172.21.15.47:0/3097142941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77d40d0590 0x7f77d41f0310 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f77bc037040 tx=0x7f77bc004a40 comp rx=0 tx=0).stop 2024-05-27T10:53:24.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:24.860+0000 7f77d9a00640 1 -- 172.21.15.47:0/3097142941 shutdown_connections 2024-05-27T10:53:24.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:24.860+0000 7f77d9a00640 1 --2- 172.21.15.47:0/3097142941 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f77b006c940 0x7f77b006ee00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:24.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:24.860+0000 7f77d9a00640 1 --2- 172.21.15.47:0/3097142941 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77d40d0970 0x7f77d40afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:24.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:24.860+0000 7f77d9a00640 1 --2- 172.21.15.47:0/3097142941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77d40d0590 0x7f77d41f0310 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:24.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:24.860+0000 7f77d9a00640 1 --2- 172.21.15.47:0/3097142941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77d40cc030 0x7f77d40b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:24.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:24.860+0000 7f77d9a00640 1 -- 172.21.15.47:0/3097142941 >> 172.21.15.47:0/3097142941 conn(0x7f77d406bb20 msgr2=0x7f77d40ad030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:24.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:24.861+0000 7f77d9a00640 1 -- 172.21.15.47:0/3097142941 shutdown_connections 2024-05-27T10:53:24.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:24.861+0000 7f77d9a00640 1 -- 172.21.15.47:0/3097142941 wait complete. 2024-05-27T10:53:24.880 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-27T10:53:24.880 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-27T10:53:25.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.089+0000 7f437aa00640 1 Processor -- start 2024-05-27T10:53:25.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.089+0000 7f437aa00640 1 -- start start 2024-05-27T10:53:25.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.091+0000 7f437aa00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f43740d0a30 0x7f4374167470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:25.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.091+0000 7f437aa00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43740b4620 con 0x7f437415c510 2024-05-27T10:53:25.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.091+0000 7f437aa00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43740b4900 con 0x7f437406da80 2024-05-27T10:53:25.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.091+0000 7f437aa00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f43740b43e0 con 0x7f43740d0a30 2024-05-27T10:53:25.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.092+0000 7f4379600640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f437415c510 0x7f43740b3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35900/0 (socket says 172.21.15.47:35900) 2024-05-27T10:53:25.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.092+0000 7f4379600640 1 -- 172.21.15.47:0/4209428267 learned_addr learned my addr 172.21.15.47:0/4209428267 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:25.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.092+0000 7f4373e00640 1 -- 172.21.15.47:0/4209428267 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2097223157 0 0) 0x7f43740b4620 con 0x7f437415c510 2024-05-27T10:53:25.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.092+0000 7f437a000640 1 --2- 172.21.15.47:0/4209428267 >> v2:172.21.15.53:3300/0 conn(0x7f43740d0a30 0x7f4374167470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:25.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.092+0000 7f4373e00640 1 -- 172.21.15.47:0/4209428267 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f435c003520 con 0x7f437415c510 2024-05-27T10:53:25.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.092+0000 7f4373e00640 1 -- 172.21.15.47:0/4209428267 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3635273796 0 0) 0x7f435c003520 con 0x7f437415c510 2024-05-27T10:53:25.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f4373e00640 1 -- 172.21.15.47:0/4209428267 >> v2:172.21.15.53:3300/0 conn(0x7f43740d0a30 msgr2=0x7f4374167470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:25.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f4373e00640 1 --2- 172.21.15.47:0/4209428267 >> v2:172.21.15.53:3300/0 conn(0x7f43740d0a30 0x7f4374167470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:25.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f4373e00640 1 -- 172.21.15.47:0/4209428267 >> v1:172.21.15.53:6789/0 conn(0x7f437406da80 legacy=0x7f43740d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:25.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f4373e00640 1 -- 172.21.15.47:0/4209428267 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43740b4be0 con 0x7f437415c510 2024-05-27T10:53:25.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f4373e00640 1 -- 172.21.15.47:0/4209428267 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7f43680019f0 con 0x7f437415c510 2024-05-27T10:53:25.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f4373e00640 1 -- 172.21.15.47:0/4209428267 >> v1:172.21.15.47:6789/0 conn(0x7f437415c510 legacy=0x7f43740b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:25.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f4373e00640 1 --2- 172.21.15.47:0/4209428267 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f435c0039b0 0x7f435c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:25.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f4373e00640 1 --2- 172.21.15.47:0/4209428267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f435c004800 0x7f435c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:25.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f4373e00640 1 --2- 172.21.15.47:0/4209428267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f435c0051c0 0x7f435c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:25.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f4373e00640 1 -- 172.21.15.47:0/4209428267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f43740b43e0 con 0x7f435c004800 2024-05-27T10:53:25.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f4373e00640 1 -- 172.21.15.47:0/4209428267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f435c00c110 con 0x7f435c0051c0 2024-05-27T10:53:25.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f4373e00640 1 -- 172.21.15.47:0/4209428267 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f435c00c310 con 0x7f435c0039b0 2024-05-27T10:53:25.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f437a000640 1 --2- 172.21.15.47:0/4209428267 >> v2:172.21.15.53:3300/0 conn(0x7f43740d0a30 0x7f4374167470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:53:25.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f4378c00640 1 --2- 172.21.15.47:0/4209428267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f435c004800 0x7f435c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:25.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f4379600640 1 --2- 172.21.15.47:0/4209428267 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f435c0039b0 0x7f435c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:25.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f4378c00640 1 -- 172.21.15.47:0/4209428267 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f435c0039b0 msgr2=0x7f435c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:25.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f4378c00640 1 --2- 172.21.15.47:0/4209428267 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f435c0039b0 0x7f435c003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:25.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f4378c00640 1 -- 172.21.15.47:0/4209428267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f435c0051c0 msgr2=0x7f435c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:25.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f4378c00640 1 --2- 172.21.15.47:0/4209428267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f435c0051c0 0x7f435c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:25.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f4378c00640 1 -- 172.21.15.47:0/4209428267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435c003520 con 0x7f435c004800 2024-05-27T10:53:25.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.093+0000 7f437a000640 1 -- 172.21.15.47:0/4209428267 reap_dead start 2024-05-27T10:53:25.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.095+0000 7f4378c00640 1 --2- 172.21.15.47:0/4209428267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f435c004800 0x7f435c004c80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4360001750 tx=0x7f435c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29ffbf600307b86 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:25.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.095+0000 7f4373e00640 1 -- 172.21.15.47:0/4209428267 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4360001370 con 0x7f435c004800 2024-05-27T10:53:25.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.095+0000 7f4373e00640 1 -- 172.21.15.47:0/4209428267 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43600052d0 con 0x7f435c004800 2024-05-27T10:53:25.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.095+0000 7f4373e00640 1 -- 172.21.15.47:0/4209428267 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436002abc0 con 0x7f435c004800 2024-05-27T10:53:25.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.095+0000 7f437aa00640 1 -- 172.21.15.47:0/4209428267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f435c004800 msgr2=0x7f435c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:25.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.095+0000 7f437aa00640 1 --2- 172.21.15.47:0/4209428267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f435c004800 0x7f435c004c80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4360001750 tx=0x7f435c005830 comp rx=0 tx=0).stop 2024-05-27T10:53:25.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.095+0000 7f437aa00640 1 -- 172.21.15.47:0/4209428267 shutdown_connections 2024-05-27T10:53:25.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.095+0000 7f437aa00640 1 --2- 172.21.15.47:0/4209428267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f435c004800 0x7f435c004c80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:25.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.095+0000 7f437aa00640 1 -- 172.21.15.47:0/4209428267 >> 172.21.15.47:0/4209428267 conn(0x7f437406bb20 msgr2=0x7f437406bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:25.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.096+0000 7f437aa00640 1 -- 172.21.15.47:0/4209428267 shutdown_connections 2024-05-27T10:53:25.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.096+0000 7f437aa00640 1 -- 172.21.15.47:0/4209428267 wait complete. 2024-05-27T10:53:25.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.097+0000 7f437aa00640 1 Processor -- start 2024-05-27T10:53:25.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.097+0000 7f437aa00640 1 -- start start 2024-05-27T10:53:25.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.098+0000 7f437aa00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f435c004800 0x7f437414a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:25.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.098+0000 7f437aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f437415e520 0x7f43741557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:25.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.098+0000 7f437aa00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f437415e9a0 0x7f4374155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:25.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.098+0000 7f437aa00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f43740d0320 con 0x7f437415e520 2024-05-27T10:53:25.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.098+0000 7f437aa00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f437415c8f0 con 0x7f435c004800 2024-05-27T10:53:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.098+0000 7f437aa00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f43740d04a0 con 0x7f437415e9a0 2024-05-27T10:53:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.099+0000 7f4378c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f437415e520 0x7f43741557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.099+0000 7f4378c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f437415e520 0x7f43741557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55012/0 (socket says 172.21.15.47:55012) 2024-05-27T10:53:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.099+0000 7f4378c00640 1 -- 172.21.15.47:0/1404836769 learned_addr learned my addr 172.21.15.47:0/1404836769 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.099+0000 7f437a000640 1 --2- 172.21.15.47:0/1404836769 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f437415e9a0 0x7f4374155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.099+0000 7f4379600640 1 --2- 172.21.15.47:0/1404836769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f435c004800 0x7f437414a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.099+0000 7f4378c00640 1 -- 172.21.15.47:0/1404836769 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f437415e9a0 msgr2=0x7f4374155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.099+0000 7f4378c00640 1 --2- 172.21.15.47:0/1404836769 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f437415e9a0 0x7f4374155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.099+0000 7f4378c00640 1 -- 172.21.15.47:0/1404836769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f435c004800 msgr2=0x7f437414a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.099+0000 7f4378c00640 1 --2- 172.21.15.47:0/1404836769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f435c004800 0x7f437414a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.099+0000 7f4378c00640 1 -- 172.21.15.47:0/1404836769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437415d860 con 0x7f437415e520 2024-05-27T10:53:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.100+0000 7f4378c00640 1 --2- 172.21.15.47:0/1404836769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f437415e520 0x7f43741557a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4360000c00 tx=0x7f4360001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:25.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.100+0000 7f4371600640 1 -- 172.21.15.47:0/1404836769 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436003f030 con 0x7f437415e520 2024-05-27T10:53:25.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.100+0000 7f4371600640 1 -- 172.21.15.47:0/1404836769 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4360005480 con 0x7f437415e520 2024-05-27T10:53:25.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.100+0000 7f437aa00640 1 -- 172.21.15.47:0/1404836769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f437415db40 con 0x7f437415e520 2024-05-27T10:53:25.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.100+0000 7f4371600640 1 -- 172.21.15.47:0/1404836769 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4360037040 con 0x7f437415e520 2024-05-27T10:53:25.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.100+0000 7f437aa00640 1 -- 172.21.15.47:0/1404836769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4374153bc0 con 0x7f437415e520 2024-05-27T10:53:25.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.101+0000 7f437aa00640 1 -- 172.21.15.47:0/1404836769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f437415dd10 con 0x7f437415e520 2024-05-27T10:53:25.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.102+0000 7f4371600640 1 -- 172.21.15.47:0/1404836769 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4360042070 con 0x7f437415e520 2024-05-27T10:53:25.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.103+0000 7f4371600640 1 --2- 172.21.15.47:0/1404836769 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f435406c920 0x7f435406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:25.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.103+0000 7f4371600640 1 -- 172.21.15.47:0/1404836769 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f43600ab250 con 0x7f437415e520 2024-05-27T10:53:25.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.103+0000 7f4379600640 1 --2- 172.21.15.47:0/1404836769 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f435406c920 0x7f435406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:25.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.104+0000 7f4379600640 1 --2- 172.21.15.47:0/1404836769 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f435406c920 0x7f435406ede0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4368001370 tx=0x7f4368009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:25.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.108+0000 7f4371600640 1 -- 172.21.15.47:0/1404836769 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f437415dd10 con 0x7f437415e520 2024-05-27T10:53:25.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.357+0000 7f437aa00640 1 -- 172.21.15.47:0/1404836769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f43741536d0 con 0x7f437415e520 2024-05-27T10:53:25.774 INFO:tasks.ceph.mds.b.smithi053.stderr:2024-05-27T10:53:25.776+0000 7fdd5b600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-27T10:53:25.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.871+0000 7f4371600640 1 -- 172.21.15.47:0/1404836769 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f4360079550 con 0x7f437415e520 2024-05-27T10:53:25.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.875+0000 7f437aa00640 1 -- 172.21.15.47:0/1404836769 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f435406c920 msgr2=0x7f435406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:25.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.875+0000 7f437aa00640 1 --2- 172.21.15.47:0/1404836769 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f435406c920 0x7f435406ede0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4368001370 tx=0x7f4368009040 comp rx=0 tx=0).stop 2024-05-27T10:53:25.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.875+0000 7f437aa00640 1 -- 172.21.15.47:0/1404836769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f437415e520 msgr2=0x7f43741557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:25.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.875+0000 7f437aa00640 1 --2- 172.21.15.47:0/1404836769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f437415e520 0x7f43741557a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4360000c00 tx=0x7f4360001120 comp rx=0 tx=0).stop 2024-05-27T10:53:25.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.876+0000 7f437aa00640 1 -- 172.21.15.47:0/1404836769 shutdown_connections 2024-05-27T10:53:25.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.876+0000 7f437aa00640 1 --2- 172.21.15.47:0/1404836769 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f435406c920 0x7f435406ede0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:25.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.876+0000 7f437aa00640 1 --2- 172.21.15.47:0/1404836769 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f437415e9a0 0x7f4374155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:25.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.876+0000 7f437aa00640 1 --2- 172.21.15.47:0/1404836769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f437415e520 0x7f43741557a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:25.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.876+0000 7f437aa00640 1 --2- 172.21.15.47:0/1404836769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f435c004800 0x7f437414a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:25.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.876+0000 7f437aa00640 1 -- 172.21.15.47:0/1404836769 >> 172.21.15.47:0/1404836769 conn(0x7f437406bb20 msgr2=0x7f437406df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:25.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.876+0000 7f437aa00640 1 -- 172.21.15.47:0/1404836769 shutdown_connections 2024-05-27T10:53:25.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:25.876+0000 7f437aa00640 1 -- 172.21.15.47:0/1404836769 wait complete. 2024-05-27T10:53:25.896 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-27T10:53:25.897 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T10:53:26.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.108+0000 7fa87d600640 1 Processor -- start 2024-05-27T10:53:26.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.108+0000 7fa87d600640 1 -- start start 2024-05-27T10:53:26.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.109+0000 7fa87d600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa87815c460 0x7fa8780ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:26.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.109+0000 7fa87d600640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa8780d0e10 0x7fa87806def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:26.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.109+0000 7fa87d600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa878160140 con 0x7fa87815c840 2024-05-27T10:53:26.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.109+0000 7fa87d600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa878160420 con 0x7fa87815c460 2024-05-27T10:53:26.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.109+0000 7fa87d600640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fa878160700 con 0x7fa8780d0e10 2024-05-27T10:53:26.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.110+0000 7fa876a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa87815c460 0x7fa8780ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:26.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.110+0000 7fa876a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa87815c460 0x7fa8780ad300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55022/0 (socket says 172.21.15.47:55022) 2024-05-27T10:53:26.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.110+0000 7fa876a00640 1 -- 172.21.15.47:0/2926876725 learned_addr learned my addr 172.21.15.47:0/2926876725 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:26.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.110+0000 7fa86fe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa87815c840 0x7fa8780d0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35916/0 (socket says 172.21.15.47:35916) 2024-05-27T10:53:26.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.110+0000 7fa876a00640 1 -- 172.21.15.47:0/2926876725 >> v2:172.21.15.53:3300/0 conn(0x7fa8780d0e10 msgr2=0x7fa87806def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:26.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.110+0000 7fa876a00640 1 --2- 172.21.15.47:0/2926876725 >> v2:172.21.15.53:3300/0 conn(0x7fa8780d0e10 0x7fa87806def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:26.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.110+0000 7fa876a00640 1 -- 172.21.15.47:0/2926876725 >> v1:172.21.15.47:6789/0 conn(0x7fa87815c840 legacy=0x7fa8780d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:26.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.110+0000 7fa876a00640 1 -- 172.21.15.47:0/2926876725 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8781609e0 con 0x7fa87815c460 2024-05-27T10:53:26.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.111+0000 7fa876a00640 1 --2- 172.21.15.47:0/2926876725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa87815c460 0x7fa8780ad300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa8780ae360 tx=0x7fa86802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84671b1708afbf3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:26.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.112+0000 7fa876000640 1 -- 172.21.15.47:0/2926876725 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868037070 con 0x7fa87815c460 2024-05-27T10:53:26.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.112+0000 7fa876000640 1 -- 172.21.15.47:0/2926876725 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa868032440 con 0x7fa87815c460 2024-05-27T10:53:26.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.112+0000 7fa876000640 1 -- 172.21.15.47:0/2926876725 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868032810 con 0x7fa87815c460 2024-05-27T10:53:26.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.112+0000 7fa87d600640 1 -- 172.21.15.47:0/2926876725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa87815c460 msgr2=0x7fa8780ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:26.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.112+0000 7fa87d600640 1 --2- 172.21.15.47:0/2926876725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa87815c460 0x7fa8780ad300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa8780ae360 tx=0x7fa86802a210 comp rx=0 tx=0).stop 2024-05-27T10:53:26.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.112+0000 7fa87d600640 1 -- 172.21.15.47:0/2926876725 shutdown_connections 2024-05-27T10:53:26.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.112+0000 7fa87d600640 1 --2- 172.21.15.47:0/2926876725 >> v2:172.21.15.53:3300/0 conn(0x7fa8780d0e10 0x7fa87806def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:26.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.112+0000 7fa87d600640 1 --2- 172.21.15.47:0/2926876725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa87815c460 0x7fa8780ad300 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:26.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.112+0000 7fa87d600640 1 -- 172.21.15.47:0/2926876725 >> 172.21.15.47:0/2926876725 conn(0x7fa87806bd60 msgr2=0x7fa87806c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:26.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.112+0000 7fa87d600640 1 -- 172.21.15.47:0/2926876725 shutdown_connections 2024-05-27T10:53:26.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.112+0000 7fa87d600640 1 -- 172.21.15.47:0/2926876725 wait complete. 2024-05-27T10:53:26.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.114+0000 7fa87d600640 1 Processor -- start 2024-05-27T10:53:26.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.114+0000 7fa87d600640 1 -- start start 2024-05-27T10:53:26.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.115+0000 7fa87d600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa8780d0e10 0x7fa8781e7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:26.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.115+0000 7fa87d600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa87815c460 0x7fa87809c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:26.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.115+0000 7fa87d600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa87815c840 0x7fa87809ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:26.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.115+0000 7fa87d600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa8780ad840 con 0x7fa87815c840 2024-05-27T10:53:26.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.115+0000 7fa87d600640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa878160fa0 con 0x7fa87815c460 2024-05-27T10:53:26.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.115+0000 7fa87d600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fa8780ad9c0 con 0x7fa8780d0e10 2024-05-27T10:53:26.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.116+0000 7fa877400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa87815c840 0x7fa87809ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:26.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.116+0000 7fa877400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa87815c840 0x7fa87809ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55024/0 (socket says 172.21.15.47:55024) 2024-05-27T10:53:26.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.116+0000 7fa877400640 1 -- 172.21.15.47:0/3284643698 learned_addr learned my addr 172.21.15.47:0/3284643698 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:26.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.116+0000 7fa876a00640 1 --2- 172.21.15.47:0/3284643698 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa8780d0e10 0x7fa8781e7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:26.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.116+0000 7fa86fe00640 1 --2- 172.21.15.47:0/3284643698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa87815c460 0x7fa87809c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:26.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.116+0000 7fa877400640 1 -- 172.21.15.47:0/3284643698 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa8780d0e10 msgr2=0x7fa8781e7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:26.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.116+0000 7fa877400640 1 --2- 172.21.15.47:0/3284643698 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa8780d0e10 0x7fa8781e7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:26.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.116+0000 7fa877400640 1 -- 172.21.15.47:0/3284643698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa87815c460 msgr2=0x7fa87809c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:26.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.116+0000 7fa877400640 1 --2- 172.21.15.47:0/3284643698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa87815c460 0x7fa87809c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:26.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.116+0000 7fa877400640 1 -- 172.21.15.47:0/3284643698 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8781e63c0 con 0x7fa87815c840 2024-05-27T10:53:26.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.116+0000 7fa877400640 1 --2- 172.21.15.47:0/3284643698 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa87815c840 0x7fa87809ca90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa87000b9e0 tx=0x7fa87000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:26.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.117+0000 7fa86ea00640 1 -- 172.21.15.47:0/3284643698 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa870019070 con 0x7fa87815c840 2024-05-27T10:53:26.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.117+0000 7fa86ea00640 1 -- 172.21.15.47:0/3284643698 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa87000cb20 con 0x7fa87815c840 2024-05-27T10:53:26.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.117+0000 7fa86ea00640 1 -- 172.21.15.47:0/3284643698 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa870014440 con 0x7fa87815c840 2024-05-27T10:53:26.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.117+0000 7fa87d600640 1 -- 172.21.15.47:0/3284643698 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8781e66a0 con 0x7fa87815c840 2024-05-27T10:53:26.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.117+0000 7fa87d600640 1 -- 172.21.15.47:0/3284643698 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8781e6c60 con 0x7fa87815c840 2024-05-27T10:53:26.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.118+0000 7fa87d600640 1 -- 172.21.15.47:0/3284643698 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8780689e0 con 0x7fa87815c840 2024-05-27T10:53:26.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.120+0000 7fa86ea00640 1 -- 172.21.15.47:0/3284643698 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa87001c070 con 0x7fa87815c840 2024-05-27T10:53:26.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.121+0000 7fa86ea00640 1 --2- 172.21.15.47:0/3284643698 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa85406c8f0 0x7fa85406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:26.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.121+0000 7fa86ea00640 1 -- 172.21.15.47:0/3284643698 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa87008b8a0 con 0x7fa87815c840 2024-05-27T10:53:26.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.121+0000 7fa876a00640 1 --2- 172.21.15.47:0/3284643698 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa85406c8f0 0x7fa85406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:26.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.122+0000 7fa876a00640 1 --2- 172.21.15.47:0/3284643698 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa85406c8f0 0x7fa85406edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa868034000 tx=0x7fa86802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:26.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.126+0000 7fa86ea00640 1 -- 172.21.15.47:0/3284643698 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa870059c40 con 0x7fa87815c840 2024-05-27T10:53:26.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.372+0000 7fa87d600640 1 -- 172.21.15.47:0/3284643698 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8780b1170 con 0x7fa87815c840 2024-05-27T10:53:26.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.373+0000 7fa86ea00640 1 -- 172.21.15.47:0/3284643698 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5181 (secure 0 0 0) 0x7fa870059540 con 0x7fa87815c840 2024-05-27T10:53:26.371 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:53:26.371 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1336820258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1336820258},{"type":"v1","addr":"172.21.15.53:6835","nonce":1336820258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4187595814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4187595814},{"type":"v1","addr":"172.21.15.47:6835","nonce":4187595814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1549808451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1549808451},{"type":"v1","addr":"172.21.15.47:6837","nonce":1549808451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T10:53:22.309015+0000","modified":"2024-05-27T10:53:25.359276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5223":{"gid":5223,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6833/2725015532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2725015532},{"type":"v1","addr":"172.21.15.53:6833","nonce":2725015532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5223,"qdb_cluster":[5223]},"id":2}]} 2024-05-27T10:53:26.371 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 17 2024-05-27T10:53:26.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.375+0000 7fa87d600640 1 -- 172.21.15.47:0/3284643698 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa85406c8f0 msgr2=0x7fa85406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:26.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.375+0000 7fa87d600640 1 --2- 172.21.15.47:0/3284643698 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa85406c8f0 0x7fa85406edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa868034000 tx=0x7fa86802e000 comp rx=0 tx=0).stop 2024-05-27T10:53:26.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.375+0000 7fa87d600640 1 -- 172.21.15.47:0/3284643698 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa87815c840 msgr2=0x7fa87809ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:26.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.375+0000 7fa87d600640 1 --2- 172.21.15.47:0/3284643698 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa87815c840 0x7fa87809ca90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa87000b9e0 tx=0x7fa87000bea0 comp rx=0 tx=0).stop 2024-05-27T10:53:26.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.375+0000 7fa87d600640 1 -- 172.21.15.47:0/3284643698 shutdown_connections 2024-05-27T10:53:26.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.375+0000 7fa87d600640 1 --2- 172.21.15.47:0/3284643698 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fa85406c8f0 0x7fa85406edb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:26.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.375+0000 7fa87d600640 1 --2- 172.21.15.47:0/3284643698 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa87815c840 0x7fa87809ca90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:26.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.375+0000 7fa87d600640 1 --2- 172.21.15.47:0/3284643698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa87815c460 0x7fa87809c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:26.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.375+0000 7fa87d600640 1 --2- 172.21.15.47:0/3284643698 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa8780d0e10 0x7fa8781e7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:26.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.375+0000 7fa87d600640 1 -- 172.21.15.47:0/3284643698 >> 172.21.15.47:0/3284643698 conn(0x7fa87806bd60 msgr2=0x7fa8780b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:26.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.376+0000 7fa87d600640 1 -- 172.21.15.47:0/3284643698 shutdown_connections 2024-05-27T10:53:26.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.376+0000 7fa87d600640 1 -- 172.21.15.47:0/3284643698 wait complete. 2024-05-27T10:53:26.393 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T10:53:26.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.611+0000 7fbd66c00640 1 Processor -- start 2024-05-27T10:53:26.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.611+0000 7fbd66c00640 1 -- start start 2024-05-27T10:53:26.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.613+0000 7fbd66c00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbd6015e880 0x7fbd600d30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:26.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.613+0000 7fbd66c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbd600cfac0 0x7fbd600cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:26.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.613+0000 7fbd66c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd600d2310 con 0x7fbd600b6000 2024-05-27T10:53:26.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.613+0000 7fbd66c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fbd600d20c0 con 0x7fbd600cfac0 2024-05-27T10:53:26.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.613+0000 7fbd66c00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fbd600d2c40 con 0x7fbd6015e880 2024-05-27T10:53:26.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.613+0000 7fbd64e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbd600cfac0 0x7fbd600cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:26.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.613+0000 7fbd66200640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbd600b6000 0x7fbd6006ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35922/0 (socket says 172.21.15.47:35922) 2024-05-27T10:53:26.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.613+0000 7fbd66200640 1 -- 172.21.15.47:0/905569339 learned_addr learned my addr 172.21.15.47:0/905569339 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:26.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.613+0000 7fbd65800640 1 --2- 172.21.15.47:0/905569339 >> v2:172.21.15.53:3300/0 conn(0x7fbd6015e880 0x7fbd600d30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:26.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.613+0000 7fbd64e00640 1 -- 172.21.15.47:0/905569339 >> v2:172.21.15.53:3300/0 conn(0x7fbd6015e880 msgr2=0x7fbd600d30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:26.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.613+0000 7fbd64e00640 1 --2- 172.21.15.47:0/905569339 >> v2:172.21.15.53:3300/0 conn(0x7fbd6015e880 0x7fbd600d30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:26.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.613+0000 7fbd64e00640 1 -- 172.21.15.47:0/905569339 >> v1:172.21.15.47:6789/0 conn(0x7fbd600b6000 legacy=0x7fbd6006ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:26.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.613+0000 7fbd64e00640 1 -- 172.21.15.47:0/905569339 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd600d25f0 con 0x7fbd600cfac0 2024-05-27T10:53:26.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.613+0000 7fbd5fe00640 1 -- 172.21.15.47:0/905569339 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 611965513 0 0) 0x7fbd600d2310 con 0x7fbd600b6000 2024-05-27T10:53:26.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.613+0000 7fbd65800640 1 --2- 172.21.15.47:0/905569339 >> v2:172.21.15.53:3300/0 conn(0x7fbd6015e880 0x7fbd600d30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T10:53:26.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.614+0000 7fbd64e00640 1 --2- 172.21.15.47:0/905569339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600cfac0 0x7fbd600cff40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbd6008cbe0 tx=0x7fbd4c02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=decdecb5c7ab03a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:26.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.615+0000 7fbd5fe00640 1 -- 172.21.15.47:0/905569339 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c037070 con 0x7fbd600cfac0 2024-05-27T10:53:26.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.615+0000 7fbd5fe00640 1 -- 172.21.15.47:0/905569339 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd4c02add0 con 0x7fbd600cfac0 2024-05-27T10:53:26.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.615+0000 7fbd5fe00640 1 -- 172.21.15.47:0/905569339 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c032660 con 0x7fbd600cfac0 2024-05-27T10:53:26.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.615+0000 7fbd66c00640 1 -- 172.21.15.47:0/905569339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600cfac0 msgr2=0x7fbd600cff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:26.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.615+0000 7fbd66c00640 1 --2- 172.21.15.47:0/905569339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600cfac0 0x7fbd600cff40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbd6008cbe0 tx=0x7fbd4c02a080 comp rx=0 tx=0).stop 2024-05-27T10:53:26.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.615+0000 7fbd66c00640 1 -- 172.21.15.47:0/905569339 shutdown_connections 2024-05-27T10:53:26.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.615+0000 7fbd66c00640 1 --2- 172.21.15.47:0/905569339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600cfac0 0x7fbd600cff40 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:26.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.615+0000 7fbd66c00640 1 --2- 172.21.15.47:0/905569339 >> v2:172.21.15.53:3300/0 conn(0x7fbd6015e880 0x7fbd600d30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:26.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.615+0000 7fbd66c00640 1 -- 172.21.15.47:0/905569339 >> 172.21.15.47:0/905569339 conn(0x7fbd6008bfd0 msgr2=0x7fbd600d4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:26.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.615+0000 7fbd66c00640 1 -- 172.21.15.47:0/905569339 shutdown_connections 2024-05-27T10:53:26.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.615+0000 7fbd66c00640 1 -- 172.21.15.47:0/905569339 wait complete. 2024-05-27T10:53:26.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.617+0000 7fbd66c00640 1 Processor -- start 2024-05-27T10:53:26.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.617+0000 7fbd66c00640 1 -- start start 2024-05-27T10:53:26.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.618+0000 7fbd66c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600b6000 0x7fbd600c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:26.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.618+0000 7fbd66c00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd600cfac0 0x7fbd600c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:26.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.618+0000 7fbd66c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd6015e880 0x7fbd60158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:26.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.618+0000 7fbd66c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6015ec60 con 0x7fbd600b6000 2024-05-27T10:53:26.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.618+0000 7fbd66c00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbd600d50a0 con 0x7fbd600cfac0 2024-05-27T10:53:26.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.618+0000 7fbd66c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbd6015ede0 con 0x7fbd6015e880 2024-05-27T10:53:26.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.618+0000 7fbd65800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600b6000 0x7fbd600c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:26.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.619+0000 7fbd65800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600b6000 0x7fbd600c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55046/0 (socket says 172.21.15.47:55046) 2024-05-27T10:53:26.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.619+0000 7fbd65800640 1 -- 172.21.15.47:0/879250563 learned_addr learned my addr 172.21.15.47:0/879250563 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:26.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.619+0000 7fbd66200640 1 --2- 172.21.15.47:0/879250563 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd6015e880 0x7fbd60158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:26.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.619+0000 7fbd64e00640 1 --2- 172.21.15.47:0/879250563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd600cfac0 0x7fbd600c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:26.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.619+0000 7fbd65800640 1 -- 172.21.15.47:0/879250563 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd6015e880 msgr2=0x7fbd60158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:26.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.619+0000 7fbd65800640 1 --2- 172.21.15.47:0/879250563 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd6015e880 0x7fbd60158cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:26.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.619+0000 7fbd65800640 1 -- 172.21.15.47:0/879250563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd600cfac0 msgr2=0x7fbd600c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:26.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.619+0000 7fbd65800640 1 --2- 172.21.15.47:0/879250563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd600cfac0 0x7fbd600c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:26.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.619+0000 7fbd65800640 1 -- 172.21.15.47:0/879250563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd600ca250 con 0x7fbd600b6000 2024-05-27T10:53:26.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.619+0000 7fbd66200640 1 --2- 172.21.15.47:0/879250563 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd6015e880 0x7fbd60158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:26.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.619+0000 7fbd65800640 1 --2- 172.21.15.47:0/879250563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600b6000 0x7fbd600c8aa0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400e7e0 tx=0x7fbd5400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:26.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.620+0000 7fbd5d600640 1 -- 172.21.15.47:0/879250563 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5400f040 con 0x7fbd600b6000 2024-05-27T10:53:26.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.620+0000 7fbd5d600640 1 -- 172.21.15.47:0/879250563 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd54004030 con 0x7fbd600b6000 2024-05-27T10:53:26.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.620+0000 7fbd5d600640 1 -- 172.21.15.47:0/879250563 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd54004400 con 0x7fbd600b6000 2024-05-27T10:53:26.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.620+0000 7fbd66c00640 1 -- 172.21.15.47:0/879250563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd60159200 con 0x7fbd600b6000 2024-05-27T10:53:26.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.620+0000 7fbd66c00640 1 -- 172.21.15.47:0/879250563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd600caab0 con 0x7fbd600b6000 2024-05-27T10:53:26.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.621+0000 7fbd66c00640 1 -- 172.21.15.47:0/879250563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd600ca600 con 0x7fbd600b6000 2024-05-27T10:53:26.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.622+0000 7fbd5d600640 1 -- 172.21.15.47:0/879250563 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbd5400c6d0 con 0x7fbd600b6000 2024-05-27T10:53:26.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.623+0000 7fbd5d600640 1 --2- 172.21.15.47:0/879250563 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbd4006c8f0 0x7fbd4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:26.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.623+0000 7fbd5d600640 1 -- 172.21.15.47:0/879250563 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fbd5408b8f0 con 0x7fbd600b6000 2024-05-27T10:53:26.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.625+0000 7fbd64e00640 1 --2- 172.21.15.47:0/879250563 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbd4006c8f0 0x7fbd4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:26.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.625+0000 7fbd64e00640 1 --2- 172.21.15.47:0/879250563 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbd4006c8f0 0x7fbd4006edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c034000 tx=0x7fbd4c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:26.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.630+0000 7fbd5d600640 1 -- 172.21.15.47:0/879250563 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbd54017020 con 0x7fbd600b6000 2024-05-27T10:53:26.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.834+0000 7fbd66c00640 1 -- 172.21.15.47:0/879250563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd600cb380 con 0x7fbd600b6000 2024-05-27T10:53:26.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.836+0000 7fbd5d600640 1 -- 172.21.15.47:0/879250563 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16585 (secure 0 0 0) 0x7fbd54059d10 con 0x7fbd600b6000 2024-05-27T10:53:26.835 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:53:26.835 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":33,"fsid":"7b0baa11-ae73-495b-918f-c8db2aa0510f","created":"2024-05-27T10:51:41.839976+0000","modified":"2024-05-27T10:53:23.836469+0000","last_up_change":"2024-05-27T10:51:53.770613+0000","last_in_change":"2024-05-27T10:51:45.190643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T10:51:55.073251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-27T10:53:20.334553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-27T10:53:21.277355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6198acec-d103-4b5c-ad8e-e9dfa3b40242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6801","nonce":1852621480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6803","nonce":1852621480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6807","nonce":1852621480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1852621480},{"type":"v1","addr":"172.21.15.47:6805","nonce":1852621480}]},"public_addr":"172.21.15.47:6801/1852621480","cluster_addr":"172.21.15.47:6803/1852621480","heartbeat_back_addr":"172.21.15.47:6807/1852621480","heartbeat_front_addr":"172.21.15.47:6805/1852621480","state":["exists","up"]},{"osd":1,"uuid":"e893fcd8-a0c8-4504-8737-98bf1bcd77ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6809","nonce":3537662321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6811","nonce":3537662321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6815","nonce":3537662321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3537662321},{"type":"v1","addr":"172.21.15.47:6813","nonce":3537662321}]},"public_addr":"172.21.15.47:6809/3537662321","cluster_addr":"172.21.15.47:6811/3537662321","heartbeat_back_addr":"172.21.15.47:6815/3537662321","heartbeat_front_addr":"172.21.15.47:6813/3537662321","state":["exists","up"]},{"osd":2,"uuid":"66f5ebff-f4e8-4f73-b483-d328f0aba6f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6825","nonce":1861819371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6827","nonce":1861819371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6831","nonce":1861819371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":1861819371},{"type":"v1","addr":"172.21.15.47:6829","nonce":1861819371}]},"public_addr":"172.21.15.47:6825/1861819371","cluster_addr":"172.21.15.47:6827/1861819371","heartbeat_back_addr":"172.21.15.47:6831/1861819371","heartbeat_front_addr":"172.21.15.47:6829/1861819371","state":["exists","up"]},{"osd":3,"uuid":"e659251d-46ba-4790-b235-e3e9c6b324aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6817","nonce":830128512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6819","nonce":830128512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6823","nonce":830128512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":830128512},{"type":"v1","addr":"172.21.15.47:6821","nonce":830128512}]},"public_addr":"172.21.15.47:6817/830128512","cluster_addr":"172.21.15.47:6819/830128512","heartbeat_back_addr":"172.21.15.47:6823/830128512","heartbeat_front_addr":"172.21.15.47:6821/830128512","state":["exists","up"]},{"osd":4,"uuid":"6d4a2c12-adba-4422-8996-d7562dbbd49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6801","nonce":331298306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6803","nonce":331298306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6807","nonce":331298306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":331298306},{"type":"v1","addr":"172.21.15.53:6805","nonce":331298306}]},"public_addr":"172.21.15.53:6801/331298306","cluster_addr":"172.21.15.53:6803/331298306","heartbeat_back_addr":"172.21.15.53:6807/331298306","heartbeat_front_addr":"172.21.15.53:6805/331298306","state":["exists","up"]},{"osd":5,"uuid":"c8687cb8-e78e-4001-a07e-20cffdf5bd66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6809","nonce":3828340653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6811","nonce":3828340653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6815","nonce":3828340653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":3828340653},{"type":"v1","addr":"172.21.15.53:6813","nonce":3828340653}]},"public_addr":"172.21.15.53:6809/3828340653","cluster_addr":"172.21.15.53:6811/3828340653","heartbeat_back_addr":"172.21.15.53:6815/3828340653","heartbeat_front_addr":"172.21.15.53:6813/3828340653","state":["exists","up"]},{"osd":6,"uuid":"3809de92-ab70-43c5-861e-0c7477e17f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6817","nonce":204629598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6819","nonce":204629598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6823","nonce":204629598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":204629598},{"type":"v1","addr":"172.21.15.53:6821","nonce":204629598}]},"public_addr":"172.21.15.53:6817/204629598","cluster_addr":"172.21.15.53:6819/204629598","heartbeat_back_addr":"172.21.15.53:6823/204629598","heartbeat_front_addr":"172.21.15.53:6821/204629598","state":["exists","up"]},{"osd":7,"uuid":"416be35b-2283-4014-be72-4c729adbb6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6825","nonce":841884034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6827","nonce":841884034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6831","nonce":841884034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":841884034},{"type":"v1","addr":"172.21.15.53:6829","nonce":841884034}]},"public_addr":"172.21.15.53:6825/841884034","cluster_addr":"172.21.15.53:6827/841884034","heartbeat_back_addr":"172.21.15.53:6831/841884034","heartbeat_front_addr":"172.21.15.53:6829/841884034","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.541306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.547671+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.614392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.652051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.530355+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.785878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.540042+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T10:51:50.636947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T10:53:26.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.839+0000 7fbd66c00640 1 -- 172.21.15.47:0/879250563 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbd4006c8f0 msgr2=0x7fbd4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:26.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.839+0000 7fbd66c00640 1 --2- 172.21.15.47:0/879250563 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbd4006c8f0 0x7fbd4006edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c034000 tx=0x7fbd4c02e000 comp rx=0 tx=0).stop 2024-05-27T10:53:26.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.839+0000 7fbd66c00640 1 -- 172.21.15.47:0/879250563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600b6000 msgr2=0x7fbd600c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:26.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.839+0000 7fbd66c00640 1 --2- 172.21.15.47:0/879250563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600b6000 0x7fbd600c8aa0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400e7e0 tx=0x7fbd5400eca0 comp rx=0 tx=0).stop 2024-05-27T10:53:26.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.839+0000 7fbd66c00640 1 -- 172.21.15.47:0/879250563 shutdown_connections 2024-05-27T10:53:26.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.839+0000 7fbd66c00640 1 --2- 172.21.15.47:0/879250563 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbd4006c8f0 0x7fbd4006edb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:26.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.839+0000 7fbd66c00640 1 --2- 172.21.15.47:0/879250563 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd6015e880 0x7fbd60158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:26.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.839+0000 7fbd66c00640 1 --2- 172.21.15.47:0/879250563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd600cfac0 0x7fbd600c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:26.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.839+0000 7fbd66c00640 1 --2- 172.21.15.47:0/879250563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600b6000 0x7fbd600c8aa0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:26.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.840+0000 7fbd66c00640 1 -- 172.21.15.47:0/879250563 >> 172.21.15.47:0/879250563 conn(0x7fbd6008bfd0 msgr2=0x7fbd600b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:26.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.840+0000 7fbd66c00640 1 -- 172.21.15.47:0/879250563 shutdown_connections 2024-05-27T10:53:26.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:26.840+0000 7fbd66c00640 1 -- 172.21.15.47:0/879250563 wait complete. 2024-05-27T10:53:26.858 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-27T10:53:26.858 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T10:53:27.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.067+0000 7fde3c000640 1 Processor -- start 2024-05-27T10:53:27.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.067+0000 7fde3c000640 1 -- start start 2024-05-27T10:53:27.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.068+0000 7fde3c000640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fde3415c460 0x7fde340ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:27.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.068+0000 7fde3c000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fde340d0e10 0x7fde3406def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:27.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.068+0000 7fde3c000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde34160140 con 0x7fde3415c840 2024-05-27T10:53:27.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.068+0000 7fde3c000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fde34160420 con 0x7fde340d0e10 2024-05-27T10:53:27.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.068+0000 7fde3c000640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fde34160700 con 0x7fde3415c460 2024-05-27T10:53:27.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.069+0000 7fde38c00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fde3415c840 0x7fde340d0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35928/0 (socket says 172.21.15.47:35928) 2024-05-27T10:53:27.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.069+0000 7fde38c00640 1 -- 172.21.15.47:0/2948985687 learned_addr learned my addr 172.21.15.47:0/2948985687 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:27.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.069+0000 7fde3a000640 1 --2- 172.21.15.47:0/2948985687 >> v2:172.21.15.47:3300/0 conn(0x7fde340d0e10 0x7fde3406def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:27.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.069+0000 7fde39600640 1 --2- 172.21.15.47:0/2948985687 >> v2:172.21.15.53:3300/0 conn(0x7fde3415c460 0x7fde340ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:27.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.069+0000 7fde3a000640 1 -- 172.21.15.47:0/2948985687 >> v2:172.21.15.53:3300/0 conn(0x7fde3415c460 msgr2=0x7fde340ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:27.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.069+0000 7fde3a000640 1 --2- 172.21.15.47:0/2948985687 >> v2:172.21.15.53:3300/0 conn(0x7fde3415c460 0x7fde340ad300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:27.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.069+0000 7fde3a000640 1 -- 172.21.15.47:0/2948985687 >> v1:172.21.15.47:6789/0 conn(0x7fde3415c840 legacy=0x7fde340d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:27.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.069+0000 7fde3a000640 1 -- 172.21.15.47:0/2948985687 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde341609e0 con 0x7fde340d0e10 2024-05-27T10:53:27.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.070+0000 7fde3a000640 1 --2- 172.21.15.47:0/2948985687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde340d0e10 0x7fde3406def0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fde340740a0 tx=0x7fde2c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8ad76ec261da0e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:27.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.071+0000 7fde33e00640 1 -- 172.21.15.47:0/2948985687 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2c037070 con 0x7fde340d0e10 2024-05-27T10:53:27.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.071+0000 7fde33e00640 1 -- 172.21.15.47:0/2948985687 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde2c032440 con 0x7fde340d0e10 2024-05-27T10:53:27.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.071+0000 7fde33e00640 1 -- 172.21.15.47:0/2948985687 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2c02ae60 con 0x7fde340d0e10 2024-05-27T10:53:27.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.071+0000 7fde3c000640 1 -- 172.21.15.47:0/2948985687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde340d0e10 msgr2=0x7fde3406def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:27.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.071+0000 7fde3c000640 1 --2- 172.21.15.47:0/2948985687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde340d0e10 0x7fde3406def0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fde340740a0 tx=0x7fde2c02a110 comp rx=0 tx=0).stop 2024-05-27T10:53:27.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.071+0000 7fde3c000640 1 -- 172.21.15.47:0/2948985687 shutdown_connections 2024-05-27T10:53:27.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.071+0000 7fde3c000640 1 --2- 172.21.15.47:0/2948985687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde340d0e10 0x7fde3406def0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:27.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.071+0000 7fde3c000640 1 --2- 172.21.15.47:0/2948985687 >> v2:172.21.15.53:3300/0 conn(0x7fde3415c460 0x7fde340ad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:27.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.071+0000 7fde3c000640 1 -- 172.21.15.47:0/2948985687 >> 172.21.15.47:0/2948985687 conn(0x7fde3406bd60 msgr2=0x7fde3406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:27.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.072+0000 7fde3c000640 1 -- 172.21.15.47:0/2948985687 shutdown_connections 2024-05-27T10:53:27.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.072+0000 7fde3c000640 1 -- 172.21.15.47:0/2948985687 wait complete. 2024-05-27T10:53:27.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.073+0000 7fde3c000640 1 Processor -- start 2024-05-27T10:53:27.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.074+0000 7fde3c000640 1 -- start start 2024-05-27T10:53:27.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.074+0000 7fde3c000640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde340d0e10 0x7fde3414dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:27.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.075+0000 7fde3c000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3415c460 0x7fde341e7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:27.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.075+0000 7fde3c000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde3415c840 0x7fde341e8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:27.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.075+0000 7fde3c000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fde340ad840 con 0x7fde3415c840 2024-05-27T10:53:27.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.075+0000 7fde3c000640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fde34160fa0 con 0x7fde3415c460 2024-05-27T10:53:27.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.075+0000 7fde3c000640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fde340ad9c0 con 0x7fde340d0e10 2024-05-27T10:53:27.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.075+0000 7fde3a000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde3415c840 0x7fde341e8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:27.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.075+0000 7fde3a000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde3415c840 0x7fde341e8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55054/0 (socket says 172.21.15.47:55054) 2024-05-27T10:53:27.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.075+0000 7fde3a000640 1 -- 172.21.15.47:0/4096025371 learned_addr learned my addr 172.21.15.47:0/4096025371 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:27.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.075+0000 7fde39600640 1 --2- 172.21.15.47:0/4096025371 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde340d0e10 0x7fde3414dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:27.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.075+0000 7fde38c00640 1 --2- 172.21.15.47:0/4096025371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3415c460 0x7fde341e7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:27.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.075+0000 7fde3a000640 1 -- 172.21.15.47:0/4096025371 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde340d0e10 msgr2=0x7fde3414dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:27.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.075+0000 7fde3a000640 1 --2- 172.21.15.47:0/4096025371 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde340d0e10 0x7fde3414dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:27.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.075+0000 7fde3a000640 1 -- 172.21.15.47:0/4096025371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3415c460 msgr2=0x7fde341e7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:27.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.075+0000 7fde3a000640 1 --2- 172.21.15.47:0/4096025371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3415c460 0x7fde341e7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:27.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.075+0000 7fde3a000640 1 -- 172.21.15.47:0/4096025371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde3415f730 con 0x7fde3415c840 2024-05-27T10:53:27.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.075+0000 7fde38c00640 1 --2- 172.21.15.47:0/4096025371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3415c460 0x7fde341e7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:27.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.076+0000 7fde3a000640 1 --2- 172.21.15.47:0/4096025371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde3415c840 0x7fde341e8280 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fde2c035040 tx=0x7fde2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:27.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.076+0000 7fde31600640 1 -- 172.21.15.47:0/4096025371 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2c037040 con 0x7fde3415c840 2024-05-27T10:53:27.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.076+0000 7fde31600640 1 -- 172.21.15.47:0/4096025371 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde2c042070 con 0x7fde3415c840 2024-05-27T10:53:27.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.076+0000 7fde31600640 1 -- 172.21.15.47:0/4096025371 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2c0308a0 con 0x7fde3415c840 2024-05-27T10:53:27.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.076+0000 7fde3c000640 1 -- 172.21.15.47:0/4096025371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde3415f9d0 con 0x7fde3415c840 2024-05-27T10:53:27.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.076+0000 7fde3c000640 1 -- 172.21.15.47:0/4096025371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde3415dbe0 con 0x7fde3415c840 2024-05-27T10:53:27.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.078+0000 7fde3c000640 1 -- 172.21.15.47:0/4096025371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde340689e0 con 0x7fde3415c840 2024-05-27T10:53:27.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.079+0000 7fde31600640 1 -- 172.21.15.47:0/4096025371 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fde2c030a40 con 0x7fde3415c840 2024-05-27T10:53:27.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.080+0000 7fde31600640 1 --2- 172.21.15.47:0/4096025371 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fde1806c8f0 0x7fde1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:27.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.080+0000 7fde31600640 1 -- 172.21.15.47:0/4096025371 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fde2c0ac450 con 0x7fde3415c840 2024-05-27T10:53:27.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.080+0000 7fde39600640 1 --2- 172.21.15.47:0/4096025371 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fde1806c8f0 0x7fde1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:27.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.081+0000 7fde39600640 1 --2- 172.21.15.47:0/4096025371 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fde1806c8f0 0x7fde1806edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fde3415b640 tx=0x7fde28008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:27.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.085+0000 7fde31600640 1 -- 172.21.15.47:0/4096025371 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fde2c07a910 con 0x7fde3415c840 2024-05-27T10:53:27.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.289+0000 7fde3c000640 1 -- 172.21.15.47:0/4096025371 --> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fde341577a0 con 0x7fde1806c8f0 2024-05-27T10:53:27.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.312+0000 7fde31600640 1 -- 172.21.15.47:0/4096025371 <== mgr.4108 v2:172.21.15.47:6832/3679485934 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251918 (secure 0 0 0) 0x7fde341577a0 con 0x7fde1806c8f0 2024-05-27T10:53:27.312 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:53:27.314 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-27T10:53:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.318+0000 7fde3c000640 1 -- 172.21.15.47:0/4096025371 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fde1806c8f0 msgr2=0x7fde1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.318+0000 7fde3c000640 1 --2- 172.21.15.47:0/4096025371 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fde1806c8f0 0x7fde1806edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fde3415b640 tx=0x7fde28008040 comp rx=0 tx=0).stop 2024-05-27T10:53:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.318+0000 7fde3c000640 1 -- 172.21.15.47:0/4096025371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde3415c840 msgr2=0x7fde341e8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.318+0000 7fde3c000640 1 --2- 172.21.15.47:0/4096025371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde3415c840 0x7fde341e8280 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fde2c035040 tx=0x7fde2c0046c0 comp rx=0 tx=0).stop 2024-05-27T10:53:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.319+0000 7fde3c000640 1 -- 172.21.15.47:0/4096025371 shutdown_connections 2024-05-27T10:53:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.319+0000 7fde3c000640 1 --2- 172.21.15.47:0/4096025371 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fde1806c8f0 0x7fde1806edb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.319+0000 7fde3c000640 1 --2- 172.21.15.47:0/4096025371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde3415c840 0x7fde341e8280 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.319+0000 7fde3c000640 1 --2- 172.21.15.47:0/4096025371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3415c460 0x7fde341e7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.319+0000 7fde3c000640 1 --2- 172.21.15.47:0/4096025371 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde340d0e10 0x7fde3414dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.319+0000 7fde3c000640 1 -- 172.21.15.47:0/4096025371 >> 172.21.15.47:0/4096025371 conn(0x7fde3406bd60 msgr2=0x7fde3406dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:27.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.319+0000 7fde3c000640 1 -- 172.21.15.47:0/4096025371 shutdown_connections 2024-05-27T10:53:27.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.319+0000 7fde3c000640 1 -- 172.21.15.47:0/4096025371 wait complete. 2024-05-27T10:53:27.336 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-05-27T10:53:27.065234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253504,"kb_used_data":4052,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721216,"statfs":{"total":773094113280,"available":772834525184,"internally_reserved":0,"allocated":4149248,"data_stored":2314384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001750"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.867263+0000","last_change":"2024-05-27T10:53:22.866251+0000","last_active":"2024-05-27T10:53:22.867263+0000","last_peered":"2024-05-27T10:53:22.867263+0000","last_clean":"2024-05-27T10:53:22.867263+0000","last_became_active":"2024-05-27T10:53:22.862148+0000","last_became_peered":"2024-05-27T10:53:22.862148+0000","last_unstale":"2024-05-27T10:53:22.867263+0000","last_undegraded":"2024-05-27T10:53:22.867263+0000","last_fullsized":"2024-05-27T10:53:22.867263+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:51:43.718521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.853504+0000","last_change":"2024-05-27T10:53:22.857386+0000","last_active":"2024-05-27T10:53:23.853504+0000","last_peered":"2024-05-27T10:53:23.853504+0000","last_clean":"2024-05-27T10:53:23.853504+0000","last_became_active":"2024-05-27T10:53:22.856874+0000","last_became_peered":"2024-05-27T10:53:22.856874+0000","last_unstale":"2024-05-27T10:53:23.853504+0000","last_undegraded":"2024-05-27T10:53:23.853504+0000","last_fullsized":"2024-05-27T10:53:23.853504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:34.606091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.869274+0000","last_change":"2024-05-27T10:53:22.867374+0000","last_active":"2024-05-27T10:53:22.869274+0000","last_peered":"2024-05-27T10:53:22.869274+0000","last_clean":"2024-05-27T10:53:22.869274+0000","last_became_active":"2024-05-27T10:53:22.865680+0000","last_became_peered":"2024-05-27T10:53:22.865680+0000","last_unstale":"2024-05-27T10:53:22.869274+0000","last_undegraded":"2024-05-27T10:53:22.869274+0000","last_fullsized":"2024-05-27T10:53:22.869274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:53:10.724493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.870629+0000","last_change":"2024-05-27T10:53:22.865597+0000","last_active":"2024-05-27T10:53:22.870629+0000","last_peered":"2024-05-27T10:53:22.870629+0000","last_clean":"2024-05-27T10:53:22.870629+0000","last_became_active":"2024-05-27T10:53:22.865319+0000","last_became_peered":"2024-05-27T10:53:22.865319+0000","last_unstale":"2024-05-27T10:53:22.870629+0000","last_undegraded":"2024-05-27T10:53:22.870629+0000","last_fullsized":"2024-05-27T10:53:22.870629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:39:47.386726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851977+0000","last_change":"2024-05-27T10:53:22.865928+0000","last_active":"2024-05-27T10:53:23.851977+0000","last_peered":"2024-05-27T10:53:23.851977+0000","last_clean":"2024-05-27T10:53:23.851977+0000","last_became_active":"2024-05-27T10:53:22.865626+0000","last_became_peered":"2024-05-27T10:53:22.865626+0000","last_unstale":"2024-05-27T10:53:23.851977+0000","last_undegraded":"2024-05-27T10:53:23.851977+0000","last_fullsized":"2024-05-27T10:53:23.851977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:51:50.348279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.852636+0000","last_change":"2024-05-27T10:53:22.863701+0000","last_active":"2024-05-27T10:53:23.852636+0000","last_peered":"2024-05-27T10:53:23.852636+0000","last_clean":"2024-05-27T10:53:23.852636+0000","last_became_active":"2024-05-27T10:53:22.862781+0000","last_became_peered":"2024-05-27T10:53:22.862781+0000","last_unstale":"2024-05-27T10:53:23.852636+0000","last_undegraded":"2024-05-27T10:53:23.852636+0000","last_fullsized":"2024-05-27T10:53:23.852636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:01:26.220914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.961206+0000","last_change":"2024-05-27T10:53:22.862810+0000","last_active":"2024-05-27T10:53:23.961206+0000","last_peered":"2024-05-27T10:53:23.961206+0000","last_clean":"2024-05-27T10:53:23.961206+0000","last_became_active":"2024-05-27T10:53:22.862128+0000","last_became_peered":"2024-05-27T10:53:22.862128+0000","last_unstale":"2024-05-27T10:53:23.961206+0000","last_undegraded":"2024-05-27T10:53:23.961206+0000","last_fullsized":"2024-05-27T10:53:23.961206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:12:39.009218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.960722+0000","last_change":"2024-05-27T10:53:22.850921+0000","last_active":"2024-05-27T10:53:23.960722+0000","last_peered":"2024-05-27T10:53:23.960722+0000","last_clean":"2024-05-27T10:53:23.960722+0000","last_became_active":"2024-05-27T10:53:22.849626+0000","last_became_peered":"2024-05-27T10:53:22.849626+0000","last_unstale":"2024-05-27T10:53:23.960722+0000","last_undegraded":"2024-05-27T10:53:23.960722+0000","last_fullsized":"2024-05-27T10:53:23.960722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:19:00.382738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.852101+0000","last_change":"2024-05-27T10:53:22.865486+0000","last_active":"2024-05-27T10:53:23.852101+0000","last_peered":"2024-05-27T10:53:23.852101+0000","last_clean":"2024-05-27T10:53:23.852101+0000","last_became_active":"2024-05-27T10:53:22.865200+0000","last_became_peered":"2024-05-27T10:53:22.865200+0000","last_unstale":"2024-05-27T10:53:23.852101+0000","last_undegraded":"2024-05-27T10:53:23.852101+0000","last_fullsized":"2024-05-27T10:53:23.852101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:38:30.803119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.875671+0000","last_change":"2024-05-27T10:53:22.872971+0000","last_active":"2024-05-27T10:53:22.875671+0000","last_peered":"2024-05-27T10:53:22.875671+0000","last_clean":"2024-05-27T10:53:22.875671+0000","last_became_active":"2024-05-27T10:53:22.872703+0000","last_became_peered":"2024-05-27T10:53:22.872703+0000","last_unstale":"2024-05-27T10:53:22.875671+0000","last_undegraded":"2024-05-27T10:53:22.875671+0000","last_fullsized":"2024-05-27T10:53:22.875671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:33:26.866748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.961426+0000","last_change":"2024-05-27T10:53:22.859842+0000","last_active":"2024-05-27T10:53:23.961426+0000","last_peered":"2024-05-27T10:53:23.961426+0000","last_clean":"2024-05-27T10:53:23.961426+0000","last_became_active":"2024-05-27T10:53:22.857618+0000","last_became_peered":"2024-05-27T10:53:22.857618+0000","last_unstale":"2024-05-27T10:53:23.961426+0000","last_undegraded":"2024-05-27T10:53:23.961426+0000","last_fullsized":"2024-05-27T10:53:23.961426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:17:36.654521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.859492+0000","last_change":"2024-05-27T10:53:22.853264+0000","last_active":"2024-05-27T10:53:22.859492+0000","last_peered":"2024-05-27T10:53:22.859492+0000","last_clean":"2024-05-27T10:53:22.859492+0000","last_became_active":"2024-05-27T10:53:22.852715+0000","last_became_peered":"2024-05-27T10:53:22.852715+0000","last_unstale":"2024-05-27T10:53:22.859492+0000","last_undegraded":"2024-05-27T10:53:22.859492+0000","last_fullsized":"2024-05-27T10:53:22.859492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:00:28.398086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850551+0000","last_change":"2024-05-27T10:53:22.847608+0000","last_active":"2024-05-27T10:53:23.850551+0000","last_peered":"2024-05-27T10:53:23.850551+0000","last_clean":"2024-05-27T10:53:23.850551+0000","last_became_active":"2024-05-27T10:53:22.847337+0000","last_became_peered":"2024-05-27T10:53:22.847337+0000","last_unstale":"2024-05-27T10:53:23.850551+0000","last_undegraded":"2024-05-27T10:53:23.850551+0000","last_fullsized":"2024-05-27T10:53:23.850551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:01:45.991716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.853053+0000","last_change":"2024-05-27T10:53:22.852678+0000","last_active":"2024-05-27T10:53:23.853053+0000","last_peered":"2024-05-27T10:53:23.853053+0000","last_clean":"2024-05-27T10:53:23.853053+0000","last_became_active":"2024-05-27T10:53:22.852324+0000","last_became_peered":"2024-05-27T10:53:22.852324+0000","last_unstale":"2024-05-27T10:53:23.853053+0000","last_undegraded":"2024-05-27T10:53:23.853053+0000","last_fullsized":"2024-05-27T10:53:23.853053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:43:46.639026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.867715+0000","last_change":"2024-05-27T10:53:22.865808+0000","last_active":"2024-05-27T10:53:22.867715+0000","last_peered":"2024-05-27T10:53:22.867715+0000","last_clean":"2024-05-27T10:53:22.867715+0000","last_became_active":"2024-05-27T10:53:22.865441+0000","last_became_peered":"2024-05-27T10:53:22.865441+0000","last_unstale":"2024-05-27T10:53:22.867715+0000","last_undegraded":"2024-05-27T10:53:22.867715+0000","last_fullsized":"2024-05-27T10:53:22.867715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:54:28.408651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.962176+0000","last_change":"2024-05-27T10:53:22.853558+0000","last_active":"2024-05-27T10:53:23.962176+0000","last_peered":"2024-05-27T10:53:23.962176+0000","last_clean":"2024-05-27T10:53:23.962176+0000","last_became_active":"2024-05-27T10:53:22.853275+0000","last_became_peered":"2024-05-27T10:53:22.853275+0000","last_unstale":"2024-05-27T10:53:23.962176+0000","last_undegraded":"2024-05-27T10:53:23.962176+0000","last_fullsized":"2024-05-27T10:53:23.962176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:38:46.654292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.961474+0000","last_change":"2024-05-27T10:53:22.852921+0000","last_active":"2024-05-27T10:53:23.961474+0000","last_peered":"2024-05-27T10:53:23.961474+0000","last_clean":"2024-05-27T10:53:23.961474+0000","last_became_active":"2024-05-27T10:53:22.852636+0000","last_became_peered":"2024-05-27T10:53:22.852636+0000","last_unstale":"2024-05-27T10:53:23.961474+0000","last_undegraded":"2024-05-27T10:53:23.961474+0000","last_fullsized":"2024-05-27T10:53:23.961474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:13:17.380852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.853585+0000","last_change":"2024-05-27T10:53:22.857136+0000","last_active":"2024-05-27T10:53:23.853585+0000","last_peered":"2024-05-27T10:53:23.853585+0000","last_clean":"2024-05-27T10:53:23.853585+0000","last_became_active":"2024-05-27T10:53:22.856265+0000","last_became_peered":"2024-05-27T10:53:22.856265+0000","last_unstale":"2024-05-27T10:53:23.853585+0000","last_undegraded":"2024-05-27T10:53:23.853585+0000","last_fullsized":"2024-05-27T10:53:23.853585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:26:00.846616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.853725+0000","last_change":"2024-05-27T10:53:22.866122+0000","last_active":"2024-05-27T10:53:23.853725+0000","last_peered":"2024-05-27T10:53:23.853725+0000","last_clean":"2024-05-27T10:53:23.853725+0000","last_became_active":"2024-05-27T10:53:22.865760+0000","last_became_peered":"2024-05-27T10:53:22.865760+0000","last_unstale":"2024-05-27T10:53:23.853725+0000","last_undegraded":"2024-05-27T10:53:23.853725+0000","last_fullsized":"2024-05-27T10:53:23.853725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:38:46.654292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850591+0000","last_change":"2024-05-27T10:53:22.861407+0000","last_active":"2024-05-27T10:53:23.850591+0000","last_peered":"2024-05-27T10:53:23.850591+0000","last_clean":"2024-05-27T10:53:23.850591+0000","last_became_active":"2024-05-27T10:53:22.861015+0000","last_became_peered":"2024-05-27T10:53:22.861015+0000","last_unstale":"2024-05-27T10:53:23.850591+0000","last_undegraded":"2024-05-27T10:53:23.850591+0000","last_fullsized":"2024-05-27T10:53:23.850591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:51.073081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851545+0000","last_change":"2024-05-27T10:53:22.839434+0000","last_active":"2024-05-27T10:53:23.851545+0000","last_peered":"2024-05-27T10:53:23.851545+0000","last_clean":"2024-05-27T10:53:23.851545+0000","last_became_active":"2024-05-27T10:53:22.838870+0000","last_became_peered":"2024-05-27T10:53:22.838870+0000","last_unstale":"2024-05-27T10:53:23.851545+0000","last_undegraded":"2024-05-27T10:53:23.851545+0000","last_fullsized":"2024-05-27T10:53:23.851545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:54:28.408651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851217+0000","last_change":"2024-05-27T10:53:22.840373+0000","last_active":"2024-05-27T10:53:23.851217+0000","last_peered":"2024-05-27T10:53:23.851217+0000","last_clean":"2024-05-27T10:53:23.851217+0000","last_became_active":"2024-05-27T10:53:22.840039+0000","last_became_peered":"2024-05-27T10:53:22.840039+0000","last_unstale":"2024-05-27T10:53:23.851217+0000","last_undegraded":"2024-05-27T10:53:23.851217+0000","last_fullsized":"2024-05-27T10:53:23.851217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:27:29.011353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.860962+0000","last_change":"2024-05-27T10:53:22.858138+0000","last_active":"2024-05-27T10:53:22.860962+0000","last_peered":"2024-05-27T10:53:22.860962+0000","last_clean":"2024-05-27T10:53:22.860962+0000","last_became_active":"2024-05-27T10:53:22.854090+0000","last_became_peered":"2024-05-27T10:53:22.854090+0000","last_unstale":"2024-05-27T10:53:22.860962+0000","last_undegraded":"2024-05-27T10:53:22.860962+0000","last_fullsized":"2024-05-27T10:53:22.860962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:20.391795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.856446+0000","last_change":"2024-05-27T10:53:22.847363+0000","last_active":"2024-05-27T10:53:22.856446+0000","last_peered":"2024-05-27T10:53:22.856446+0000","last_clean":"2024-05-27T10:53:22.856446+0000","last_became_active":"2024-05-27T10:53:22.847097+0000","last_became_peered":"2024-05-27T10:53:22.847097+0000","last_unstale":"2024-05-27T10:53:22.856446+0000","last_undegraded":"2024-05-27T10:53:22.856446+0000","last_fullsized":"2024-05-27T10:53:22.856446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:57:02.366139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.868940+0000","last_change":"2024-05-27T10:53:22.862215+0000","last_active":"2024-05-27T10:53:22.868940+0000","last_peered":"2024-05-27T10:53:22.868940+0000","last_clean":"2024-05-27T10:53:22.868940+0000","last_became_active":"2024-05-27T10:53:22.861915+0000","last_became_peered":"2024-05-27T10:53:22.861915+0000","last_unstale":"2024-05-27T10:53:22.868940+0000","last_undegraded":"2024-05-27T10:53:22.868940+0000","last_fullsized":"2024-05-27T10:53:22.868940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:33:07.238602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.853756+0000","last_change":"2024-05-27T10:53:22.849359+0000","last_active":"2024-05-27T10:53:23.853756+0000","last_peered":"2024-05-27T10:53:23.853756+0000","last_clean":"2024-05-27T10:53:23.853756+0000","last_became_active":"2024-05-27T10:53:22.849013+0000","last_became_peered":"2024-05-27T10:53:22.849013+0000","last_unstale":"2024-05-27T10:53:23.853756+0000","last_undegraded":"2024-05-27T10:53:23.853756+0000","last_fullsized":"2024-05-27T10:53:23.853756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:17:38.080730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.869092+0000","last_change":"2024-05-27T10:53:22.863215+0000","last_active":"2024-05-27T10:53:22.869092+0000","last_peered":"2024-05-27T10:53:22.869092+0000","last_clean":"2024-05-27T10:53:22.869092+0000","last_became_active":"2024-05-27T10:53:22.862926+0000","last_became_peered":"2024-05-27T10:53:22.862926+0000","last_unstale":"2024-05-27T10:53:22.869092+0000","last_undegraded":"2024-05-27T10:53:22.869092+0000","last_fullsized":"2024-05-27T10:53:22.869092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:23:39.238652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.859512+0000","last_change":"2024-05-27T10:53:22.855589+0000","last_active":"2024-05-27T10:53:22.859512+0000","last_peered":"2024-05-27T10:53:22.859512+0000","last_clean":"2024-05-27T10:53:22.859512+0000","last_became_active":"2024-05-27T10:53:22.855334+0000","last_became_peered":"2024-05-27T10:53:22.855334+0000","last_unstale":"2024-05-27T10:53:22.859512+0000","last_undegraded":"2024-05-27T10:53:22.859512+0000","last_fullsized":"2024-05-27T10:53:22.859512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:33:26.866748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851393+0000","last_change":"2024-05-27T10:53:22.845981+0000","last_active":"2024-05-27T10:53:23.851393+0000","last_peered":"2024-05-27T10:53:23.851393+0000","last_clean":"2024-05-27T10:53:23.851393+0000","last_became_active":"2024-05-27T10:53:22.845513+0000","last_became_peered":"2024-05-27T10:53:22.845513+0000","last_unstale":"2024-05-27T10:53:23.851393+0000","last_undegraded":"2024-05-27T10:53:23.851393+0000","last_fullsized":"2024-05-27T10:53:23.851393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:00:46.823241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.960985+0000","last_change":"2024-05-27T10:53:22.854712+0000","last_active":"2024-05-27T10:53:23.960985+0000","last_peered":"2024-05-27T10:53:23.960985+0000","last_clean":"2024-05-27T10:53:23.960985+0000","last_became_active":"2024-05-27T10:53:22.854348+0000","last_became_peered":"2024-05-27T10:53:22.854348+0000","last_unstale":"2024-05-27T10:53:23.960985+0000","last_undegraded":"2024-05-27T10:53:23.960985+0000","last_fullsized":"2024-05-27T10:53:23.960985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:01:26.220914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.859247+0000","last_change":"2024-05-27T10:53:22.853256+0000","last_active":"2024-05-27T10:53:22.859247+0000","last_peered":"2024-05-27T10:53:22.859247+0000","last_clean":"2024-05-27T10:53:22.859247+0000","last_became_active":"2024-05-27T10:53:22.852969+0000","last_became_peered":"2024-05-27T10:53:22.852969+0000","last_unstale":"2024-05-27T10:53:22.859247+0000","last_undegraded":"2024-05-27T10:53:22.859247+0000","last_fullsized":"2024-05-27T10:53:22.859247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:51:50.348279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.961569+0000","last_change":"2024-05-27T10:53:22.858038+0000","last_active":"2024-05-27T10:53:23.961569+0000","last_peered":"2024-05-27T10:53:23.961569+0000","last_clean":"2024-05-27T10:53:23.961569+0000","last_became_active":"2024-05-27T10:53:22.857705+0000","last_became_peered":"2024-05-27T10:53:22.857705+0000","last_unstale":"2024-05-27T10:53:23.961569+0000","last_undegraded":"2024-05-27T10:53:23.961569+0000","last_fullsized":"2024-05-27T10:53:23.961569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:34.606091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.857791+0000","last_change":"2024-05-27T10:53:22.856014+0000","last_active":"2024-05-27T10:53:22.857791+0000","last_peered":"2024-05-27T10:53:22.857791+0000","last_clean":"2024-05-27T10:53:22.857791+0000","last_became_active":"2024-05-27T10:53:22.855739+0000","last_became_peered":"2024-05-27T10:53:22.855739+0000","last_unstale":"2024-05-27T10:53:22.857791+0000","last_undegraded":"2024-05-27T10:53:22.857791+0000","last_fullsized":"2024-05-27T10:53:22.857791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:55:31.722504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.862568+0000","last_change":"2024-05-27T10:53:21.853935+0000","last_active":"2024-05-27T10:53:22.862568+0000","last_peered":"2024-05-27T10:53:22.862568+0000","last_clean":"2024-05-27T10:53:22.862568+0000","last_became_active":"2024-05-27T10:53:21.853021+0000","last_became_peered":"2024-05-27T10:53:21.853021+0000","last_unstale":"2024-05-27T10:53:22.862568+0000","last_undegraded":"2024-05-27T10:53:22.862568+0000","last_fullsized":"2024-05-27T10:53:22.862568+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:52:35.726060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.859677+0000","last_change":"2024-05-27T10:53:22.857744+0000","last_active":"2024-05-27T10:53:22.859677+0000","last_peered":"2024-05-27T10:53:22.859677+0000","last_clean":"2024-05-27T10:53:22.859677+0000","last_became_active":"2024-05-27T10:53:22.857344+0000","last_became_peered":"2024-05-27T10:53:22.857344+0000","last_unstale":"2024-05-27T10:53:22.859677+0000","last_undegraded":"2024-05-27T10:53:22.859677+0000","last_fullsized":"2024-05-27T10:53:22.859677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:55:31.722504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.861238+0000","last_change":"2024-05-27T10:53:21.856567+0000","last_active":"2024-05-27T10:53:22.861238+0000","last_peered":"2024-05-27T10:53:22.861238+0000","last_clean":"2024-05-27T10:53:22.861238+0000","last_became_active":"2024-05-27T10:53:21.856216+0000","last_became_peered":"2024-05-27T10:53:21.856216+0000","last_unstale":"2024-05-27T10:53:22.861238+0000","last_undegraded":"2024-05-27T10:53:22.861238+0000","last_fullsized":"2024-05-27T10:53:22.861238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:01:44.974858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851414+0000","last_change":"2024-05-27T10:53:22.854317+0000","last_active":"2024-05-27T10:53:23.851414+0000","last_peered":"2024-05-27T10:53:23.851414+0000","last_clean":"2024-05-27T10:53:23.851414+0000","last_became_active":"2024-05-27T10:53:22.853979+0000","last_became_peered":"2024-05-27T10:53:22.853979+0000","last_unstale":"2024-05-27T10:53:23.851414+0000","last_undegraded":"2024-05-27T10:53:23.851414+0000","last_fullsized":"2024-05-27T10:53:23.851414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:33:26.866748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.854006+0000","last_change":"2024-05-27T10:53:21.847417+0000","last_active":"2024-05-27T10:53:23.854006+0000","last_peered":"2024-05-27T10:53:23.854006+0000","last_clean":"2024-05-27T10:53:23.854006+0000","last_became_active":"2024-05-27T10:53:21.847108+0000","last_became_peered":"2024-05-27T10:53:21.847108+0000","last_unstale":"2024-05-27T10:53:23.854006+0000","last_undegraded":"2024-05-27T10:53:23.854006+0000","last_fullsized":"2024-05-27T10:53:23.854006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:23:38.221794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.870348+0000","last_change":"2024-05-27T10:53:22.868434+0000","last_active":"2024-05-27T10:53:22.870348+0000","last_peered":"2024-05-27T10:53:22.870348+0000","last_clean":"2024-05-27T10:53:22.870348+0000","last_became_active":"2024-05-27T10:53:22.863198+0000","last_became_peered":"2024-05-27T10:53:22.863198+0000","last_unstale":"2024-05-27T10:53:22.870348+0000","last_undegraded":"2024-05-27T10:53:22.870348+0000","last_fullsized":"2024-05-27T10:53:22.870348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:00:46.823241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850912+0000","last_change":"2024-05-27T10:53:21.849165+0000","last_active":"2024-05-27T10:53:23.850912+0000","last_peered":"2024-05-27T10:53:23.850912+0000","last_clean":"2024-05-27T10:53:23.850912+0000","last_became_active":"2024-05-27T10:53:21.848845+0000","last_became_peered":"2024-05-27T10:53:21.848845+0000","last_unstale":"2024-05-27T10:53:23.850912+0000","last_undegraded":"2024-05-27T10:53:23.850912+0000","last_fullsized":"2024-05-27T10:53:23.850912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:58:24.719173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.960954+0000","last_change":"2024-05-27T10:53:22.860122+0000","last_active":"2024-05-27T10:53:23.960954+0000","last_peered":"2024-05-27T10:53:23.960954+0000","last_clean":"2024-05-27T10:53:23.960954+0000","last_became_active":"2024-05-27T10:53:22.858031+0000","last_became_peered":"2024-05-27T10:53:22.858031+0000","last_unstale":"2024-05-27T10:53:23.960954+0000","last_undegraded":"2024-05-27T10:53:23.960954+0000","last_fullsized":"2024-05-27T10:53:23.960954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:47.477033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851703+0000","last_change":"2024-05-27T10:53:21.851395+0000","last_active":"2024-05-27T10:53:23.851703+0000","last_peered":"2024-05-27T10:53:23.851703+0000","last_clean":"2024-05-27T10:53:23.851703+0000","last_became_active":"2024-05-27T10:53:21.846968+0000","last_became_peered":"2024-05-27T10:53:21.846968+0000","last_unstale":"2024-05-27T10:53:23.851703+0000","last_undegraded":"2024-05-27T10:53:23.851703+0000","last_fullsized":"2024-05-27T10:53:23.851703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:53:59.154416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.858690+0000","last_change":"2024-05-27T10:53:22.854974+0000","last_active":"2024-05-27T10:53:22.858690+0000","last_peered":"2024-05-27T10:53:22.858690+0000","last_clean":"2024-05-27T10:53:22.858690+0000","last_became_active":"2024-05-27T10:53:22.854718+0000","last_became_peered":"2024-05-27T10:53:22.854718+0000","last_unstale":"2024-05-27T10:53:22.858690+0000","last_undegraded":"2024-05-27T10:53:22.858690+0000","last_fullsized":"2024-05-27T10:53:22.858690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:00:46.823241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851212+0000","last_change":"2024-05-27T10:53:21.846948+0000","last_active":"2024-05-27T10:53:23.851212+0000","last_peered":"2024-05-27T10:53:23.851212+0000","last_clean":"2024-05-27T10:53:23.851212+0000","last_became_active":"2024-05-27T10:53:21.846619+0000","last_became_peered":"2024-05-27T10:53:21.846619+0000","last_unstale":"2024-05-27T10:53:23.851212+0000","last_undegraded":"2024-05-27T10:53:23.851212+0000","last_fullsized":"2024-05-27T10:53:23.851212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:35:08.749848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850561+0000","last_change":"2024-05-27T10:53:22.866171+0000","last_active":"2024-05-27T10:53:23.850561+0000","last_peered":"2024-05-27T10:53:23.850561+0000","last_clean":"2024-05-27T10:53:23.850561+0000","last_became_active":"2024-05-27T10:53:22.854348+0000","last_became_peered":"2024-05-27T10:53:22.854348+0000","last_unstale":"2024-05-27T10:53:23.850561+0000","last_undegraded":"2024-05-27T10:53:23.850561+0000","last_fullsized":"2024-05-27T10:53:23.850561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:39:47.386726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.852284+0000","last_change":"2024-05-27T10:53:21.838078+0000","last_active":"2024-05-27T10:53:23.852284+0000","last_peered":"2024-05-27T10:53:23.852284+0000","last_clean":"2024-05-27T10:53:23.852284+0000","last_became_active":"2024-05-27T10:53:21.837747+0000","last_became_peered":"2024-05-27T10:53:21.837747+0000","last_unstale":"2024-05-27T10:53:23.852284+0000","last_undegraded":"2024-05-27T10:53:23.852284+0000","last_fullsized":"2024-05-27T10:53:23.852284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:33:06.221744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.870036+0000","last_change":"2024-05-27T10:53:22.866282+0000","last_active":"2024-05-27T10:53:22.870036+0000","last_peered":"2024-05-27T10:53:22.870036+0000","last_clean":"2024-05-27T10:53:22.870036+0000","last_became_active":"2024-05-27T10:53:22.865974+0000","last_became_peered":"2024-05-27T10:53:22.865974+0000","last_unstale":"2024-05-27T10:53:22.870036+0000","last_undegraded":"2024-05-27T10:53:22.870036+0000","last_fullsized":"2024-05-27T10:53:22.870036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:00:28.398086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850770+0000","last_change":"2024-05-27T10:53:21.848915+0000","last_active":"2024-05-27T10:53:23.850770+0000","last_peered":"2024-05-27T10:53:23.850770+0000","last_clean":"2024-05-27T10:53:23.850770+0000","last_became_active":"2024-05-27T10:53:21.848617+0000","last_became_peered":"2024-05-27T10:53:21.848617+0000","last_unstale":"2024-05-27T10:53:23.850770+0000","last_undegraded":"2024-05-27T10:53:23.850770+0000","last_fullsized":"2024-05-27T10:53:23.850770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:09:31.216390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.858954+0000","last_change":"2024-05-27T10:53:22.851589+0000","last_active":"2024-05-27T10:53:22.858954+0000","last_peered":"2024-05-27T10:53:22.858954+0000","last_clean":"2024-05-27T10:53:22.858954+0000","last_became_active":"2024-05-27T10:53:22.851026+0000","last_became_peered":"2024-05-27T10:53:22.851026+0000","last_unstale":"2024-05-27T10:53:22.858954+0000","last_undegraded":"2024-05-27T10:53:22.858954+0000","last_fullsized":"2024-05-27T10:53:22.858954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:39:47.386726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.853920+0000","last_change":"2024-05-27T10:53:21.856631+0000","last_active":"2024-05-27T10:53:23.853920+0000","last_peered":"2024-05-27T10:53:23.853920+0000","last_clean":"2024-05-27T10:53:23.853920+0000","last_became_active":"2024-05-27T10:53:21.856076+0000","last_became_peered":"2024-05-27T10:53:21.856076+0000","last_unstale":"2024-05-27T10:53:23.853920+0000","last_undegraded":"2024-05-27T10:53:23.853920+0000","last_fullsized":"2024-05-27T10:53:23.853920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:39:46.369868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.853498+0000","last_change":"2024-05-27T10:53:22.868451+0000","last_active":"2024-05-27T10:53:23.853498+0000","last_peered":"2024-05-27T10:53:23.853498+0000","last_clean":"2024-05-27T10:53:23.853498+0000","last_became_active":"2024-05-27T10:53:22.866072+0000","last_became_peered":"2024-05-27T10:53:22.866072+0000","last_unstale":"2024-05-27T10:53:23.853498+0000","last_undegraded":"2024-05-27T10:53:23.853498+0000","last_fullsized":"2024-05-27T10:53:23.853498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:13:17.380852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.834209+0000","last_change":"2024-05-27T10:53:21.841349+0000","last_active":"2024-05-27T10:53:22.834209+0000","last_peered":"2024-05-27T10:53:22.834209+0000","last_clean":"2024-05-27T10:53:22.834209+0000","last_became_active":"2024-05-27T10:53:21.841065+0000","last_became_peered":"2024-05-27T10:53:21.841065+0000","last_unstale":"2024-05-27T10:53:22.834209+0000","last_undegraded":"2024-05-27T10:53:22.834209+0000","last_fullsized":"2024-05-27T10:53:22.834209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:50.056223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.853299+0000","last_change":"2024-05-27T10:53:22.846257+0000","last_active":"2024-05-27T10:53:23.853299+0000","last_peered":"2024-05-27T10:53:23.853299+0000","last_clean":"2024-05-27T10:53:23.853299+0000","last_became_active":"2024-05-27T10:53:22.845968+0000","last_became_peered":"2024-05-27T10:53:22.845968+0000","last_unstale":"2024-05-27T10:53:23.853299+0000","last_undegraded":"2024-05-27T10:53:23.853299+0000","last_fullsized":"2024-05-27T10:53:23.853299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:17:36.654521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.865395+0000","last_change":"2024-05-27T10:53:21.851797+0000","last_active":"2024-05-27T10:53:22.865395+0000","last_peered":"2024-05-27T10:53:22.865395+0000","last_clean":"2024-05-27T10:53:22.865395+0000","last_became_active":"2024-05-27T10:53:21.851519+0000","last_became_peered":"2024-05-27T10:53:21.851519+0000","last_unstale":"2024-05-27T10:53:22.865395+0000","last_undegraded":"2024-05-27T10:53:22.865395+0000","last_fullsized":"2024-05-27T10:53:22.865395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:23:38.221794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.869298+0000","last_change":"2024-05-27T10:53:22.867460+0000","last_active":"2024-05-27T10:53:22.869298+0000","last_peered":"2024-05-27T10:53:22.869298+0000","last_clean":"2024-05-27T10:53:22.869298+0000","last_became_active":"2024-05-27T10:53:22.867142+0000","last_became_peered":"2024-05-27T10:53:22.867142+0000","last_unstale":"2024-05-27T10:53:22.869298+0000","last_undegraded":"2024-05-27T10:53:22.869298+0000","last_fullsized":"2024-05-27T10:53:22.869298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:38:30.803119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.853038+0000","last_change":"2024-05-27T10:53:21.850072+0000","last_active":"2024-05-27T10:53:23.853038+0000","last_peered":"2024-05-27T10:53:23.853038+0000","last_clean":"2024-05-27T10:53:23.853038+0000","last_became_active":"2024-05-27T10:53:21.849754+0000","last_became_peered":"2024-05-27T10:53:21.849754+0000","last_unstale":"2024-05-27T10:53:23.853038+0000","last_undegraded":"2024-05-27T10:53:23.853038+0000","last_fullsized":"2024-05-27T10:53:23.853038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:00:27.381228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.870070+0000","last_change":"2024-05-27T10:53:22.867903+0000","last_active":"2024-05-27T10:53:22.870070+0000","last_peered":"2024-05-27T10:53:22.870070+0000","last_clean":"2024-05-27T10:53:22.870070+0000","last_became_active":"2024-05-27T10:53:22.867625+0000","last_became_peered":"2024-05-27T10:53:22.867625+0000","last_unstale":"2024-05-27T10:53:22.870070+0000","last_undegraded":"2024-05-27T10:53:22.870070+0000","last_fullsized":"2024-05-27T10:53:22.870070+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:27:29.011353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851687+0000","last_change":"2024-05-27T10:53:21.851822+0000","last_active":"2024-05-27T10:53:23.851687+0000","last_peered":"2024-05-27T10:53:23.851687+0000","last_clean":"2024-05-27T10:53:23.851687+0000","last_became_active":"2024-05-27T10:53:21.851370+0000","last_became_peered":"2024-05-27T10:53:21.851370+0000","last_unstale":"2024-05-27T10:53:23.851687+0000","last_undegraded":"2024-05-27T10:53:23.851687+0000","last_fullsized":"2024-05-27T10:53:23.851687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:01:44.974858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.852995+0000","last_change":"2024-05-27T10:53:22.853223+0000","last_active":"2024-05-27T10:53:23.852995+0000","last_peered":"2024-05-27T10:53:23.852995+0000","last_clean":"2024-05-27T10:53:23.852995+0000","last_became_active":"2024-05-27T10:53:22.852909+0000","last_became_peered":"2024-05-27T10:53:22.852909+0000","last_unstale":"2024-05-27T10:53:23.852995+0000","last_undegraded":"2024-05-27T10:53:23.852995+0000","last_fullsized":"2024-05-27T10:53:23.852995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:12:39.009218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.842461+0000","last_change":"2024-05-27T10:53:21.835104+0000","last_active":"2024-05-27T10:53:22.842461+0000","last_peered":"2024-05-27T10:53:22.842461+0000","last_clean":"2024-05-27T10:53:22.842461+0000","last_became_active":"2024-05-27T10:53:21.834814+0000","last_became_peered":"2024-05-27T10:53:21.834814+0000","last_unstale":"2024-05-27T10:53:22.842461+0000","last_undegraded":"2024-05-27T10:53:22.842461+0000","last_fullsized":"2024-05-27T10:53:22.842461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:51:49.331421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.961725+0000","last_change":"2024-05-27T10:53:22.870363+0000","last_active":"2024-05-27T10:53:23.961725+0000","last_peered":"2024-05-27T10:53:23.961725+0000","last_clean":"2024-05-27T10:53:23.961725+0000","last_became_active":"2024-05-27T10:53:22.869500+0000","last_became_peered":"2024-05-27T10:53:22.869500+0000","last_unstale":"2024-05-27T10:53:23.961725+0000","last_undegraded":"2024-05-27T10:53:23.961725+0000","last_fullsized":"2024-05-27T10:53:23.961725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:26:00.846616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.852505+0000","last_change":"2024-05-27T10:53:21.852670+0000","last_active":"2024-05-27T10:53:23.852505+0000","last_peered":"2024-05-27T10:53:23.852505+0000","last_clean":"2024-05-27T10:53:23.852505+0000","last_became_active":"2024-05-27T10:53:21.852418+0000","last_became_peered":"2024-05-27T10:53:21.852418+0000","last_unstale":"2024-05-27T10:53:23.852505+0000","last_undegraded":"2024-05-27T10:53:23.852505+0000","last_fullsized":"2024-05-27T10:53:23.852505+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:57:01.349281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.859999+0000","last_change":"2024-05-27T10:53:22.858333+0000","last_active":"2024-05-27T10:53:22.859999+0000","last_peered":"2024-05-27T10:53:22.859999+0000","last_clean":"2024-05-27T10:53:22.859999+0000","last_became_active":"2024-05-27T10:53:22.858023+0000","last_became_peered":"2024-05-27T10:53:22.858023+0000","last_unstale":"2024-05-27T10:53:22.859999+0000","last_undegraded":"2024-05-27T10:53:22.859999+0000","last_fullsized":"2024-05-27T10:53:22.859999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:20.391795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.852050+0000","last_change":"2024-05-27T10:53:21.849520+0000","last_active":"2024-05-27T10:53:23.852050+0000","last_peered":"2024-05-27T10:53:23.852050+0000","last_clean":"2024-05-27T10:53:23.852050+0000","last_became_active":"2024-05-27T10:53:21.848053+0000","last_became_peered":"2024-05-27T10:53:21.848053+0000","last_unstale":"2024-05-27T10:53:23.852050+0000","last_undegraded":"2024-05-27T10:53:23.852050+0000","last_fullsized":"2024-05-27T10:53:23.852050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:19.374937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851609+0000","last_change":"2024-05-27T10:53:22.858263+0000","last_active":"2024-05-27T10:53:23.851609+0000","last_peered":"2024-05-27T10:53:23.851609+0000","last_clean":"2024-05-27T10:53:23.851609+0000","last_became_active":"2024-05-27T10:53:22.857976+0000","last_became_peered":"2024-05-27T10:53:22.857976+0000","last_unstale":"2024-05-27T10:53:23.851609+0000","last_undegraded":"2024-05-27T10:53:23.851609+0000","last_fullsized":"2024-05-27T10:53:23.851609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:53:10.724493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.874388+0000","last_change":"2024-05-27T10:53:21.847169+0000","last_active":"2024-05-27T10:53:22.874388+0000","last_peered":"2024-05-27T10:53:22.874388+0000","last_clean":"2024-05-27T10:53:22.874388+0000","last_became_active":"2024-05-27T10:53:21.846630+0000","last_became_peered":"2024-05-27T10:53:21.846630+0000","last_unstale":"2024-05-27T10:53:22.874388+0000","last_undegraded":"2024-05-27T10:53:22.874388+0000","last_fullsized":"2024-05-27T10:53:22.874388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:19.374937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.858480+0000","last_change":"2024-05-27T10:53:22.853961+0000","last_active":"2024-05-27T10:53:22.858480+0000","last_peered":"2024-05-27T10:53:22.858480+0000","last_clean":"2024-05-27T10:53:22.858480+0000","last_became_active":"2024-05-27T10:53:22.853687+0000","last_became_peered":"2024-05-27T10:53:22.853687+0000","last_unstale":"2024-05-27T10:53:22.858480+0000","last_undegraded":"2024-05-27T10:53:22.858480+0000","last_fullsized":"2024-05-27T10:53:22.858480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:27:29.011353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851483+0000","last_change":"2024-05-27T10:53:21.851807+0000","last_active":"2024-05-27T10:53:23.851483+0000","last_peered":"2024-05-27T10:53:23.851483+0000","last_clean":"2024-05-27T10:53:23.851483+0000","last_became_active":"2024-05-27T10:53:21.851401+0000","last_became_peered":"2024-05-27T10:53:21.851401+0000","last_unstale":"2024-05-27T10:53:23.851483+0000","last_undegraded":"2024-05-27T10:53:23.851483+0000","last_fullsized":"2024-05-27T10:53:23.851483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:52:35.726060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.870606+0000","last_change":"2024-05-27T10:53:22.864250+0000","last_active":"2024-05-27T10:53:22.870606+0000","last_peered":"2024-05-27T10:53:22.870606+0000","last_clean":"2024-05-27T10:53:22.870606+0000","last_became_active":"2024-05-27T10:53:22.863861+0000","last_became_peered":"2024-05-27T10:53:22.863861+0000","last_unstale":"2024-05-27T10:53:22.870606+0000","last_undegraded":"2024-05-27T10:53:22.870606+0000","last_fullsized":"2024-05-27T10:53:22.870606+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:57:02.366139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851680+0000","last_change":"2024-05-27T10:53:21.842414+0000","last_active":"2024-05-27T10:53:23.851680+0000","last_peered":"2024-05-27T10:53:23.851680+0000","last_clean":"2024-05-27T10:53:23.851680+0000","last_became_active":"2024-05-27T10:53:21.841225+0000","last_became_peered":"2024-05-27T10:53:21.841225+0000","last_unstale":"2024-05-27T10:53:23.851680+0000","last_undegraded":"2024-05-27T10:53:23.851680+0000","last_fullsized":"2024-05-27T10:53:23.851680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:50.056223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850326+0000","last_change":"2024-05-27T10:53:22.850508+0000","last_active":"2024-05-27T10:53:23.850326+0000","last_peered":"2024-05-27T10:53:23.850326+0000","last_clean":"2024-05-27T10:53:23.850326+0000","last_became_active":"2024-05-27T10:53:22.850227+0000","last_became_peered":"2024-05-27T10:53:22.850227+0000","last_unstale":"2024-05-27T10:53:23.850326+0000","last_undegraded":"2024-05-27T10:53:23.850326+0000","last_fullsized":"2024-05-27T10:53:23.850326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:35:09.766706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851353+0000","last_change":"2024-05-27T10:53:21.847848+0000","last_active":"2024-05-27T10:53:23.851353+0000","last_peered":"2024-05-27T10:53:23.851353+0000","last_clean":"2024-05-27T10:53:23.851353+0000","last_became_active":"2024-05-27T10:53:21.847547+0000","last_became_peered":"2024-05-27T10:53:21.847547+0000","last_unstale":"2024-05-27T10:53:23.851353+0000","last_undegraded":"2024-05-27T10:53:23.851353+0000","last_fullsized":"2024-05-27T10:53:23.851353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:45:24.257422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850101+0000","last_change":"2024-05-27T10:53:22.834721+0000","last_active":"2024-05-27T10:53:23.850101+0000","last_peered":"2024-05-27T10:53:23.850101+0000","last_clean":"2024-05-27T10:53:23.850101+0000","last_became_active":"2024-05-27T10:53:22.834385+0000","last_became_peered":"2024-05-27T10:53:22.834385+0000","last_unstale":"2024-05-27T10:53:23.850101+0000","last_undegraded":"2024-05-27T10:53:23.850101+0000","last_fullsized":"2024-05-27T10:53:23.850101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:09:32.233248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.860598+0000","last_change":"2024-05-27T10:53:21.840315+0000","last_active":"2024-05-27T10:53:22.860598+0000","last_peered":"2024-05-27T10:53:22.860598+0000","last_clean":"2024-05-27T10:53:22.860598+0000","last_became_active":"2024-05-27T10:53:21.839991+0000","last_became_peered":"2024-05-27T10:53:21.839991+0000","last_unstale":"2024-05-27T10:53:22.860598+0000","last_undegraded":"2024-05-27T10:53:22.860598+0000","last_fullsized":"2024-05-27T10:53:22.860598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:52:35.726060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851025+0000","last_change":"2024-05-27T10:53:22.869588+0000","last_active":"2024-05-27T10:53:23.851025+0000","last_peered":"2024-05-27T10:53:23.851025+0000","last_clean":"2024-05-27T10:53:23.851025+0000","last_became_active":"2024-05-27T10:53:22.869288+0000","last_became_peered":"2024-05-27T10:53:22.869288+0000","last_unstale":"2024-05-27T10:53:23.851025+0000","last_undegraded":"2024-05-27T10:53:23.851025+0000","last_fullsized":"2024-05-27T10:53:23.851025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:52:36.742918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.836434+0000","last_change":"2024-05-27T10:53:21.843211+0000","last_active":"2024-05-27T10:53:22.836434+0000","last_peered":"2024-05-27T10:53:22.836434+0000","last_clean":"2024-05-27T10:53:22.836434+0000","last_became_active":"2024-05-27T10:53:21.842884+0000","last_became_peered":"2024-05-27T10:53:21.842884+0000","last_unstale":"2024-05-27T10:53:22.836434+0000","last_undegraded":"2024-05-27T10:53:22.836434+0000","last_fullsized":"2024-05-27T10:53:22.836434+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:50.056223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850313+0000","last_change":"2024-05-27T10:53:22.853706+0000","last_active":"2024-05-27T10:53:23.850313+0000","last_peered":"2024-05-27T10:53:23.850313+0000","last_clean":"2024-05-27T10:53:23.850313+0000","last_became_active":"2024-05-27T10:53:22.853110+0000","last_became_peered":"2024-05-27T10:53:22.853110+0000","last_unstale":"2024-05-27T10:53:23.850313+0000","last_undegraded":"2024-05-27T10:53:23.850313+0000","last_fullsized":"2024-05-27T10:53:23.850313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:54:00.171274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850728+0000","last_change":"2024-05-27T10:53:21.840371+0000","last_active":"2024-05-27T10:53:23.850728+0000","last_peered":"2024-05-27T10:53:23.850728+0000","last_clean":"2024-05-27T10:53:23.850728+0000","last_became_active":"2024-05-27T10:53:21.839612+0000","last_became_peered":"2024-05-27T10:53:21.839612+0000","last_unstale":"2024-05-27T10:53:23.850728+0000","last_undegraded":"2024-05-27T10:53:23.850728+0000","last_fullsized":"2024-05-27T10:53:23.850728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:05:06.955720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.960907+0000","last_change":"2024-05-27T10:53:22.863050+0000","last_active":"2024-05-27T10:53:23.960907+0000","last_peered":"2024-05-27T10:53:23.960907+0000","last_clean":"2024-05-27T10:53:23.960907+0000","last_became_active":"2024-05-27T10:53:22.862527+0000","last_became_peered":"2024-05-27T10:53:22.862527+0000","last_unstale":"2024-05-27T10:53:23.960907+0000","last_undegraded":"2024-05-27T10:53:23.960907+0000","last_fullsized":"2024-05-27T10:53:23.960907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:00:52.836281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.837888+0000","last_change":"2024-05-27T10:53:21.856681+0000","last_active":"2024-05-27T10:53:22.837888+0000","last_peered":"2024-05-27T10:53:22.837888+0000","last_clean":"2024-05-27T10:53:22.837888+0000","last_became_active":"2024-05-27T10:53:21.856185+0000","last_became_peered":"2024-05-27T10:53:21.856185+0000","last_unstale":"2024-05-27T10:53:22.837888+0000","last_undegraded":"2024-05-27T10:53:22.837888+0000","last_fullsized":"2024-05-27T10:53:22.837888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:33:06.221744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850680+0000","last_change":"2024-05-27T10:53:22.853766+0000","last_active":"2024-05-27T10:53:23.850680+0000","last_peered":"2024-05-27T10:53:23.850680+0000","last_clean":"2024-05-27T10:53:23.850680+0000","last_became_active":"2024-05-27T10:53:22.853365+0000","last_became_peered":"2024-05-27T10:53:22.853365+0000","last_unstale":"2024-05-27T10:53:23.850680+0000","last_undegraded":"2024-05-27T10:53:23.850680+0000","last_fullsized":"2024-05-27T10:53:23.850680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:45:25.274280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.874246+0000","last_change":"2024-05-27T10:53:21.849302+0000","last_active":"2024-05-27T10:53:22.874246+0000","last_peered":"2024-05-27T10:53:22.874246+0000","last_clean":"2024-05-27T10:53:22.874246+0000","last_became_active":"2024-05-27T10:53:21.848944+0000","last_became_peered":"2024-05-27T10:53:21.848944+0000","last_unstale":"2024-05-27T10:53:22.874246+0000","last_undegraded":"2024-05-27T10:53:22.874246+0000","last_fullsized":"2024-05-27T10:53:22.874246+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:51:42.701663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.870429+0000","last_change":"2024-05-27T10:53:22.868750+0000","last_active":"2024-05-27T10:53:22.870429+0000","last_peered":"2024-05-27T10:53:22.870429+0000","last_clean":"2024-05-27T10:53:22.870429+0000","last_became_active":"2024-05-27T10:53:22.868076+0000","last_became_peered":"2024-05-27T10:53:22.868076+0000","last_unstale":"2024-05-27T10:53:22.870429+0000","last_undegraded":"2024-05-27T10:53:22.870429+0000","last_fullsized":"2024-05-27T10:53:22.870429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:06:42.117873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.834512+0000","last_change":"2024-05-27T10:53:21.842944+0000","last_active":"2024-05-27T10:53:22.834512+0000","last_peered":"2024-05-27T10:53:22.834512+0000","last_clean":"2024-05-27T10:53:22.834512+0000","last_became_active":"2024-05-27T10:53:21.842642+0000","last_became_peered":"2024-05-27T10:53:21.842642+0000","last_unstale":"2024-05-27T10:53:22.834512+0000","last_undegraded":"2024-05-27T10:53:22.834512+0000","last_fullsized":"2024-05-27T10:53:22.834512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:45:24.257422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.861566+0000","last_change":"2024-05-27T10:53:22.858269+0000","last_active":"2024-05-27T10:53:22.861566+0000","last_peered":"2024-05-27T10:53:22.861566+0000","last_clean":"2024-05-27T10:53:22.861566+0000","last_became_active":"2024-05-27T10:53:22.854984+0000","last_became_peered":"2024-05-27T10:53:22.854984+0000","last_unstale":"2024-05-27T10:53:22.861566+0000","last_undegraded":"2024-05-27T10:53:22.861566+0000","last_fullsized":"2024-05-27T10:53:22.861566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:51:43.718521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.847393+0000","last_change":"2024-05-27T10:53:21.839644+0000","last_active":"2024-05-27T10:53:22.847393+0000","last_peered":"2024-05-27T10:53:22.847393+0000","last_clean":"2024-05-27T10:53:22.847393+0000","last_became_active":"2024-05-27T10:53:21.838679+0000","last_became_peered":"2024-05-27T10:53:21.838679+0000","last_unstale":"2024-05-27T10:53:22.847393+0000","last_undegraded":"2024-05-27T10:53:22.847393+0000","last_fullsized":"2024-05-27T10:53:22.847393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:55:30.705646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.859537+0000","last_change":"2024-05-27T10:53:22.855841+0000","last_active":"2024-05-27T10:53:22.859537+0000","last_peered":"2024-05-27T10:53:22.859537+0000","last_clean":"2024-05-27T10:53:22.859537+0000","last_became_active":"2024-05-27T10:53:22.855464+0000","last_became_peered":"2024-05-27T10:53:22.855464+0000","last_unstale":"2024-05-27T10:53:22.859537+0000","last_undegraded":"2024-05-27T10:53:22.859537+0000","last_fullsized":"2024-05-27T10:53:22.859537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:15:09.136716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.837211+0000","last_change":"2024-05-27T10:53:21.846246+0000","last_active":"2024-05-27T10:53:22.837211+0000","last_peered":"2024-05-27T10:53:22.837211+0000","last_clean":"2024-05-27T10:53:22.837211+0000","last_became_active":"2024-05-27T10:53:21.845936+0000","last_became_peered":"2024-05-27T10:53:21.845936+0000","last_unstale":"2024-05-27T10:53:22.837211+0000","last_undegraded":"2024-05-27T10:53:22.837211+0000","last_fullsized":"2024-05-27T10:53:22.837211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:51:49.331421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.854337+0000","last_change":"2024-05-27T10:53:22.852749+0000","last_active":"2024-05-27T10:53:22.854337+0000","last_peered":"2024-05-27T10:53:22.854337+0000","last_clean":"2024-05-27T10:53:22.854337+0000","last_became_active":"2024-05-27T10:53:22.852438+0000","last_became_peered":"2024-05-27T10:53:22.852438+0000","last_unstale":"2024-05-27T10:53:22.854337+0000","last_undegraded":"2024-05-27T10:53:22.854337+0000","last_fullsized":"2024-05-27T10:53:22.854337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:15:09.136716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.842619+0000","last_change":"2024-05-27T10:53:21.850605+0000","last_active":"2024-05-27T10:53:22.842619+0000","last_peered":"2024-05-27T10:53:22.842619+0000","last_clean":"2024-05-27T10:53:22.842619+0000","last_became_active":"2024-05-27T10:53:21.850341+0000","last_became_peered":"2024-05-27T10:53:21.850341+0000","last_unstale":"2024-05-27T10:53:22.842619+0000","last_undegraded":"2024-05-27T10:53:22.842619+0000","last_fullsized":"2024-05-27T10:53:22.842619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:15:08.119858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.852555+0000","last_change":"2024-05-27T10:53:22.855374+0000","last_active":"2024-05-27T10:53:23.852555+0000","last_peered":"2024-05-27T10:53:23.852555+0000","last_clean":"2024-05-27T10:53:23.852555+0000","last_became_active":"2024-05-27T10:53:22.855091+0000","last_became_peered":"2024-05-27T10:53:22.855091+0000","last_unstale":"2024-05-27T10:53:23.852555+0000","last_undegraded":"2024-05-27T10:53:23.852555+0000","last_fullsized":"2024-05-27T10:53:23.852555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:47.477033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850882+0000","last_change":"2024-05-27T10:53:21.852377+0000","last_active":"2024-05-27T10:53:23.850882+0000","last_peered":"2024-05-27T10:53:23.850882+0000","last_clean":"2024-05-27T10:53:23.850882+0000","last_became_active":"2024-05-27T10:53:21.851082+0000","last_became_peered":"2024-05-27T10:53:21.851082+0000","last_unstale":"2024-05-27T10:53:23.850882+0000","last_undegraded":"2024-05-27T10:53:23.850882+0000","last_fullsized":"2024-05-27T10:53:23.850882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:51:19.944755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850750+0000","last_change":"2024-05-27T10:53:22.854709+0000","last_active":"2024-05-27T10:53:23.850750+0000","last_peered":"2024-05-27T10:53:23.850750+0000","last_clean":"2024-05-27T10:53:23.850750+0000","last_became_active":"2024-05-27T10:53:22.854367+0000","last_became_peered":"2024-05-27T10:53:22.854367+0000","last_unstale":"2024-05-27T10:53:23.850750+0000","last_undegraded":"2024-05-27T10:53:23.850750+0000","last_fullsized":"2024-05-27T10:53:23.850750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:00:28.398086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.852172+0000","last_change":"2024-05-27T10:53:21.850751+0000","last_active":"2024-05-27T10:53:23.852172+0000","last_peered":"2024-05-27T10:53:23.852172+0000","last_clean":"2024-05-27T10:53:23.852172+0000","last_became_active":"2024-05-27T10:53:21.850500+0000","last_became_peered":"2024-05-27T10:53:21.850500+0000","last_unstale":"2024-05-27T10:53:23.852172+0000","last_undegraded":"2024-05-27T10:53:23.852172+0000","last_fullsized":"2024-05-27T10:53:23.852172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:51:42.701663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.961408+0000","last_change":"2024-05-27T10:53:22.848201+0000","last_active":"2024-05-27T10:53:23.961408+0000","last_peered":"2024-05-27T10:53:23.961408+0000","last_clean":"2024-05-27T10:53:23.961408+0000","last_became_active":"2024-05-27T10:53:22.847870+0000","last_became_peered":"2024-05-27T10:53:22.847870+0000","last_unstale":"2024-05-27T10:53:23.961408+0000","last_undegraded":"2024-05-27T10:53:23.961408+0000","last_fullsized":"2024-05-27T10:53:23.961408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:43:46.639026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.839693+0000","last_change":"2024-05-27T10:53:21.845430+0000","last_active":"2024-05-27T10:53:22.839693+0000","last_peered":"2024-05-27T10:53:22.839693+0000","last_clean":"2024-05-27T10:53:22.839693+0000","last_became_active":"2024-05-27T10:53:21.845098+0000","last_became_peered":"2024-05-27T10:53:21.845098+0000","last_unstale":"2024-05-27T10:53:22.839693+0000","last_undegraded":"2024-05-27T10:53:22.839693+0000","last_fullsized":"2024-05-27T10:53:22.839693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:45:24.257422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":195,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.961907+0000","last_change":"2024-05-27T10:51:56.473671+0000","last_active":"2024-05-27T10:53:23.961907+0000","last_peered":"2024-05-27T10:53:23.961907+0000","last_clean":"2024-05-27T10:53:23.961907+0000","last_became_active":"2024-05-27T10:51:56.470561+0000","last_became_peered":"2024-05-27T10:51:56.470561+0000","last_unstale":"2024-05-27T10:53:23.961907+0000","last_undegraded":"2024-05-27T10:53:23.961907+0000","last_fullsized":"2024-05-27T10:53:23.961907+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:51:55.105404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:51:55.105404+0000","last_clean_scrub_stamp":"2024-05-27T10:51:55.105404+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:20:59.737450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":958464,"data_stored":730774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":368640,"data_stored":140932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":368640,"data_stored":140988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":368640,"data_stored":140420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":148250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":364544,"data_stored":140386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":141950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":954368,"data_stored":730684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T10:53:27.340 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T10:53:27.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.589+0000 7f118f800640 1 Processor -- start 2024-05-27T10:53:27.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.590+0000 7f118f800640 1 -- start start 2024-05-27T10:53:27.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.591+0000 7f118f800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f118806d3a0 0x7f1188160390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:27.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.591+0000 7f118f800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f118815faa0 0x7f118815e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:27.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.591+0000 7f118f800640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f118815ff50 con 0x7f118806cba0 2024-05-27T10:53:27.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.591+0000 7f118f800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f11880d26e0 con 0x7f118806d3a0 2024-05-27T10:53:27.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.591+0000 7f118f800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f11880d29c0 con 0x7f118815faa0 2024-05-27T10:53:27.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.592+0000 7f118ce00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f118806d3a0 0x7f1188160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:27.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.592+0000 7f118ce00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f118806d3a0 0x7f1188160390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55066/0 (socket says 172.21.15.47:55066) 2024-05-27T10:53:27.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.592+0000 7f118ce00640 1 -- 172.21.15.47:0/1502578492 learned_addr learned my addr 172.21.15.47:0/1502578492 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:27.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.592+0000 7f118d800640 1 --2- 172.21.15.47:0/1502578492 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f118815faa0 0x7f118815e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:27.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.592+0000 7f118ce00640 1 -- 172.21.15.47:0/1502578492 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f118815faa0 msgr2=0x7f118815e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:27.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.592+0000 7f118ce00640 1 --2- 172.21.15.47:0/1502578492 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f118815faa0 0x7f118815e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:27.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.592+0000 7f118ce00640 1 -- 172.21.15.47:0/1502578492 >> v1:172.21.15.53:6789/0 conn(0x7f118806cba0 legacy=0x7f118806d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:27.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.592+0000 7f118ce00640 1 -- 172.21.15.47:0/1502578492 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11880d2ca0 con 0x7f118806d3a0 2024-05-27T10:53:27.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.592+0000 7f118d800640 1 --2- 172.21.15.47:0/1502578492 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f118815faa0 0x7f118815e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:27.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.593+0000 7f118ce00640 1 --2- 172.21.15.47:0/1502578492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f118806d3a0 0x7f1188160390 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1178009e50 tx=0x7f117802a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51639c547fcbc802 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:27.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.594+0000 7f1187400640 1 -- 172.21.15.47:0/1502578492 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1178036070 con 0x7f118806d3a0 2024-05-27T10:53:27.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.594+0000 7f1187400640 1 -- 172.21.15.47:0/1502578492 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1178031600 con 0x7f118806d3a0 2024-05-27T10:53:27.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.594+0000 7f1187400640 1 -- 172.21.15.47:0/1502578492 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11780319d0 con 0x7f118806d3a0 2024-05-27T10:53:27.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.595+0000 7f118f800640 1 -- 172.21.15.47:0/1502578492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f118806d3a0 msgr2=0x7f1188160390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:27.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.595+0000 7f118f800640 1 --2- 172.21.15.47:0/1502578492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f118806d3a0 0x7f1188160390 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1178009e50 tx=0x7f117802a6d0 comp rx=0 tx=0).stop 2024-05-27T10:53:27.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.595+0000 7f118f800640 1 -- 172.21.15.47:0/1502578492 shutdown_connections 2024-05-27T10:53:27.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.595+0000 7f118f800640 1 --2- 172.21.15.47:0/1502578492 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f118815faa0 0x7f118815e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:27.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.595+0000 7f118f800640 1 --2- 172.21.15.47:0/1502578492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f118806d3a0 0x7f1188160390 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:27.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.595+0000 7f118f800640 1 -- 172.21.15.47:0/1502578492 >> 172.21.15.47:0/1502578492 conn(0x7f118808bfd0 msgr2=0x7f11880d4640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:27.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.595+0000 7f118f800640 1 -- 172.21.15.47:0/1502578492 shutdown_connections 2024-05-27T10:53:27.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.595+0000 7f118f800640 1 -- 172.21.15.47:0/1502578492 wait complete. 2024-05-27T10:53:27.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.597+0000 7f118f800640 1 Processor -- start 2024-05-27T10:53:27.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.597+0000 7f118f800640 1 -- start start 2024-05-27T10:53:27.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.598+0000 7f118f800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f118806cba0 0x7f11881f9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:27.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.598+0000 7f118f800640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f118806d3a0 0x7f11880caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:27.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.598+0000 7f118f800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f118815faa0 0x7f11880b8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:27.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.598+0000 7f118f800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f11880b3d90 con 0x7f118806cba0 2024-05-27T10:53:27.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.598+0000 7f118f800640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f11880d3260 con 0x7f118815faa0 2024-05-27T10:53:27.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.598+0000 7f118f800640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f11880b9370 con 0x7f118806d3a0 2024-05-27T10:53:27.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.598+0000 7f118ce00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f118806cba0 0x7f11881f9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:27.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.598+0000 7f118ce00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f118806cba0 0x7f11881f9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55070/0 (socket says 172.21.15.47:55070) 2024-05-27T10:53:27.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.598+0000 7f118ce00640 1 -- 172.21.15.47:0/1244427042 learned_addr learned my addr 172.21.15.47:0/1244427042 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:27.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.599+0000 7f1187e00640 1 --2- 172.21.15.47:0/1244427042 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f118806d3a0 0x7f11880caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:27.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.599+0000 7f118d800640 1 --2- 172.21.15.47:0/1244427042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f118815faa0 0x7f11880b8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:27.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.599+0000 7f118ce00640 1 -- 172.21.15.47:0/1244427042 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f118806d3a0 msgr2=0x7f11880caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:27.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.599+0000 7f118ce00640 1 --2- 172.21.15.47:0/1244427042 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f118806d3a0 0x7f11880caa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:27.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.599+0000 7f118ce00640 1 -- 172.21.15.47:0/1244427042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f118815faa0 msgr2=0x7f11880b8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:27.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.599+0000 7f118ce00640 1 --2- 172.21.15.47:0/1244427042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f118815faa0 0x7f11880b8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:27.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.599+0000 7f118ce00640 1 -- 172.21.15.47:0/1244427042 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11880b8dc0 con 0x7f118806cba0 2024-05-27T10:53:27.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.599+0000 7f118d800640 1 --2- 172.21.15.47:0/1244427042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f118815faa0 0x7f11880b8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:27.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.599+0000 7f118ce00640 1 --2- 172.21.15.47:0/1244427042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f118806cba0 0x7f11881f9350 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1178034040 tx=0x7f1178004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:27.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.599+0000 7f1184c00640 1 -- 172.21.15.47:0/1244427042 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1178036050 con 0x7f118806cba0 2024-05-27T10:53:27.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.599+0000 7f1184c00640 1 -- 172.21.15.47:0/1244427042 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1178042070 con 0x7f118806cba0 2024-05-27T10:53:27.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.599+0000 7f1184c00640 1 -- 172.21.15.47:0/1244427042 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1178009510 con 0x7f118806cba0 2024-05-27T10:53:27.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.600+0000 7f118f800640 1 -- 172.21.15.47:0/1244427042 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11880b9090 con 0x7f118806cba0 2024-05-27T10:53:27.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.600+0000 7f118f800640 1 -- 172.21.15.47:0/1244427042 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11880ca260 con 0x7f118806cba0 2024-05-27T10:53:27.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.601+0000 7f118f800640 1 -- 172.21.15.47:0/1244427042 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11880689e0 con 0x7f118806cba0 2024-05-27T10:53:27.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.602+0000 7f1184c00640 1 -- 172.21.15.47:0/1244427042 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1178007c50 con 0x7f118806cba0 2024-05-27T10:53:27.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.603+0000 7f1184c00640 1 --2- 172.21.15.47:0/1244427042 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f116806c8f0 0x7f116806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:27.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.603+0000 7f1184c00640 1 -- 172.21.15.47:0/1244427042 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f11780acaa0 con 0x7f118806cba0 2024-05-27T10:53:27.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.603+0000 7f1187e00640 1 --2- 172.21.15.47:0/1244427042 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f116806c8f0 0x7f116806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:27.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.604+0000 7f1187e00640 1 --2- 172.21.15.47:0/1244427042 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f116806c8f0 0x7f116806edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f118815d580 tx=0x7f1174009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:27.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.607+0000 7f1184c00640 1 -- 172.21.15.47:0/1244427042 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f117807af60 con 0x7f118806cba0 2024-05-27T10:53:27.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.806+0000 7f118f800640 1 -- 172.21.15.47:0/1244427042 --> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f11880b11f0 con 0x7f116806c8f0 2024-05-27T10:53:27.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.825+0000 7f1184c00640 1 -- 172.21.15.47:0/1244427042 <== mgr.4108 v2:172.21.15.47:6832/3679485934 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251918 (secure 0 0 0) 0x7f11880b11f0 con 0x7f116806c8f0 2024-05-27T10:53:27.825 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:53:27.826 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-27T10:53:27.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.830+0000 7f118f800640 1 -- 172.21.15.47:0/1244427042 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f116806c8f0 msgr2=0x7f116806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:27.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.830+0000 7f118f800640 1 --2- 172.21.15.47:0/1244427042 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f116806c8f0 0x7f116806edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f118815d580 tx=0x7f1174009040 comp rx=0 tx=0).stop 2024-05-27T10:53:27.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.830+0000 7f118f800640 1 -- 172.21.15.47:0/1244427042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f118806cba0 msgr2=0x7f11881f9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:27.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.830+0000 7f118f800640 1 --2- 172.21.15.47:0/1244427042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f118806cba0 0x7f11881f9350 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1178034040 tx=0x7f1178004a40 comp rx=0 tx=0).stop 2024-05-27T10:53:27.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.830+0000 7f118f800640 1 -- 172.21.15.47:0/1244427042 shutdown_connections 2024-05-27T10:53:27.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.830+0000 7f118f800640 1 --2- 172.21.15.47:0/1244427042 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f116806c8f0 0x7f116806edb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:27.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.830+0000 7f118f800640 1 --2- 172.21.15.47:0/1244427042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f118815faa0 0x7f11880b8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:27.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.830+0000 7f118f800640 1 --2- 172.21.15.47:0/1244427042 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f118806d3a0 0x7f11880caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:27.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.830+0000 7f118f800640 1 --2- 172.21.15.47:0/1244427042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f118806cba0 0x7f11881f9350 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:27.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.830+0000 7f118f800640 1 -- 172.21.15.47:0/1244427042 >> 172.21.15.47:0/1244427042 conn(0x7f118808bfd0 msgr2=0x7f11880b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:27.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.830+0000 7f118f800640 1 -- 172.21.15.47:0/1244427042 shutdown_connections 2024-05-27T10:53:27.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:27.830+0000 7f118f800640 1 -- 172.21.15.47:0/1244427042 wait complete. 2024-05-27T10:53:27.847 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-05-27T10:53:27.065234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253504,"kb_used_data":4052,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721216,"statfs":{"total":773094113280,"available":772834525184,"internally_reserved":0,"allocated":4149248,"data_stored":2314384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001750"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.867263+0000","last_change":"2024-05-27T10:53:22.866251+0000","last_active":"2024-05-27T10:53:22.867263+0000","last_peered":"2024-05-27T10:53:22.867263+0000","last_clean":"2024-05-27T10:53:22.867263+0000","last_became_active":"2024-05-27T10:53:22.862148+0000","last_became_peered":"2024-05-27T10:53:22.862148+0000","last_unstale":"2024-05-27T10:53:22.867263+0000","last_undegraded":"2024-05-27T10:53:22.867263+0000","last_fullsized":"2024-05-27T10:53:22.867263+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:51:43.718521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.853504+0000","last_change":"2024-05-27T10:53:22.857386+0000","last_active":"2024-05-27T10:53:23.853504+0000","last_peered":"2024-05-27T10:53:23.853504+0000","last_clean":"2024-05-27T10:53:23.853504+0000","last_became_active":"2024-05-27T10:53:22.856874+0000","last_became_peered":"2024-05-27T10:53:22.856874+0000","last_unstale":"2024-05-27T10:53:23.853504+0000","last_undegraded":"2024-05-27T10:53:23.853504+0000","last_fullsized":"2024-05-27T10:53:23.853504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:34.606091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.869274+0000","last_change":"2024-05-27T10:53:22.867374+0000","last_active":"2024-05-27T10:53:22.869274+0000","last_peered":"2024-05-27T10:53:22.869274+0000","last_clean":"2024-05-27T10:53:22.869274+0000","last_became_active":"2024-05-27T10:53:22.865680+0000","last_became_peered":"2024-05-27T10:53:22.865680+0000","last_unstale":"2024-05-27T10:53:22.869274+0000","last_undegraded":"2024-05-27T10:53:22.869274+0000","last_fullsized":"2024-05-27T10:53:22.869274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:53:10.724493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.870629+0000","last_change":"2024-05-27T10:53:22.865597+0000","last_active":"2024-05-27T10:53:22.870629+0000","last_peered":"2024-05-27T10:53:22.870629+0000","last_clean":"2024-05-27T10:53:22.870629+0000","last_became_active":"2024-05-27T10:53:22.865319+0000","last_became_peered":"2024-05-27T10:53:22.865319+0000","last_unstale":"2024-05-27T10:53:22.870629+0000","last_undegraded":"2024-05-27T10:53:22.870629+0000","last_fullsized":"2024-05-27T10:53:22.870629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:39:47.386726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851977+0000","last_change":"2024-05-27T10:53:22.865928+0000","last_active":"2024-05-27T10:53:23.851977+0000","last_peered":"2024-05-27T10:53:23.851977+0000","last_clean":"2024-05-27T10:53:23.851977+0000","last_became_active":"2024-05-27T10:53:22.865626+0000","last_became_peered":"2024-05-27T10:53:22.865626+0000","last_unstale":"2024-05-27T10:53:23.851977+0000","last_undegraded":"2024-05-27T10:53:23.851977+0000","last_fullsized":"2024-05-27T10:53:23.851977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:51:50.348279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.852636+0000","last_change":"2024-05-27T10:53:22.863701+0000","last_active":"2024-05-27T10:53:23.852636+0000","last_peered":"2024-05-27T10:53:23.852636+0000","last_clean":"2024-05-27T10:53:23.852636+0000","last_became_active":"2024-05-27T10:53:22.862781+0000","last_became_peered":"2024-05-27T10:53:22.862781+0000","last_unstale":"2024-05-27T10:53:23.852636+0000","last_undegraded":"2024-05-27T10:53:23.852636+0000","last_fullsized":"2024-05-27T10:53:23.852636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:01:26.220914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.961206+0000","last_change":"2024-05-27T10:53:22.862810+0000","last_active":"2024-05-27T10:53:23.961206+0000","last_peered":"2024-05-27T10:53:23.961206+0000","last_clean":"2024-05-27T10:53:23.961206+0000","last_became_active":"2024-05-27T10:53:22.862128+0000","last_became_peered":"2024-05-27T10:53:22.862128+0000","last_unstale":"2024-05-27T10:53:23.961206+0000","last_undegraded":"2024-05-27T10:53:23.961206+0000","last_fullsized":"2024-05-27T10:53:23.961206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:12:39.009218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.960722+0000","last_change":"2024-05-27T10:53:22.850921+0000","last_active":"2024-05-27T10:53:23.960722+0000","last_peered":"2024-05-27T10:53:23.960722+0000","last_clean":"2024-05-27T10:53:23.960722+0000","last_became_active":"2024-05-27T10:53:22.849626+0000","last_became_peered":"2024-05-27T10:53:22.849626+0000","last_unstale":"2024-05-27T10:53:23.960722+0000","last_undegraded":"2024-05-27T10:53:23.960722+0000","last_fullsized":"2024-05-27T10:53:23.960722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:19:00.382738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.852101+0000","last_change":"2024-05-27T10:53:22.865486+0000","last_active":"2024-05-27T10:53:23.852101+0000","last_peered":"2024-05-27T10:53:23.852101+0000","last_clean":"2024-05-27T10:53:23.852101+0000","last_became_active":"2024-05-27T10:53:22.865200+0000","last_became_peered":"2024-05-27T10:53:22.865200+0000","last_unstale":"2024-05-27T10:53:23.852101+0000","last_undegraded":"2024-05-27T10:53:23.852101+0000","last_fullsized":"2024-05-27T10:53:23.852101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:38:30.803119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.875671+0000","last_change":"2024-05-27T10:53:22.872971+0000","last_active":"2024-05-27T10:53:22.875671+0000","last_peered":"2024-05-27T10:53:22.875671+0000","last_clean":"2024-05-27T10:53:22.875671+0000","last_became_active":"2024-05-27T10:53:22.872703+0000","last_became_peered":"2024-05-27T10:53:22.872703+0000","last_unstale":"2024-05-27T10:53:22.875671+0000","last_undegraded":"2024-05-27T10:53:22.875671+0000","last_fullsized":"2024-05-27T10:53:22.875671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:33:26.866748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.961426+0000","last_change":"2024-05-27T10:53:22.859842+0000","last_active":"2024-05-27T10:53:23.961426+0000","last_peered":"2024-05-27T10:53:23.961426+0000","last_clean":"2024-05-27T10:53:23.961426+0000","last_became_active":"2024-05-27T10:53:22.857618+0000","last_became_peered":"2024-05-27T10:53:22.857618+0000","last_unstale":"2024-05-27T10:53:23.961426+0000","last_undegraded":"2024-05-27T10:53:23.961426+0000","last_fullsized":"2024-05-27T10:53:23.961426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:17:36.654521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.859492+0000","last_change":"2024-05-27T10:53:22.853264+0000","last_active":"2024-05-27T10:53:22.859492+0000","last_peered":"2024-05-27T10:53:22.859492+0000","last_clean":"2024-05-27T10:53:22.859492+0000","last_became_active":"2024-05-27T10:53:22.852715+0000","last_became_peered":"2024-05-27T10:53:22.852715+0000","last_unstale":"2024-05-27T10:53:22.859492+0000","last_undegraded":"2024-05-27T10:53:22.859492+0000","last_fullsized":"2024-05-27T10:53:22.859492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:00:28.398086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850551+0000","last_change":"2024-05-27T10:53:22.847608+0000","last_active":"2024-05-27T10:53:23.850551+0000","last_peered":"2024-05-27T10:53:23.850551+0000","last_clean":"2024-05-27T10:53:23.850551+0000","last_became_active":"2024-05-27T10:53:22.847337+0000","last_became_peered":"2024-05-27T10:53:22.847337+0000","last_unstale":"2024-05-27T10:53:23.850551+0000","last_undegraded":"2024-05-27T10:53:23.850551+0000","last_fullsized":"2024-05-27T10:53:23.850551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:01:45.991716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.853053+0000","last_change":"2024-05-27T10:53:22.852678+0000","last_active":"2024-05-27T10:53:23.853053+0000","last_peered":"2024-05-27T10:53:23.853053+0000","last_clean":"2024-05-27T10:53:23.853053+0000","last_became_active":"2024-05-27T10:53:22.852324+0000","last_became_peered":"2024-05-27T10:53:22.852324+0000","last_unstale":"2024-05-27T10:53:23.853053+0000","last_undegraded":"2024-05-27T10:53:23.853053+0000","last_fullsized":"2024-05-27T10:53:23.853053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:43:46.639026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.867715+0000","last_change":"2024-05-27T10:53:22.865808+0000","last_active":"2024-05-27T10:53:22.867715+0000","last_peered":"2024-05-27T10:53:22.867715+0000","last_clean":"2024-05-27T10:53:22.867715+0000","last_became_active":"2024-05-27T10:53:22.865441+0000","last_became_peered":"2024-05-27T10:53:22.865441+0000","last_unstale":"2024-05-27T10:53:22.867715+0000","last_undegraded":"2024-05-27T10:53:22.867715+0000","last_fullsized":"2024-05-27T10:53:22.867715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:54:28.408651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.962176+0000","last_change":"2024-05-27T10:53:22.853558+0000","last_active":"2024-05-27T10:53:23.962176+0000","last_peered":"2024-05-27T10:53:23.962176+0000","last_clean":"2024-05-27T10:53:23.962176+0000","last_became_active":"2024-05-27T10:53:22.853275+0000","last_became_peered":"2024-05-27T10:53:22.853275+0000","last_unstale":"2024-05-27T10:53:23.962176+0000","last_undegraded":"2024-05-27T10:53:23.962176+0000","last_fullsized":"2024-05-27T10:53:23.962176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:38:46.654292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.961474+0000","last_change":"2024-05-27T10:53:22.852921+0000","last_active":"2024-05-27T10:53:23.961474+0000","last_peered":"2024-05-27T10:53:23.961474+0000","last_clean":"2024-05-27T10:53:23.961474+0000","last_became_active":"2024-05-27T10:53:22.852636+0000","last_became_peered":"2024-05-27T10:53:22.852636+0000","last_unstale":"2024-05-27T10:53:23.961474+0000","last_undegraded":"2024-05-27T10:53:23.961474+0000","last_fullsized":"2024-05-27T10:53:23.961474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:13:17.380852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.853585+0000","last_change":"2024-05-27T10:53:22.857136+0000","last_active":"2024-05-27T10:53:23.853585+0000","last_peered":"2024-05-27T10:53:23.853585+0000","last_clean":"2024-05-27T10:53:23.853585+0000","last_became_active":"2024-05-27T10:53:22.856265+0000","last_became_peered":"2024-05-27T10:53:22.856265+0000","last_unstale":"2024-05-27T10:53:23.853585+0000","last_undegraded":"2024-05-27T10:53:23.853585+0000","last_fullsized":"2024-05-27T10:53:23.853585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:26:00.846616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.853725+0000","last_change":"2024-05-27T10:53:22.866122+0000","last_active":"2024-05-27T10:53:23.853725+0000","last_peered":"2024-05-27T10:53:23.853725+0000","last_clean":"2024-05-27T10:53:23.853725+0000","last_became_active":"2024-05-27T10:53:22.865760+0000","last_became_peered":"2024-05-27T10:53:22.865760+0000","last_unstale":"2024-05-27T10:53:23.853725+0000","last_undegraded":"2024-05-27T10:53:23.853725+0000","last_fullsized":"2024-05-27T10:53:23.853725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:38:46.654292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850591+0000","last_change":"2024-05-27T10:53:22.861407+0000","last_active":"2024-05-27T10:53:23.850591+0000","last_peered":"2024-05-27T10:53:23.850591+0000","last_clean":"2024-05-27T10:53:23.850591+0000","last_became_active":"2024-05-27T10:53:22.861015+0000","last_became_peered":"2024-05-27T10:53:22.861015+0000","last_unstale":"2024-05-27T10:53:23.850591+0000","last_undegraded":"2024-05-27T10:53:23.850591+0000","last_fullsized":"2024-05-27T10:53:23.850591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:51.073081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851545+0000","last_change":"2024-05-27T10:53:22.839434+0000","last_active":"2024-05-27T10:53:23.851545+0000","last_peered":"2024-05-27T10:53:23.851545+0000","last_clean":"2024-05-27T10:53:23.851545+0000","last_became_active":"2024-05-27T10:53:22.838870+0000","last_became_peered":"2024-05-27T10:53:22.838870+0000","last_unstale":"2024-05-27T10:53:23.851545+0000","last_undegraded":"2024-05-27T10:53:23.851545+0000","last_fullsized":"2024-05-27T10:53:23.851545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:54:28.408651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851217+0000","last_change":"2024-05-27T10:53:22.840373+0000","last_active":"2024-05-27T10:53:23.851217+0000","last_peered":"2024-05-27T10:53:23.851217+0000","last_clean":"2024-05-27T10:53:23.851217+0000","last_became_active":"2024-05-27T10:53:22.840039+0000","last_became_peered":"2024-05-27T10:53:22.840039+0000","last_unstale":"2024-05-27T10:53:23.851217+0000","last_undegraded":"2024-05-27T10:53:23.851217+0000","last_fullsized":"2024-05-27T10:53:23.851217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:27:29.011353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.860962+0000","last_change":"2024-05-27T10:53:22.858138+0000","last_active":"2024-05-27T10:53:22.860962+0000","last_peered":"2024-05-27T10:53:22.860962+0000","last_clean":"2024-05-27T10:53:22.860962+0000","last_became_active":"2024-05-27T10:53:22.854090+0000","last_became_peered":"2024-05-27T10:53:22.854090+0000","last_unstale":"2024-05-27T10:53:22.860962+0000","last_undegraded":"2024-05-27T10:53:22.860962+0000","last_fullsized":"2024-05-27T10:53:22.860962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:20.391795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.856446+0000","last_change":"2024-05-27T10:53:22.847363+0000","last_active":"2024-05-27T10:53:22.856446+0000","last_peered":"2024-05-27T10:53:22.856446+0000","last_clean":"2024-05-27T10:53:22.856446+0000","last_became_active":"2024-05-27T10:53:22.847097+0000","last_became_peered":"2024-05-27T10:53:22.847097+0000","last_unstale":"2024-05-27T10:53:22.856446+0000","last_undegraded":"2024-05-27T10:53:22.856446+0000","last_fullsized":"2024-05-27T10:53:22.856446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:57:02.366139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.868940+0000","last_change":"2024-05-27T10:53:22.862215+0000","last_active":"2024-05-27T10:53:22.868940+0000","last_peered":"2024-05-27T10:53:22.868940+0000","last_clean":"2024-05-27T10:53:22.868940+0000","last_became_active":"2024-05-27T10:53:22.861915+0000","last_became_peered":"2024-05-27T10:53:22.861915+0000","last_unstale":"2024-05-27T10:53:22.868940+0000","last_undegraded":"2024-05-27T10:53:22.868940+0000","last_fullsized":"2024-05-27T10:53:22.868940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:33:07.238602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.853756+0000","last_change":"2024-05-27T10:53:22.849359+0000","last_active":"2024-05-27T10:53:23.853756+0000","last_peered":"2024-05-27T10:53:23.853756+0000","last_clean":"2024-05-27T10:53:23.853756+0000","last_became_active":"2024-05-27T10:53:22.849013+0000","last_became_peered":"2024-05-27T10:53:22.849013+0000","last_unstale":"2024-05-27T10:53:23.853756+0000","last_undegraded":"2024-05-27T10:53:23.853756+0000","last_fullsized":"2024-05-27T10:53:23.853756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:17:38.080730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.869092+0000","last_change":"2024-05-27T10:53:22.863215+0000","last_active":"2024-05-27T10:53:22.869092+0000","last_peered":"2024-05-27T10:53:22.869092+0000","last_clean":"2024-05-27T10:53:22.869092+0000","last_became_active":"2024-05-27T10:53:22.862926+0000","last_became_peered":"2024-05-27T10:53:22.862926+0000","last_unstale":"2024-05-27T10:53:22.869092+0000","last_undegraded":"2024-05-27T10:53:22.869092+0000","last_fullsized":"2024-05-27T10:53:22.869092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:23:39.238652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.859512+0000","last_change":"2024-05-27T10:53:22.855589+0000","last_active":"2024-05-27T10:53:22.859512+0000","last_peered":"2024-05-27T10:53:22.859512+0000","last_clean":"2024-05-27T10:53:22.859512+0000","last_became_active":"2024-05-27T10:53:22.855334+0000","last_became_peered":"2024-05-27T10:53:22.855334+0000","last_unstale":"2024-05-27T10:53:22.859512+0000","last_undegraded":"2024-05-27T10:53:22.859512+0000","last_fullsized":"2024-05-27T10:53:22.859512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:33:26.866748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851393+0000","last_change":"2024-05-27T10:53:22.845981+0000","last_active":"2024-05-27T10:53:23.851393+0000","last_peered":"2024-05-27T10:53:23.851393+0000","last_clean":"2024-05-27T10:53:23.851393+0000","last_became_active":"2024-05-27T10:53:22.845513+0000","last_became_peered":"2024-05-27T10:53:22.845513+0000","last_unstale":"2024-05-27T10:53:23.851393+0000","last_undegraded":"2024-05-27T10:53:23.851393+0000","last_fullsized":"2024-05-27T10:53:23.851393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:00:46.823241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.960985+0000","last_change":"2024-05-27T10:53:22.854712+0000","last_active":"2024-05-27T10:53:23.960985+0000","last_peered":"2024-05-27T10:53:23.960985+0000","last_clean":"2024-05-27T10:53:23.960985+0000","last_became_active":"2024-05-27T10:53:22.854348+0000","last_became_peered":"2024-05-27T10:53:22.854348+0000","last_unstale":"2024-05-27T10:53:23.960985+0000","last_undegraded":"2024-05-27T10:53:23.960985+0000","last_fullsized":"2024-05-27T10:53:23.960985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:01:26.220914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.859247+0000","last_change":"2024-05-27T10:53:22.853256+0000","last_active":"2024-05-27T10:53:22.859247+0000","last_peered":"2024-05-27T10:53:22.859247+0000","last_clean":"2024-05-27T10:53:22.859247+0000","last_became_active":"2024-05-27T10:53:22.852969+0000","last_became_peered":"2024-05-27T10:53:22.852969+0000","last_unstale":"2024-05-27T10:53:22.859247+0000","last_undegraded":"2024-05-27T10:53:22.859247+0000","last_fullsized":"2024-05-27T10:53:22.859247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:51:50.348279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.961569+0000","last_change":"2024-05-27T10:53:22.858038+0000","last_active":"2024-05-27T10:53:23.961569+0000","last_peered":"2024-05-27T10:53:23.961569+0000","last_clean":"2024-05-27T10:53:23.961569+0000","last_became_active":"2024-05-27T10:53:22.857705+0000","last_became_peered":"2024-05-27T10:53:22.857705+0000","last_unstale":"2024-05-27T10:53:23.961569+0000","last_undegraded":"2024-05-27T10:53:23.961569+0000","last_fullsized":"2024-05-27T10:53:23.961569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:25:34.606091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.857791+0000","last_change":"2024-05-27T10:53:22.856014+0000","last_active":"2024-05-27T10:53:22.857791+0000","last_peered":"2024-05-27T10:53:22.857791+0000","last_clean":"2024-05-27T10:53:22.857791+0000","last_became_active":"2024-05-27T10:53:22.855739+0000","last_became_peered":"2024-05-27T10:53:22.855739+0000","last_unstale":"2024-05-27T10:53:22.857791+0000","last_undegraded":"2024-05-27T10:53:22.857791+0000","last_fullsized":"2024-05-27T10:53:22.857791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:55:31.722504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.862568+0000","last_change":"2024-05-27T10:53:21.853935+0000","last_active":"2024-05-27T10:53:22.862568+0000","last_peered":"2024-05-27T10:53:22.862568+0000","last_clean":"2024-05-27T10:53:22.862568+0000","last_became_active":"2024-05-27T10:53:21.853021+0000","last_became_peered":"2024-05-27T10:53:21.853021+0000","last_unstale":"2024-05-27T10:53:22.862568+0000","last_undegraded":"2024-05-27T10:53:22.862568+0000","last_fullsized":"2024-05-27T10:53:22.862568+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:52:35.726060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.859677+0000","last_change":"2024-05-27T10:53:22.857744+0000","last_active":"2024-05-27T10:53:22.859677+0000","last_peered":"2024-05-27T10:53:22.859677+0000","last_clean":"2024-05-27T10:53:22.859677+0000","last_became_active":"2024-05-27T10:53:22.857344+0000","last_became_peered":"2024-05-27T10:53:22.857344+0000","last_unstale":"2024-05-27T10:53:22.859677+0000","last_undegraded":"2024-05-27T10:53:22.859677+0000","last_fullsized":"2024-05-27T10:53:22.859677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:55:31.722504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.861238+0000","last_change":"2024-05-27T10:53:21.856567+0000","last_active":"2024-05-27T10:53:22.861238+0000","last_peered":"2024-05-27T10:53:22.861238+0000","last_clean":"2024-05-27T10:53:22.861238+0000","last_became_active":"2024-05-27T10:53:21.856216+0000","last_became_peered":"2024-05-27T10:53:21.856216+0000","last_unstale":"2024-05-27T10:53:22.861238+0000","last_undegraded":"2024-05-27T10:53:22.861238+0000","last_fullsized":"2024-05-27T10:53:22.861238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:01:44.974858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851414+0000","last_change":"2024-05-27T10:53:22.854317+0000","last_active":"2024-05-27T10:53:23.851414+0000","last_peered":"2024-05-27T10:53:23.851414+0000","last_clean":"2024-05-27T10:53:23.851414+0000","last_became_active":"2024-05-27T10:53:22.853979+0000","last_became_peered":"2024-05-27T10:53:22.853979+0000","last_unstale":"2024-05-27T10:53:23.851414+0000","last_undegraded":"2024-05-27T10:53:23.851414+0000","last_fullsized":"2024-05-27T10:53:23.851414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:33:26.866748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.854006+0000","last_change":"2024-05-27T10:53:21.847417+0000","last_active":"2024-05-27T10:53:23.854006+0000","last_peered":"2024-05-27T10:53:23.854006+0000","last_clean":"2024-05-27T10:53:23.854006+0000","last_became_active":"2024-05-27T10:53:21.847108+0000","last_became_peered":"2024-05-27T10:53:21.847108+0000","last_unstale":"2024-05-27T10:53:23.854006+0000","last_undegraded":"2024-05-27T10:53:23.854006+0000","last_fullsized":"2024-05-27T10:53:23.854006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:23:38.221794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.870348+0000","last_change":"2024-05-27T10:53:22.868434+0000","last_active":"2024-05-27T10:53:22.870348+0000","last_peered":"2024-05-27T10:53:22.870348+0000","last_clean":"2024-05-27T10:53:22.870348+0000","last_became_active":"2024-05-27T10:53:22.863198+0000","last_became_peered":"2024-05-27T10:53:22.863198+0000","last_unstale":"2024-05-27T10:53:22.870348+0000","last_undegraded":"2024-05-27T10:53:22.870348+0000","last_fullsized":"2024-05-27T10:53:22.870348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:00:46.823241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850912+0000","last_change":"2024-05-27T10:53:21.849165+0000","last_active":"2024-05-27T10:53:23.850912+0000","last_peered":"2024-05-27T10:53:23.850912+0000","last_clean":"2024-05-27T10:53:23.850912+0000","last_became_active":"2024-05-27T10:53:21.848845+0000","last_became_peered":"2024-05-27T10:53:21.848845+0000","last_unstale":"2024-05-27T10:53:23.850912+0000","last_undegraded":"2024-05-27T10:53:23.850912+0000","last_fullsized":"2024-05-27T10:53:23.850912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:58:24.719173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.960954+0000","last_change":"2024-05-27T10:53:22.860122+0000","last_active":"2024-05-27T10:53:23.960954+0000","last_peered":"2024-05-27T10:53:23.960954+0000","last_clean":"2024-05-27T10:53:23.960954+0000","last_became_active":"2024-05-27T10:53:22.858031+0000","last_became_peered":"2024-05-27T10:53:22.858031+0000","last_unstale":"2024-05-27T10:53:23.960954+0000","last_undegraded":"2024-05-27T10:53:23.960954+0000","last_fullsized":"2024-05-27T10:53:23.960954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:47.477033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851703+0000","last_change":"2024-05-27T10:53:21.851395+0000","last_active":"2024-05-27T10:53:23.851703+0000","last_peered":"2024-05-27T10:53:23.851703+0000","last_clean":"2024-05-27T10:53:23.851703+0000","last_became_active":"2024-05-27T10:53:21.846968+0000","last_became_peered":"2024-05-27T10:53:21.846968+0000","last_unstale":"2024-05-27T10:53:23.851703+0000","last_undegraded":"2024-05-27T10:53:23.851703+0000","last_fullsized":"2024-05-27T10:53:23.851703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:53:59.154416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.858690+0000","last_change":"2024-05-27T10:53:22.854974+0000","last_active":"2024-05-27T10:53:22.858690+0000","last_peered":"2024-05-27T10:53:22.858690+0000","last_clean":"2024-05-27T10:53:22.858690+0000","last_became_active":"2024-05-27T10:53:22.854718+0000","last_became_peered":"2024-05-27T10:53:22.854718+0000","last_unstale":"2024-05-27T10:53:22.858690+0000","last_undegraded":"2024-05-27T10:53:22.858690+0000","last_fullsized":"2024-05-27T10:53:22.858690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:00:46.823241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851212+0000","last_change":"2024-05-27T10:53:21.846948+0000","last_active":"2024-05-27T10:53:23.851212+0000","last_peered":"2024-05-27T10:53:23.851212+0000","last_clean":"2024-05-27T10:53:23.851212+0000","last_became_active":"2024-05-27T10:53:21.846619+0000","last_became_peered":"2024-05-27T10:53:21.846619+0000","last_unstale":"2024-05-27T10:53:23.851212+0000","last_undegraded":"2024-05-27T10:53:23.851212+0000","last_fullsized":"2024-05-27T10:53:23.851212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:35:08.749848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850561+0000","last_change":"2024-05-27T10:53:22.866171+0000","last_active":"2024-05-27T10:53:23.850561+0000","last_peered":"2024-05-27T10:53:23.850561+0000","last_clean":"2024-05-27T10:53:23.850561+0000","last_became_active":"2024-05-27T10:53:22.854348+0000","last_became_peered":"2024-05-27T10:53:22.854348+0000","last_unstale":"2024-05-27T10:53:23.850561+0000","last_undegraded":"2024-05-27T10:53:23.850561+0000","last_fullsized":"2024-05-27T10:53:23.850561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:39:47.386726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.852284+0000","last_change":"2024-05-27T10:53:21.838078+0000","last_active":"2024-05-27T10:53:23.852284+0000","last_peered":"2024-05-27T10:53:23.852284+0000","last_clean":"2024-05-27T10:53:23.852284+0000","last_became_active":"2024-05-27T10:53:21.837747+0000","last_became_peered":"2024-05-27T10:53:21.837747+0000","last_unstale":"2024-05-27T10:53:23.852284+0000","last_undegraded":"2024-05-27T10:53:23.852284+0000","last_fullsized":"2024-05-27T10:53:23.852284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:33:06.221744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.870036+0000","last_change":"2024-05-27T10:53:22.866282+0000","last_active":"2024-05-27T10:53:22.870036+0000","last_peered":"2024-05-27T10:53:22.870036+0000","last_clean":"2024-05-27T10:53:22.870036+0000","last_became_active":"2024-05-27T10:53:22.865974+0000","last_became_peered":"2024-05-27T10:53:22.865974+0000","last_unstale":"2024-05-27T10:53:22.870036+0000","last_undegraded":"2024-05-27T10:53:22.870036+0000","last_fullsized":"2024-05-27T10:53:22.870036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:00:28.398086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850770+0000","last_change":"2024-05-27T10:53:21.848915+0000","last_active":"2024-05-27T10:53:23.850770+0000","last_peered":"2024-05-27T10:53:23.850770+0000","last_clean":"2024-05-27T10:53:23.850770+0000","last_became_active":"2024-05-27T10:53:21.848617+0000","last_became_peered":"2024-05-27T10:53:21.848617+0000","last_unstale":"2024-05-27T10:53:23.850770+0000","last_undegraded":"2024-05-27T10:53:23.850770+0000","last_fullsized":"2024-05-27T10:53:23.850770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:09:31.216390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.858954+0000","last_change":"2024-05-27T10:53:22.851589+0000","last_active":"2024-05-27T10:53:22.858954+0000","last_peered":"2024-05-27T10:53:22.858954+0000","last_clean":"2024-05-27T10:53:22.858954+0000","last_became_active":"2024-05-27T10:53:22.851026+0000","last_became_peered":"2024-05-27T10:53:22.851026+0000","last_unstale":"2024-05-27T10:53:22.858954+0000","last_undegraded":"2024-05-27T10:53:22.858954+0000","last_fullsized":"2024-05-27T10:53:22.858954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:39:47.386726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.853920+0000","last_change":"2024-05-27T10:53:21.856631+0000","last_active":"2024-05-27T10:53:23.853920+0000","last_peered":"2024-05-27T10:53:23.853920+0000","last_clean":"2024-05-27T10:53:23.853920+0000","last_became_active":"2024-05-27T10:53:21.856076+0000","last_became_peered":"2024-05-27T10:53:21.856076+0000","last_unstale":"2024-05-27T10:53:23.853920+0000","last_undegraded":"2024-05-27T10:53:23.853920+0000","last_fullsized":"2024-05-27T10:53:23.853920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:39:46.369868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.853498+0000","last_change":"2024-05-27T10:53:22.868451+0000","last_active":"2024-05-27T10:53:23.853498+0000","last_peered":"2024-05-27T10:53:23.853498+0000","last_clean":"2024-05-27T10:53:23.853498+0000","last_became_active":"2024-05-27T10:53:22.866072+0000","last_became_peered":"2024-05-27T10:53:22.866072+0000","last_unstale":"2024-05-27T10:53:23.853498+0000","last_undegraded":"2024-05-27T10:53:23.853498+0000","last_fullsized":"2024-05-27T10:53:23.853498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:13:17.380852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.834209+0000","last_change":"2024-05-27T10:53:21.841349+0000","last_active":"2024-05-27T10:53:22.834209+0000","last_peered":"2024-05-27T10:53:22.834209+0000","last_clean":"2024-05-27T10:53:22.834209+0000","last_became_active":"2024-05-27T10:53:21.841065+0000","last_became_peered":"2024-05-27T10:53:21.841065+0000","last_unstale":"2024-05-27T10:53:22.834209+0000","last_undegraded":"2024-05-27T10:53:22.834209+0000","last_fullsized":"2024-05-27T10:53:22.834209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:50.056223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.853299+0000","last_change":"2024-05-27T10:53:22.846257+0000","last_active":"2024-05-27T10:53:23.853299+0000","last_peered":"2024-05-27T10:53:23.853299+0000","last_clean":"2024-05-27T10:53:23.853299+0000","last_became_active":"2024-05-27T10:53:22.845968+0000","last_became_peered":"2024-05-27T10:53:22.845968+0000","last_unstale":"2024-05-27T10:53:23.853299+0000","last_undegraded":"2024-05-27T10:53:23.853299+0000","last_fullsized":"2024-05-27T10:53:23.853299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:17:36.654521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.865395+0000","last_change":"2024-05-27T10:53:21.851797+0000","last_active":"2024-05-27T10:53:22.865395+0000","last_peered":"2024-05-27T10:53:22.865395+0000","last_clean":"2024-05-27T10:53:22.865395+0000","last_became_active":"2024-05-27T10:53:21.851519+0000","last_became_peered":"2024-05-27T10:53:21.851519+0000","last_unstale":"2024-05-27T10:53:22.865395+0000","last_undegraded":"2024-05-27T10:53:22.865395+0000","last_fullsized":"2024-05-27T10:53:22.865395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:23:38.221794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.869298+0000","last_change":"2024-05-27T10:53:22.867460+0000","last_active":"2024-05-27T10:53:22.869298+0000","last_peered":"2024-05-27T10:53:22.869298+0000","last_clean":"2024-05-27T10:53:22.869298+0000","last_became_active":"2024-05-27T10:53:22.867142+0000","last_became_peered":"2024-05-27T10:53:22.867142+0000","last_unstale":"2024-05-27T10:53:22.869298+0000","last_undegraded":"2024-05-27T10:53:22.869298+0000","last_fullsized":"2024-05-27T10:53:22.869298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:38:30.803119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.853038+0000","last_change":"2024-05-27T10:53:21.850072+0000","last_active":"2024-05-27T10:53:23.853038+0000","last_peered":"2024-05-27T10:53:23.853038+0000","last_clean":"2024-05-27T10:53:23.853038+0000","last_became_active":"2024-05-27T10:53:21.849754+0000","last_became_peered":"2024-05-27T10:53:21.849754+0000","last_unstale":"2024-05-27T10:53:23.853038+0000","last_undegraded":"2024-05-27T10:53:23.853038+0000","last_fullsized":"2024-05-27T10:53:23.853038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:00:27.381228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.870070+0000","last_change":"2024-05-27T10:53:22.867903+0000","last_active":"2024-05-27T10:53:22.870070+0000","last_peered":"2024-05-27T10:53:22.870070+0000","last_clean":"2024-05-27T10:53:22.870070+0000","last_became_active":"2024-05-27T10:53:22.867625+0000","last_became_peered":"2024-05-27T10:53:22.867625+0000","last_unstale":"2024-05-27T10:53:22.870070+0000","last_undegraded":"2024-05-27T10:53:22.870070+0000","last_fullsized":"2024-05-27T10:53:22.870070+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:27:29.011353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851687+0000","last_change":"2024-05-27T10:53:21.851822+0000","last_active":"2024-05-27T10:53:23.851687+0000","last_peered":"2024-05-27T10:53:23.851687+0000","last_clean":"2024-05-27T10:53:23.851687+0000","last_became_active":"2024-05-27T10:53:21.851370+0000","last_became_peered":"2024-05-27T10:53:21.851370+0000","last_unstale":"2024-05-27T10:53:23.851687+0000","last_undegraded":"2024-05-27T10:53:23.851687+0000","last_fullsized":"2024-05-27T10:53:23.851687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:01:44.974858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.852995+0000","last_change":"2024-05-27T10:53:22.853223+0000","last_active":"2024-05-27T10:53:23.852995+0000","last_peered":"2024-05-27T10:53:23.852995+0000","last_clean":"2024-05-27T10:53:23.852995+0000","last_became_active":"2024-05-27T10:53:22.852909+0000","last_became_peered":"2024-05-27T10:53:22.852909+0000","last_unstale":"2024-05-27T10:53:23.852995+0000","last_undegraded":"2024-05-27T10:53:23.852995+0000","last_fullsized":"2024-05-27T10:53:23.852995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:12:39.009218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.842461+0000","last_change":"2024-05-27T10:53:21.835104+0000","last_active":"2024-05-27T10:53:22.842461+0000","last_peered":"2024-05-27T10:53:22.842461+0000","last_clean":"2024-05-27T10:53:22.842461+0000","last_became_active":"2024-05-27T10:53:21.834814+0000","last_became_peered":"2024-05-27T10:53:21.834814+0000","last_unstale":"2024-05-27T10:53:22.842461+0000","last_undegraded":"2024-05-27T10:53:22.842461+0000","last_fullsized":"2024-05-27T10:53:22.842461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:51:49.331421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.961725+0000","last_change":"2024-05-27T10:53:22.870363+0000","last_active":"2024-05-27T10:53:23.961725+0000","last_peered":"2024-05-27T10:53:23.961725+0000","last_clean":"2024-05-27T10:53:23.961725+0000","last_became_active":"2024-05-27T10:53:22.869500+0000","last_became_peered":"2024-05-27T10:53:22.869500+0000","last_unstale":"2024-05-27T10:53:23.961725+0000","last_undegraded":"2024-05-27T10:53:23.961725+0000","last_fullsized":"2024-05-27T10:53:23.961725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:26:00.846616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.852505+0000","last_change":"2024-05-27T10:53:21.852670+0000","last_active":"2024-05-27T10:53:23.852505+0000","last_peered":"2024-05-27T10:53:23.852505+0000","last_clean":"2024-05-27T10:53:23.852505+0000","last_became_active":"2024-05-27T10:53:21.852418+0000","last_became_peered":"2024-05-27T10:53:21.852418+0000","last_unstale":"2024-05-27T10:53:23.852505+0000","last_undegraded":"2024-05-27T10:53:23.852505+0000","last_fullsized":"2024-05-27T10:53:23.852505+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:57:01.349281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.859999+0000","last_change":"2024-05-27T10:53:22.858333+0000","last_active":"2024-05-27T10:53:22.859999+0000","last_peered":"2024-05-27T10:53:22.859999+0000","last_clean":"2024-05-27T10:53:22.859999+0000","last_became_active":"2024-05-27T10:53:22.858023+0000","last_became_peered":"2024-05-27T10:53:22.858023+0000","last_unstale":"2024-05-27T10:53:22.859999+0000","last_undegraded":"2024-05-27T10:53:22.859999+0000","last_fullsized":"2024-05-27T10:53:22.859999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:20.391795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.852050+0000","last_change":"2024-05-27T10:53:21.849520+0000","last_active":"2024-05-27T10:53:23.852050+0000","last_peered":"2024-05-27T10:53:23.852050+0000","last_clean":"2024-05-27T10:53:23.852050+0000","last_became_active":"2024-05-27T10:53:21.848053+0000","last_became_peered":"2024-05-27T10:53:21.848053+0000","last_unstale":"2024-05-27T10:53:23.852050+0000","last_undegraded":"2024-05-27T10:53:23.852050+0000","last_fullsized":"2024-05-27T10:53:23.852050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:19.374937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851609+0000","last_change":"2024-05-27T10:53:22.858263+0000","last_active":"2024-05-27T10:53:23.851609+0000","last_peered":"2024-05-27T10:53:23.851609+0000","last_clean":"2024-05-27T10:53:23.851609+0000","last_became_active":"2024-05-27T10:53:22.857976+0000","last_became_peered":"2024-05-27T10:53:22.857976+0000","last_unstale":"2024-05-27T10:53:23.851609+0000","last_undegraded":"2024-05-27T10:53:23.851609+0000","last_fullsized":"2024-05-27T10:53:23.851609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:53:10.724493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.874388+0000","last_change":"2024-05-27T10:53:21.847169+0000","last_active":"2024-05-27T10:53:22.874388+0000","last_peered":"2024-05-27T10:53:22.874388+0000","last_clean":"2024-05-27T10:53:22.874388+0000","last_became_active":"2024-05-27T10:53:21.846630+0000","last_became_peered":"2024-05-27T10:53:21.846630+0000","last_unstale":"2024-05-27T10:53:22.874388+0000","last_undegraded":"2024-05-27T10:53:22.874388+0000","last_fullsized":"2024-05-27T10:53:22.874388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:19.374937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.858480+0000","last_change":"2024-05-27T10:53:22.853961+0000","last_active":"2024-05-27T10:53:22.858480+0000","last_peered":"2024-05-27T10:53:22.858480+0000","last_clean":"2024-05-27T10:53:22.858480+0000","last_became_active":"2024-05-27T10:53:22.853687+0000","last_became_peered":"2024-05-27T10:53:22.853687+0000","last_unstale":"2024-05-27T10:53:22.858480+0000","last_undegraded":"2024-05-27T10:53:22.858480+0000","last_fullsized":"2024-05-27T10:53:22.858480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:27:29.011353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851483+0000","last_change":"2024-05-27T10:53:21.851807+0000","last_active":"2024-05-27T10:53:23.851483+0000","last_peered":"2024-05-27T10:53:23.851483+0000","last_clean":"2024-05-27T10:53:23.851483+0000","last_became_active":"2024-05-27T10:53:21.851401+0000","last_became_peered":"2024-05-27T10:53:21.851401+0000","last_unstale":"2024-05-27T10:53:23.851483+0000","last_undegraded":"2024-05-27T10:53:23.851483+0000","last_fullsized":"2024-05-27T10:53:23.851483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:52:35.726060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.870606+0000","last_change":"2024-05-27T10:53:22.864250+0000","last_active":"2024-05-27T10:53:22.870606+0000","last_peered":"2024-05-27T10:53:22.870606+0000","last_clean":"2024-05-27T10:53:22.870606+0000","last_became_active":"2024-05-27T10:53:22.863861+0000","last_became_peered":"2024-05-27T10:53:22.863861+0000","last_unstale":"2024-05-27T10:53:22.870606+0000","last_undegraded":"2024-05-27T10:53:22.870606+0000","last_fullsized":"2024-05-27T10:53:22.870606+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:57:02.366139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851680+0000","last_change":"2024-05-27T10:53:21.842414+0000","last_active":"2024-05-27T10:53:23.851680+0000","last_peered":"2024-05-27T10:53:23.851680+0000","last_clean":"2024-05-27T10:53:23.851680+0000","last_became_active":"2024-05-27T10:53:21.841225+0000","last_became_peered":"2024-05-27T10:53:21.841225+0000","last_unstale":"2024-05-27T10:53:23.851680+0000","last_undegraded":"2024-05-27T10:53:23.851680+0000","last_fullsized":"2024-05-27T10:53:23.851680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:50.056223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850326+0000","last_change":"2024-05-27T10:53:22.850508+0000","last_active":"2024-05-27T10:53:23.850326+0000","last_peered":"2024-05-27T10:53:23.850326+0000","last_clean":"2024-05-27T10:53:23.850326+0000","last_became_active":"2024-05-27T10:53:22.850227+0000","last_became_peered":"2024-05-27T10:53:22.850227+0000","last_unstale":"2024-05-27T10:53:23.850326+0000","last_undegraded":"2024-05-27T10:53:23.850326+0000","last_fullsized":"2024-05-27T10:53:23.850326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:35:09.766706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851353+0000","last_change":"2024-05-27T10:53:21.847848+0000","last_active":"2024-05-27T10:53:23.851353+0000","last_peered":"2024-05-27T10:53:23.851353+0000","last_clean":"2024-05-27T10:53:23.851353+0000","last_became_active":"2024-05-27T10:53:21.847547+0000","last_became_peered":"2024-05-27T10:53:21.847547+0000","last_unstale":"2024-05-27T10:53:23.851353+0000","last_undegraded":"2024-05-27T10:53:23.851353+0000","last_fullsized":"2024-05-27T10:53:23.851353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:45:24.257422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850101+0000","last_change":"2024-05-27T10:53:22.834721+0000","last_active":"2024-05-27T10:53:23.850101+0000","last_peered":"2024-05-27T10:53:23.850101+0000","last_clean":"2024-05-27T10:53:23.850101+0000","last_became_active":"2024-05-27T10:53:22.834385+0000","last_became_peered":"2024-05-27T10:53:22.834385+0000","last_unstale":"2024-05-27T10:53:23.850101+0000","last_undegraded":"2024-05-27T10:53:23.850101+0000","last_fullsized":"2024-05-27T10:53:23.850101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:09:32.233248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.860598+0000","last_change":"2024-05-27T10:53:21.840315+0000","last_active":"2024-05-27T10:53:22.860598+0000","last_peered":"2024-05-27T10:53:22.860598+0000","last_clean":"2024-05-27T10:53:22.860598+0000","last_became_active":"2024-05-27T10:53:21.839991+0000","last_became_peered":"2024-05-27T10:53:21.839991+0000","last_unstale":"2024-05-27T10:53:22.860598+0000","last_undegraded":"2024-05-27T10:53:22.860598+0000","last_fullsized":"2024-05-27T10:53:22.860598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:52:35.726060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.851025+0000","last_change":"2024-05-27T10:53:22.869588+0000","last_active":"2024-05-27T10:53:23.851025+0000","last_peered":"2024-05-27T10:53:23.851025+0000","last_clean":"2024-05-27T10:53:23.851025+0000","last_became_active":"2024-05-27T10:53:22.869288+0000","last_became_peered":"2024-05-27T10:53:22.869288+0000","last_unstale":"2024-05-27T10:53:23.851025+0000","last_undegraded":"2024-05-27T10:53:23.851025+0000","last_fullsized":"2024-05-27T10:53:23.851025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:52:36.742918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.836434+0000","last_change":"2024-05-27T10:53:21.843211+0000","last_active":"2024-05-27T10:53:22.836434+0000","last_peered":"2024-05-27T10:53:22.836434+0000","last_clean":"2024-05-27T10:53:22.836434+0000","last_became_active":"2024-05-27T10:53:21.842884+0000","last_became_peered":"2024-05-27T10:53:21.842884+0000","last_unstale":"2024-05-27T10:53:22.836434+0000","last_undegraded":"2024-05-27T10:53:22.836434+0000","last_fullsized":"2024-05-27T10:53:22.836434+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:50.056223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850313+0000","last_change":"2024-05-27T10:53:22.853706+0000","last_active":"2024-05-27T10:53:23.850313+0000","last_peered":"2024-05-27T10:53:23.850313+0000","last_clean":"2024-05-27T10:53:23.850313+0000","last_became_active":"2024-05-27T10:53:22.853110+0000","last_became_peered":"2024-05-27T10:53:22.853110+0000","last_unstale":"2024-05-27T10:53:23.850313+0000","last_undegraded":"2024-05-27T10:53:23.850313+0000","last_fullsized":"2024-05-27T10:53:23.850313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:54:00.171274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850728+0000","last_change":"2024-05-27T10:53:21.840371+0000","last_active":"2024-05-27T10:53:23.850728+0000","last_peered":"2024-05-27T10:53:23.850728+0000","last_clean":"2024-05-27T10:53:23.850728+0000","last_became_active":"2024-05-27T10:53:21.839612+0000","last_became_peered":"2024-05-27T10:53:21.839612+0000","last_unstale":"2024-05-27T10:53:23.850728+0000","last_undegraded":"2024-05-27T10:53:23.850728+0000","last_fullsized":"2024-05-27T10:53:23.850728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:05:06.955720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.960907+0000","last_change":"2024-05-27T10:53:22.863050+0000","last_active":"2024-05-27T10:53:23.960907+0000","last_peered":"2024-05-27T10:53:23.960907+0000","last_clean":"2024-05-27T10:53:23.960907+0000","last_became_active":"2024-05-27T10:53:22.862527+0000","last_became_peered":"2024-05-27T10:53:22.862527+0000","last_unstale":"2024-05-27T10:53:23.960907+0000","last_undegraded":"2024-05-27T10:53:23.960907+0000","last_fullsized":"2024-05-27T10:53:23.960907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:00:52.836281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.837888+0000","last_change":"2024-05-27T10:53:21.856681+0000","last_active":"2024-05-27T10:53:22.837888+0000","last_peered":"2024-05-27T10:53:22.837888+0000","last_clean":"2024-05-27T10:53:22.837888+0000","last_became_active":"2024-05-27T10:53:21.856185+0000","last_became_peered":"2024-05-27T10:53:21.856185+0000","last_unstale":"2024-05-27T10:53:22.837888+0000","last_undegraded":"2024-05-27T10:53:22.837888+0000","last_fullsized":"2024-05-27T10:53:22.837888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:33:06.221744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850680+0000","last_change":"2024-05-27T10:53:22.853766+0000","last_active":"2024-05-27T10:53:23.850680+0000","last_peered":"2024-05-27T10:53:23.850680+0000","last_clean":"2024-05-27T10:53:23.850680+0000","last_became_active":"2024-05-27T10:53:22.853365+0000","last_became_peered":"2024-05-27T10:53:22.853365+0000","last_unstale":"2024-05-27T10:53:23.850680+0000","last_undegraded":"2024-05-27T10:53:23.850680+0000","last_fullsized":"2024-05-27T10:53:23.850680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:45:25.274280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.874246+0000","last_change":"2024-05-27T10:53:21.849302+0000","last_active":"2024-05-27T10:53:22.874246+0000","last_peered":"2024-05-27T10:53:22.874246+0000","last_clean":"2024-05-27T10:53:22.874246+0000","last_became_active":"2024-05-27T10:53:21.848944+0000","last_became_peered":"2024-05-27T10:53:21.848944+0000","last_unstale":"2024-05-27T10:53:22.874246+0000","last_undegraded":"2024-05-27T10:53:22.874246+0000","last_fullsized":"2024-05-27T10:53:22.874246+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:51:42.701663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.870429+0000","last_change":"2024-05-27T10:53:22.868750+0000","last_active":"2024-05-27T10:53:22.870429+0000","last_peered":"2024-05-27T10:53:22.870429+0000","last_clean":"2024-05-27T10:53:22.870429+0000","last_became_active":"2024-05-27T10:53:22.868076+0000","last_became_peered":"2024-05-27T10:53:22.868076+0000","last_unstale":"2024-05-27T10:53:22.870429+0000","last_undegraded":"2024-05-27T10:53:22.870429+0000","last_fullsized":"2024-05-27T10:53:22.870429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:06:42.117873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.834512+0000","last_change":"2024-05-27T10:53:21.842944+0000","last_active":"2024-05-27T10:53:22.834512+0000","last_peered":"2024-05-27T10:53:22.834512+0000","last_clean":"2024-05-27T10:53:22.834512+0000","last_became_active":"2024-05-27T10:53:21.842642+0000","last_became_peered":"2024-05-27T10:53:21.842642+0000","last_unstale":"2024-05-27T10:53:22.834512+0000","last_undegraded":"2024-05-27T10:53:22.834512+0000","last_fullsized":"2024-05-27T10:53:22.834512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:45:24.257422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.861566+0000","last_change":"2024-05-27T10:53:22.858269+0000","last_active":"2024-05-27T10:53:22.861566+0000","last_peered":"2024-05-27T10:53:22.861566+0000","last_clean":"2024-05-27T10:53:22.861566+0000","last_became_active":"2024-05-27T10:53:22.854984+0000","last_became_peered":"2024-05-27T10:53:22.854984+0000","last_unstale":"2024-05-27T10:53:22.861566+0000","last_undegraded":"2024-05-27T10:53:22.861566+0000","last_fullsized":"2024-05-27T10:53:22.861566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:51:43.718521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.847393+0000","last_change":"2024-05-27T10:53:21.839644+0000","last_active":"2024-05-27T10:53:22.847393+0000","last_peered":"2024-05-27T10:53:22.847393+0000","last_clean":"2024-05-27T10:53:22.847393+0000","last_became_active":"2024-05-27T10:53:21.838679+0000","last_became_peered":"2024-05-27T10:53:21.838679+0000","last_unstale":"2024-05-27T10:53:22.847393+0000","last_undegraded":"2024-05-27T10:53:22.847393+0000","last_fullsized":"2024-05-27T10:53:22.847393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:55:30.705646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.859537+0000","last_change":"2024-05-27T10:53:22.855841+0000","last_active":"2024-05-27T10:53:22.859537+0000","last_peered":"2024-05-27T10:53:22.859537+0000","last_clean":"2024-05-27T10:53:22.859537+0000","last_became_active":"2024-05-27T10:53:22.855464+0000","last_became_peered":"2024-05-27T10:53:22.855464+0000","last_unstale":"2024-05-27T10:53:22.859537+0000","last_undegraded":"2024-05-27T10:53:22.859537+0000","last_fullsized":"2024-05-27T10:53:22.859537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:15:09.136716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.837211+0000","last_change":"2024-05-27T10:53:21.846246+0000","last_active":"2024-05-27T10:53:22.837211+0000","last_peered":"2024-05-27T10:53:22.837211+0000","last_clean":"2024-05-27T10:53:22.837211+0000","last_became_active":"2024-05-27T10:53:21.845936+0000","last_became_peered":"2024-05-27T10:53:21.845936+0000","last_unstale":"2024-05-27T10:53:22.837211+0000","last_undegraded":"2024-05-27T10:53:22.837211+0000","last_fullsized":"2024-05-27T10:53:22.837211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:51:49.331421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.854337+0000","last_change":"2024-05-27T10:53:22.852749+0000","last_active":"2024-05-27T10:53:22.854337+0000","last_peered":"2024-05-27T10:53:22.854337+0000","last_clean":"2024-05-27T10:53:22.854337+0000","last_became_active":"2024-05-27T10:53:22.852438+0000","last_became_peered":"2024-05-27T10:53:22.852438+0000","last_unstale":"2024-05-27T10:53:22.854337+0000","last_undegraded":"2024-05-27T10:53:22.854337+0000","last_fullsized":"2024-05-27T10:53:22.854337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:15:09.136716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.842619+0000","last_change":"2024-05-27T10:53:21.850605+0000","last_active":"2024-05-27T10:53:22.842619+0000","last_peered":"2024-05-27T10:53:22.842619+0000","last_clean":"2024-05-27T10:53:22.842619+0000","last_became_active":"2024-05-27T10:53:21.850341+0000","last_became_peered":"2024-05-27T10:53:21.850341+0000","last_unstale":"2024-05-27T10:53:22.842619+0000","last_undegraded":"2024-05-27T10:53:22.842619+0000","last_fullsized":"2024-05-27T10:53:22.842619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:15:08.119858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.852555+0000","last_change":"2024-05-27T10:53:22.855374+0000","last_active":"2024-05-27T10:53:23.852555+0000","last_peered":"2024-05-27T10:53:23.852555+0000","last_clean":"2024-05-27T10:53:23.852555+0000","last_became_active":"2024-05-27T10:53:22.855091+0000","last_became_peered":"2024-05-27T10:53:22.855091+0000","last_unstale":"2024-05-27T10:53:23.852555+0000","last_undegraded":"2024-05-27T10:53:23.852555+0000","last_fullsized":"2024-05-27T10:53:23.852555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:47.477033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850882+0000","last_change":"2024-05-27T10:53:21.852377+0000","last_active":"2024-05-27T10:53:23.850882+0000","last_peered":"2024-05-27T10:53:23.850882+0000","last_clean":"2024-05-27T10:53:23.850882+0000","last_became_active":"2024-05-27T10:53:21.851082+0000","last_became_peered":"2024-05-27T10:53:21.851082+0000","last_unstale":"2024-05-27T10:53:23.850882+0000","last_undegraded":"2024-05-27T10:53:23.850882+0000","last_fullsized":"2024-05-27T10:53:23.850882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:51:19.944755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.850750+0000","last_change":"2024-05-27T10:53:22.854709+0000","last_active":"2024-05-27T10:53:23.850750+0000","last_peered":"2024-05-27T10:53:23.850750+0000","last_clean":"2024-05-27T10:53:23.850750+0000","last_became_active":"2024-05-27T10:53:22.854367+0000","last_became_peered":"2024-05-27T10:53:22.854367+0000","last_unstale":"2024-05-27T10:53:23.850750+0000","last_undegraded":"2024-05-27T10:53:23.850750+0000","last_fullsized":"2024-05-27T10:53:23.850750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:00:28.398086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.852172+0000","last_change":"2024-05-27T10:53:21.850751+0000","last_active":"2024-05-27T10:53:23.852172+0000","last_peered":"2024-05-27T10:53:23.852172+0000","last_clean":"2024-05-27T10:53:23.852172+0000","last_became_active":"2024-05-27T10:53:21.850500+0000","last_became_peered":"2024-05-27T10:53:21.850500+0000","last_unstale":"2024-05-27T10:53:23.852172+0000","last_undegraded":"2024-05-27T10:53:23.852172+0000","last_fullsized":"2024-05-27T10:53:23.852172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:51:42.701663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.961408+0000","last_change":"2024-05-27T10:53:22.848201+0000","last_active":"2024-05-27T10:53:23.961408+0000","last_peered":"2024-05-27T10:53:23.961408+0000","last_clean":"2024-05-27T10:53:23.961408+0000","last_became_active":"2024-05-27T10:53:22.847870+0000","last_became_peered":"2024-05-27T10:53:22.847870+0000","last_unstale":"2024-05-27T10:53:23.961408+0000","last_undegraded":"2024-05-27T10:53:23.961408+0000","last_fullsized":"2024-05-27T10:53:23.961408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:21.799641+0000","last_clean_scrub_stamp":"2024-05-27T10:53:21.799641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:43:46.639026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-27T10:53:22.839693+0000","last_change":"2024-05-27T10:53:21.845430+0000","last_active":"2024-05-27T10:53:22.839693+0000","last_peered":"2024-05-27T10:53:22.839693+0000","last_clean":"2024-05-27T10:53:22.839693+0000","last_became_active":"2024-05-27T10:53:21.845098+0000","last_became_peered":"2024-05-27T10:53:21.845098+0000","last_unstale":"2024-05-27T10:53:22.839693+0000","last_undegraded":"2024-05-27T10:53:22.839693+0000","last_fullsized":"2024-05-27T10:53:22.839693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:53:20.782783+0000","last_clean_scrub_stamp":"2024-05-27T10:53:20.782783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:45:24.257422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":195,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-27T10:53:23.961907+0000","last_change":"2024-05-27T10:51:56.473671+0000","last_active":"2024-05-27T10:53:23.961907+0000","last_peered":"2024-05-27T10:53:23.961907+0000","last_clean":"2024-05-27T10:53:23.961907+0000","last_became_active":"2024-05-27T10:51:56.470561+0000","last_became_peered":"2024-05-27T10:51:56.470561+0000","last_unstale":"2024-05-27T10:53:23.961907+0000","last_undegraded":"2024-05-27T10:53:23.961907+0000","last_fullsized":"2024-05-27T10:53:23.961907+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T10:51:55.105404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T10:51:55.105404+0000","last_clean_scrub_stamp":"2024-05-27T10:51:55.105404+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:20:59.737450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":958464,"data_stored":730774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":368640,"data_stored":140932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":368640,"data_stored":140988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":368640,"data_stored":140420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":148250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":364544,"data_stored":140386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":141950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":954368,"data_stored":730684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T10:53:27.851 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-27T10:53:27.852 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-27T10:53:28.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.117+0000 7fd10d600640 1 Processor -- start 2024-05-27T10:53:28.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.117+0000 7fd10d600640 1 -- start start 2024-05-27T10:53:28.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.118+0000 7fd10d600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd1080cd0a0 0x7fd108071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:28.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.118+0000 7fd10d600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd1080d1ad0 0x7fd1080c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:28.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.118+0000 7fd10d600640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd108072350 con 0x7fd10815c4a0 2024-05-27T10:53:28.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.118+0000 7fd10d600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd108071ab0 con 0x7fd1080d1ad0 2024-05-27T10:53:28.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.118+0000 7fd10d600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd108071d90 con 0x7fd1080cd0a0 2024-05-27T10:53:28.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.119+0000 7fd10cc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd1080d1ad0 0x7fd1080c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:28.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.119+0000 7fd10cc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd1080d1ad0 0x7fd1080c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55082/0 (socket says 172.21.15.47:55082) 2024-05-27T10:53:28.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.119+0000 7fd10cc00640 1 -- 172.21.15.47:0/2630977140 learned_addr learned my addr 172.21.15.47:0/2630977140 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:28.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.119+0000 7fd107400640 1 --2- 172.21.15.47:0/2630977140 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd1080cd0a0 0x7fd108071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:28.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.120+0000 7fd10cc00640 1 -- 172.21.15.47:0/2630977140 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd1080cd0a0 msgr2=0x7fd108071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:28.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.120+0000 7fd10cc00640 1 --2- 172.21.15.47:0/2630977140 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd1080cd0a0 0x7fd108071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.120+0000 7fd10cc00640 1 -- 172.21.15.47:0/2630977140 >> v1:172.21.15.53:6789/0 conn(0x7fd10815c4a0 legacy=0x7fd1080cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:28.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.120+0000 7fd10cc00640 1 -- 172.21.15.47:0/2630977140 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd108072070 con 0x7fd1080d1ad0 2024-05-27T10:53:28.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.121+0000 7fd10cc00640 1 --2- 172.21.15.47:0/2630977140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1080d1ad0 0x7fd1080c5e90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd100009870 tx=0x7fd10002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df1d21bc66d2b97 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:28.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.122+0000 7fd106a00640 1 -- 172.21.15.47:0/2630977140 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd100037070 con 0x7fd1080d1ad0 2024-05-27T10:53:28.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.122+0000 7fd106a00640 1 -- 172.21.15.47:0/2630977140 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd100032440 con 0x7fd1080d1ad0 2024-05-27T10:53:28.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.122+0000 7fd106a00640 1 -- 172.21.15.47:0/2630977140 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd100032810 con 0x7fd1080d1ad0 2024-05-27T10:53:28.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.122+0000 7fd10d600640 1 -- 172.21.15.47:0/2630977140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1080d1ad0 msgr2=0x7fd1080c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:28.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.122+0000 7fd10d600640 1 --2- 172.21.15.47:0/2630977140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1080d1ad0 0x7fd1080c5e90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd100009870 tx=0x7fd10002a270 comp rx=0 tx=0).stop 2024-05-27T10:53:28.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.122+0000 7fd10d600640 1 -- 172.21.15.47:0/2630977140 shutdown_connections 2024-05-27T10:53:28.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.122+0000 7fd10d600640 1 --2- 172.21.15.47:0/2630977140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1080d1ad0 0x7fd1080c5e90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.122+0000 7fd10d600640 1 --2- 172.21.15.47:0/2630977140 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd1080cd0a0 0x7fd108071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.122+0000 7fd10d600640 1 -- 172.21.15.47:0/2630977140 >> 172.21.15.47:0/2630977140 conn(0x7fd10806fc30 msgr2=0x7fd108070040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:28.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.123+0000 7fd10d600640 1 -- 172.21.15.47:0/2630977140 shutdown_connections 2024-05-27T10:53:28.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.123+0000 7fd10d600640 1 -- 172.21.15.47:0/2630977140 wait complete. 2024-05-27T10:53:28.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.124+0000 7fd10d600640 1 Processor -- start 2024-05-27T10:53:28.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.125+0000 7fd10d600640 1 -- start start 2024-05-27T10:53:28.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.126+0000 7fd10d600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1080cd0a0 0x7fd1081f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:28.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.126+0000 7fd10d600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1080d1ad0 0x7fd1080cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:28.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.126+0000 7fd10d600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd10815c4a0 0x7fd1080cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:28.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.126+0000 7fd10d600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd10815c880 con 0x7fd1080cd0a0 2024-05-27T10:53:28.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.126+0000 7fd10d600640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd1080ceac0 con 0x7fd1080d1ad0 2024-05-27T10:53:28.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.126+0000 7fd10d600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd1080d04b0 con 0x7fd10815c4a0 2024-05-27T10:53:28.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.126+0000 7fd107e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1080cd0a0 0x7fd1081f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:28.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.126+0000 7fd107e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1080cd0a0 0x7fd1081f3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55086/0 (socket says 172.21.15.47:55086) 2024-05-27T10:53:28.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.126+0000 7fd107e00640 1 -- 172.21.15.47:0/1149002017 learned_addr learned my addr 172.21.15.47:0/1149002017 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:28.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.126+0000 7fd107400640 1 --2- 172.21.15.47:0/1149002017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1080d1ad0 0x7fd1080cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:28.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.126+0000 7fd107e00640 1 -- 172.21.15.47:0/1149002017 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd10815c4a0 msgr2=0x7fd1080cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:28.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.126+0000 7fd10cc00640 1 --2- 172.21.15.47:0/1149002017 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd10815c4a0 0x7fd1080cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:28.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.126+0000 7fd107e00640 1 --2- 172.21.15.47:0/1149002017 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd10815c4a0 0x7fd1080cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.126+0000 7fd107e00640 1 -- 172.21.15.47:0/1149002017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1080d1ad0 msgr2=0x7fd1080cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:28.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.126+0000 7fd107e00640 1 --2- 172.21.15.47:0/1149002017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1080d1ad0 0x7fd1080cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.126+0000 7fd107e00640 1 -- 172.21.15.47:0/1149002017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1081f3250 con 0x7fd1080cd0a0 2024-05-27T10:53:28.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.126+0000 7fd107400640 1 --2- 172.21.15.47:0/1149002017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1080d1ad0 0x7fd1080cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:28.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.127+0000 7fd107e00640 1 --2- 172.21.15.47:0/1149002017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1080cd0a0 0x7fd1081f3530 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800c730 tx=0x7fd0f800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:28.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.127+0000 7fd0ffe00640 1 -- 172.21.15.47:0/1149002017 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8016020 con 0x7fd1080cd0a0 2024-05-27T10:53:28.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.127+0000 7fd0ffe00640 1 -- 172.21.15.47:0/1149002017 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f8006d50 con 0x7fd1080cd0a0 2024-05-27T10:53:28.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.127+0000 7fd0ffe00640 1 -- 172.21.15.47:0/1149002017 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8003bb0 con 0x7fd1080cd0a0 2024-05-27T10:53:28.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.127+0000 7fd10d600640 1 -- 172.21.15.47:0/1149002017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1081e6dc0 con 0x7fd1080cd0a0 2024-05-27T10:53:28.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.127+0000 7fd10d600640 1 -- 172.21.15.47:0/1149002017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1081e6a90 con 0x7fd1080cd0a0 2024-05-27T10:53:28.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.129+0000 7fd10d600640 1 -- 172.21.15.47:0/1149002017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd10804fce0 con 0x7fd1080cd0a0 2024-05-27T10:53:28.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.130+0000 7fd0ffe00640 1 -- 172.21.15.47:0/1149002017 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd0f800a850 con 0x7fd1080cd0a0 2024-05-27T10:53:28.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.131+0000 7fd0ffe00640 1 --2- 172.21.15.47:0/1149002017 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd0e406c940 0x7fd0e406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:28.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.131+0000 7fd0ffe00640 1 -- 172.21.15.47:0/1149002017 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fd0f808b7b0 con 0x7fd1080cd0a0 2024-05-27T10:53:28.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.131+0000 7fd107400640 1 --2- 172.21.15.47:0/1149002017 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd0e406c940 0x7fd0e406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:28.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.132+0000 7fd107400640 1 --2- 172.21.15.47:0/1149002017 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd0e406c940 0x7fd0e406ee00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd1081f5a00 tx=0x7fd0f0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:28.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.135+0000 7fd0ffe00640 1 -- 172.21.15.47:0/1149002017 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd0f8020020 con 0x7fd1080cd0a0 2024-05-27T10:53:28.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.411+0000 7fd10d600640 1 -- 172.21.15.47:0/1149002017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd1080b3690 con 0x7fd1080cd0a0 2024-05-27T10:53:28.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.417+0000 7fd0ffe00640 1 -- 172.21.15.47:0/1149002017 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7fd0f8019310 con 0x7fd1080cd0a0 2024-05-27T10:53:28.414 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-05-27T10:53:28.414 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCZZVRmP5XbNxAAeV5NQPfMMD+N/fXyt5+LnA== 2024-05-27T10:53:28.414 INFO:teuthology.orchestra.run.smithi047.stdout: caps mds = "allow" 2024-05-27T10:53:28.414 INFO:teuthology.orchestra.run.smithi047.stdout: caps mon = "allow r" 2024-05-27T10:53:28.414 INFO:teuthology.orchestra.run.smithi047.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-27T10:53:28.414 INFO:teuthology.orchestra.run.smithi047.stderr:updated caps for client.0 2024-05-27T10:53:28.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.419+0000 7fd10d600640 1 -- 172.21.15.47:0/1149002017 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd0e406c940 msgr2=0x7fd0e406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:28.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.419+0000 7fd10d600640 1 --2- 172.21.15.47:0/1149002017 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd0e406c940 0x7fd0e406ee00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd1081f5a00 tx=0x7fd0f0008040 comp rx=0 tx=0).stop 2024-05-27T10:53:28.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.419+0000 7fd10d600640 1 -- 172.21.15.47:0/1149002017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1080cd0a0 msgr2=0x7fd1081f3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:28.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.419+0000 7fd10d600640 1 --2- 172.21.15.47:0/1149002017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1080cd0a0 0x7fd1081f3530 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800c730 tx=0x7fd0f800cbf0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.420+0000 7fd10d600640 1 -- 172.21.15.47:0/1149002017 shutdown_connections 2024-05-27T10:53:28.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.420+0000 7fd10d600640 1 --2- 172.21.15.47:0/1149002017 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd0e406c940 0x7fd0e406ee00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.420+0000 7fd10d600640 1 --2- 172.21.15.47:0/1149002017 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd10815c4a0 0x7fd1080cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.420+0000 7fd10d600640 1 --2- 172.21.15.47:0/1149002017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1080d1ad0 0x7fd1080cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.420+0000 7fd10d600640 1 --2- 172.21.15.47:0/1149002017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1080cd0a0 0x7fd1081f3530 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.420+0000 7fd10d600640 1 -- 172.21.15.47:0/1149002017 >> 172.21.15.47:0/1149002017 conn(0x7fd10806fc30 msgr2=0x7fd10815aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:28.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.420+0000 7fd10d600640 1 -- 172.21.15.47:0/1149002017 shutdown_connections 2024-05-27T10:53:28.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.420+0000 7fd10d600640 1 -- 172.21.15.47:0/1149002017 wait complete. 2024-05-27T10:53:28.436 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T10:53:28.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.633+0000 7fb2df200640 1 Processor -- start 2024-05-27T10:53:28.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.633+0000 7fb2df200640 1 -- start start 2024-05-27T10:53:28.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.634+0000 7fb2df200640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb2e015c420 0x7fb2e0071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:28.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.635+0000 7fb2df200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb2e00b4ab0 0x7fb2e00d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:28.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.635+0000 7fb2df200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb2e0073c50 0x7fb2e00d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:28.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.635+0000 7fb2df200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb2e00afc90 con 0x7fb2e00b4ab0 2024-05-27T10:53:28.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.635+0000 7fb2df200640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fb2e015c800 con 0x7fb2e015c420 2024-05-27T10:53:28.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.635+0000 7fb2df200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb2e00ad2e0 con 0x7fb2e0073c50 2024-05-27T10:53:28.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.635+0000 7fb2d7e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb2e00b4ab0 0x7fb2e00d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:28.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.635+0000 7fb2d7e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb2e00b4ab0 0x7fb2e00d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55098/0 (socket says 172.21.15.47:55098) 2024-05-27T10:53:28.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.635+0000 7fb2d7e00640 1 -- 172.21.15.47:0/202906839 learned_addr learned my addr 172.21.15.47:0/202906839 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:28.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.635+0000 7fb2dde00640 1 --2- 172.21.15.47:0/202906839 >> v2:172.21.15.53:3300/0 conn(0x7fb2e015c420 0x7fb2e0071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:28.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.635+0000 7fb2d7e00640 1 -- 172.21.15.47:0/202906839 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb2e0073c50 msgr2=0x7fb2e00d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:28.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.635+0000 7fb2de800640 1 --2- 172.21.15.47:0/202906839 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb2e0073c50 0x7fb2e00d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:28.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.635+0000 7fb2d7e00640 1 --2- 172.21.15.47:0/202906839 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb2e0073c50 0x7fb2e00d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.636+0000 7fb2d7e00640 1 -- 172.21.15.47:0/202906839 >> v2:172.21.15.53:3300/0 conn(0x7fb2e015c420 msgr2=0x7fb2e0071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:28.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.636+0000 7fb2d7e00640 1 --2- 172.21.15.47:0/202906839 >> v2:172.21.15.53:3300/0 conn(0x7fb2e015c420 0x7fb2e0071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.636+0000 7fb2d7e00640 1 -- 172.21.15.47:0/202906839 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e00ad5c0 con 0x7fb2e00b4ab0 2024-05-27T10:53:28.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.636+0000 7fb2dde00640 1 --2- 172.21.15.47:0/202906839 >> v2:172.21.15.53:3300/0 conn(0x7fb2e015c420 0x7fb2e0071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:28.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.637+0000 7fb2d7e00640 1 --2- 172.21.15.47:0/202906839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2e00b4ab0 0x7fb2e00d0360 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00b4600 tx=0x7fb2c802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f28fa36d9e4d74a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:28.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.637+0000 7fb2dd400640 1 -- 172.21.15.47:0/202906839 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8037070 con 0x7fb2e00b4ab0 2024-05-27T10:53:28.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.637+0000 7fb2dd400640 1 -- 172.21.15.47:0/202906839 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2c8032440 con 0x7fb2e00b4ab0 2024-05-27T10:53:28.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.637+0000 7fb2dd400640 1 -- 172.21.15.47:0/202906839 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8032810 con 0x7fb2e00b4ab0 2024-05-27T10:53:28.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.638+0000 7fb2df200640 1 -- 172.21.15.47:0/202906839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2e00b4ab0 msgr2=0x7fb2e00d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:28.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.638+0000 7fb2df200640 1 --2- 172.21.15.47:0/202906839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2e00b4ab0 0x7fb2e00d0360 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00b4600 tx=0x7fb2c802a140 comp rx=0 tx=0).stop 2024-05-27T10:53:28.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.638+0000 7fb2df200640 1 -- 172.21.15.47:0/202906839 shutdown_connections 2024-05-27T10:53:28.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.638+0000 7fb2df200640 1 --2- 172.21.15.47:0/202906839 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb2e0073c50 0x7fb2e00d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.638+0000 7fb2df200640 1 --2- 172.21.15.47:0/202906839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2e00b4ab0 0x7fb2e00d0360 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.638+0000 7fb2df200640 1 --2- 172.21.15.47:0/202906839 >> v2:172.21.15.53:3300/0 conn(0x7fb2e015c420 0x7fb2e0071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.638+0000 7fb2df200640 1 -- 172.21.15.47:0/202906839 >> 172.21.15.47:0/202906839 conn(0x7fb2e006bb20 msgr2=0x7fb2e006bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:28.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.638+0000 7fb2df200640 1 -- 172.21.15.47:0/202906839 shutdown_connections 2024-05-27T10:53:28.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.638+0000 7fb2df200640 1 -- 172.21.15.47:0/202906839 wait complete. 2024-05-27T10:53:28.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.639+0000 7fb2df200640 1 Processor -- start 2024-05-27T10:53:28.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.640+0000 7fb2df200640 1 -- start start 2024-05-27T10:53:28.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.640+0000 7fb2df200640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb2e0073c50 0x7fb2e014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:28.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.640+0000 7fb2df200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2e00b4ab0 0x7fb2e006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:28.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.640+0000 7fb2df200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2e015c420 0x7fb2e01f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:28.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.640+0000 7fb2df200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e00af8f0 con 0x7fb2e015c420 2024-05-27T10:53:28.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.640+0000 7fb2df200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e00ad8a0 con 0x7fb2e00b4ab0 2024-05-27T10:53:28.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.640+0000 7fb2df200640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb2e00afa70 con 0x7fb2e0073c50 2024-05-27T10:53:28.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.641+0000 7fb2de800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2e015c420 0x7fb2e01f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:28.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.641+0000 7fb2de800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2e015c420 0x7fb2e01f4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55112/0 (socket says 172.21.15.47:55112) 2024-05-27T10:53:28.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.641+0000 7fb2de800640 1 -- 172.21.15.47:0/1141015 learned_addr learned my addr 172.21.15.47:0/1141015 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:28.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.641+0000 7fb2dde00640 1 --2- 172.21.15.47:0/1141015 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb2e0073c50 0x7fb2e014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:28.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.641+0000 7fb2d7e00640 1 --2- 172.21.15.47:0/1141015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2e00b4ab0 0x7fb2e006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:28.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.641+0000 7fb2de800640 1 -- 172.21.15.47:0/1141015 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb2e0073c50 msgr2=0x7fb2e014df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:28.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.641+0000 7fb2de800640 1 --2- 172.21.15.47:0/1141015 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb2e0073c50 0x7fb2e014df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.641+0000 7fb2de800640 1 -- 172.21.15.47:0/1141015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2e00b4ab0 msgr2=0x7fb2e006dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:28.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.641+0000 7fb2de800640 1 --2- 172.21.15.47:0/1141015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2e00b4ab0 0x7fb2e006dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.641+0000 7fb2de800640 1 -- 172.21.15.47:0/1141015 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e01f4fd0 con 0x7fb2e015c420 2024-05-27T10:53:28.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.641+0000 7fb2dde00640 1 --2- 172.21.15.47:0/1141015 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb2e0073c50 0x7fb2e014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:28.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.642+0000 7fb2de800640 1 --2- 172.21.15.47:0/1141015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2e015c420 0x7fb2e01f4000 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800cc30 tx=0x7fb2d800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:28.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.642+0000 7fb2d6000640 1 -- 172.21.15.47:0/1141015 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800ce40 con 0x7fb2e015c420 2024-05-27T10:53:28.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.642+0000 7fb2d6000640 1 -- 172.21.15.47:0/1141015 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2d8003990 con 0x7fb2e015c420 2024-05-27T10:53:28.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.642+0000 7fb2d6000640 1 -- 172.21.15.47:0/1141015 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8003d40 con 0x7fb2e015c420 2024-05-27T10:53:28.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.642+0000 7fb2df200640 1 -- 172.21.15.47:0/1141015 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e014e4a0 con 0x7fb2e015c420 2024-05-27T10:53:28.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.642+0000 7fb2df200640 1 -- 172.21.15.47:0/1141015 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e01f4cf0 con 0x7fb2e015c420 2024-05-27T10:53:28.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.643+0000 7fb2df200640 1 -- 172.21.15.47:0/1141015 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2e004fce0 con 0x7fb2e015c420 2024-05-27T10:53:28.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.644+0000 7fb2d6000640 1 -- 172.21.15.47:0/1141015 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb2d8003ee0 con 0x7fb2e015c420 2024-05-27T10:53:28.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.645+0000 7fb2d6000640 1 --2- 172.21.15.47:0/1141015 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb2bc06c920 0x7fb2bc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:28.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.645+0000 7fb2d6000640 1 -- 172.21.15.47:0/1141015 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fb2d808c060 con 0x7fb2e015c420 2024-05-27T10:53:28.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.645+0000 7fb2dde00640 1 --2- 172.21.15.47:0/1141015 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb2bc06c920 0x7fb2bc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:28.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.646+0000 7fb2dde00640 1 --2- 172.21.15.47:0/1141015 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb2bc06c920 0x7fb2bc06ede0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb2d00088b0 tx=0x7fb2d0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:28.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.649+0000 7fb2d6000640 1 -- 172.21.15.47:0/1141015 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb2d8014030 con 0x7fb2e015c420 2024-05-27T10:53:28.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.889+0000 7fb2df200640 1 -- 172.21.15.47:0/1141015 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2e006e140 con 0x7fb2e015c420 2024-05-27T10:53:28.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.890+0000 7fb2d6000640 1 -- 172.21.15.47:0/1141015 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5181 (secure 0 0 0) 0x7fb2d805a3f0 con 0x7fb2e015c420 2024-05-27T10:53:28.887 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-27T10:53:28.887 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1336820258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1336820258},{"type":"v1","addr":"172.21.15.53:6835","nonce":1336820258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4187595814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4187595814},{"type":"v1","addr":"172.21.15.47:6835","nonce":4187595814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1549808451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1549808451},{"type":"v1","addr":"172.21.15.47:6837","nonce":1549808451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T10:53:22.309015+0000","modified":"2024-05-27T10:53:25.359276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5223":{"gid":5223,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6833/2725015532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2725015532},{"type":"v1","addr":"172.21.15.53:6833","nonce":2725015532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5223,"qdb_cluster":[5223]},"id":2}]} 2024-05-27T10:53:28.887 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 17 2024-05-27T10:53:28.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.892+0000 7fb2df200640 1 -- 172.21.15.47:0/1141015 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb2bc06c920 msgr2=0x7fb2bc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:28.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.892+0000 7fb2df200640 1 --2- 172.21.15.47:0/1141015 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb2bc06c920 0x7fb2bc06ede0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb2d00088b0 tx=0x7fb2d0008040 comp rx=0 tx=0).stop 2024-05-27T10:53:28.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.892+0000 7fb2df200640 1 -- 172.21.15.47:0/1141015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2e015c420 msgr2=0x7fb2e01f4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:28.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.892+0000 7fb2df200640 1 --2- 172.21.15.47:0/1141015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2e015c420 0x7fb2e01f4000 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800cc30 tx=0x7fb2d800a5c0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.893+0000 7fb2df200640 1 -- 172.21.15.47:0/1141015 shutdown_connections 2024-05-27T10:53:28.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.893+0000 7fb2df200640 1 --2- 172.21.15.47:0/1141015 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fb2bc06c920 0x7fb2bc06ede0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.893+0000 7fb2df200640 1 --2- 172.21.15.47:0/1141015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2e015c420 0x7fb2e01f4000 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.893+0000 7fb2df200640 1 --2- 172.21.15.47:0/1141015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2e00b4ab0 0x7fb2e006dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.893+0000 7fb2df200640 1 --2- 172.21.15.47:0/1141015 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb2e0073c50 0x7fb2e014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:28.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.893+0000 7fb2df200640 1 -- 172.21.15.47:0/1141015 >> 172.21.15.47:0/1141015 conn(0x7fb2e006bb20 msgr2=0x7fb2e015af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:28.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.893+0000 7fb2df200640 1 -- 172.21.15.47:0/1141015 shutdown_connections 2024-05-27T10:53:28.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:28.893+0000 7fb2df200640 1 -- 172.21.15.47:0/1141015 wait complete. 2024-05-27T10:53:29.311 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-27T10:53:22.309015+0000', 'modified': '2024-05-27T10:53:25.359276+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5223}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5223': {'gid': 5223, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.53:6833/2725015532', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6832', 'nonce': 2725015532}, {'type': 'v1', 'addr': '172.21.15.53:6833', 'nonce': 2725015532}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5223, 'qdb_cluster': [5223]} 2024-05-27T10:53:29.312 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-27T10:53:29.312 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-27T10:53:29.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.536+0000 7f9896400640 1 Processor -- start 2024-05-27T10:53:29.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.537+0000 7f9896400640 1 -- start start 2024-05-27T10:53:29.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.538+0000 7f9896400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f98900d16f0 0x7f989015ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.538+0000 7f9896400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98900d36e0 con 0x7f98900d1310 2024-05-27T10:53:29.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.538+0000 7f9896400640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98900d2640 con 0x7f98900cf4e0 2024-05-27T10:53:29.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.538+0000 7f9896400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f98900d2920 con 0x7f98900d16f0 2024-05-27T10:53:29.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.538+0000 7f988f400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f98900d1310 0x7f989015e370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35932/0 (socket says 172.21.15.47:35932) 2024-05-27T10:53:29.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.538+0000 7f988f400640 1 -- 172.21.15.47:0/3634106091 learned_addr learned my addr 172.21.15.47:0/3634106091 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:29.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.538+0000 7f988fe00640 1 --2- 172.21.15.47:0/3634106091 >> v2:172.21.15.47:3300/0 conn(0x7f98900d16f0 0x7f989015ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.539+0000 7f988e000640 1 -- 172.21.15.47:0/3634106091 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158507135 0 0) 0x7f98900d36e0 con 0x7f98900d1310 2024-05-27T10:53:29.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.539+0000 7f988e000640 1 -- 172.21.15.47:0/3634106091 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9874003520 con 0x7f98900d1310 2024-05-27T10:53:29.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.539+0000 7f988fe00640 1 -- 172.21.15.47:0/3634106091 >> v1:172.21.15.53:6789/0 conn(0x7f98900cf4e0 legacy=0x7f9890166860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:29.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.539+0000 7f988fe00640 1 -- 172.21.15.47:0/3634106091 >> v1:172.21.15.47:6789/0 conn(0x7f98900d1310 legacy=0x7f989015e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:29.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.539+0000 7f988fe00640 1 -- 172.21.15.47:0/3634106091 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98900d2c00 con 0x7f98900d16f0 2024-05-27T10:53:29.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.540+0000 7f988fe00640 1 --2- 172.21.15.47:0/3634106091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98900d16f0 0x7f989015ea80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9888009d90 tx=0x7f988802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d4254b36698336 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:29.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.540+0000 7f988e000640 1 -- 172.21.15.47:0/3634106091 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9888037070 con 0x7f98900d16f0 2024-05-27T10:53:29.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.540+0000 7f988e000640 1 -- 172.21.15.47:0/3634106091 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9888007740 con 0x7f98900d16f0 2024-05-27T10:53:29.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.540+0000 7f988e000640 1 -- 172.21.15.47:0/3634106091 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9888007b10 con 0x7f98900d16f0 2024-05-27T10:53:29.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.541+0000 7f9896400640 1 -- 172.21.15.47:0/3634106091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98900d16f0 msgr2=0x7f989015ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:29.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.541+0000 7f9896400640 1 --2- 172.21.15.47:0/3634106091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98900d16f0 0x7f989015ea80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9888009d90 tx=0x7f988802a780 comp rx=0 tx=0).stop 2024-05-27T10:53:29.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.541+0000 7f9896400640 1 -- 172.21.15.47:0/3634106091 shutdown_connections 2024-05-27T10:53:29.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.541+0000 7f9896400640 1 --2- 172.21.15.47:0/3634106091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98900d16f0 0x7f989015ea80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.541+0000 7f9896400640 1 -- 172.21.15.47:0/3634106091 >> 172.21.15.47:0/3634106091 conn(0x7f989008bfd0 msgr2=0x7f98900d4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:29.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.541+0000 7f9896400640 1 -- 172.21.15.47:0/3634106091 shutdown_connections 2024-05-27T10:53:29.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.541+0000 7f9896400640 1 -- 172.21.15.47:0/3634106091 wait complete. 2024-05-27T10:53:29.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.543+0000 7f9896400640 1 Processor -- start 2024-05-27T10:53:29.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.543+0000 7f9896400640 1 -- start start 2024-05-27T10:53:29.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.544+0000 7f9896400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f98900cf4e0 0x7f989015a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.544+0000 7f9896400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98900d1310 0x7f98900b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.544+0000 7f9896400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98900d16f0 0x7f98900b9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.544+0000 7f9896400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f98900d22f0 con 0x7f98900d16f0 2024-05-27T10:53:29.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.544+0000 7f9896400640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f98900d31c0 con 0x7f98900d1310 2024-05-27T10:53:29.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.544+0000 7f9896400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f98900d0390 con 0x7f98900cf4e0 2024-05-27T10:53:29.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.544+0000 7f988fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98900d16f0 0x7f98900b9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.544+0000 7f988fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98900d16f0 0x7f98900b9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55134/0 (socket says 172.21.15.47:55134) 2024-05-27T10:53:29.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.544+0000 7f988fe00640 1 -- 172.21.15.47:0/931445899 learned_addr learned my addr 172.21.15.47:0/931445899 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:29.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.545+0000 7f988f400640 1 --2- 172.21.15.47:0/931445899 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f98900cf4e0 0x7f989015a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.545+0000 7f988fe00640 1 -- 172.21.15.47:0/931445899 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f98900cf4e0 msgr2=0x7f989015a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:29.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.545+0000 7f988fe00640 1 --2- 172.21.15.47:0/931445899 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f98900cf4e0 0x7f989015a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.545+0000 7f988fe00640 1 -- 172.21.15.47:0/931445899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98900d1310 msgr2=0x7f98900b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:29.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.545+0000 7f988fe00640 1 --2- 172.21.15.47:0/931445899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98900d1310 0x7f98900b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.545+0000 7f988fe00640 1 -- 172.21.15.47:0/931445899 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989015cb00 con 0x7f98900d16f0 2024-05-27T10:53:29.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.545+0000 7f988f400640 1 --2- 172.21.15.47:0/931445899 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f98900cf4e0 0x7f989015a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:29.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.545+0000 7f988fe00640 1 --2- 172.21.15.47:0/931445899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98900d16f0 0x7f98900b9510 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9888009d90 tx=0x7f9888004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:29.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.545+0000 7f9887400640 1 -- 172.21.15.47:0/931445899 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9888042020 con 0x7f98900d16f0 2024-05-27T10:53:29.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.546+0000 7f9887400640 1 -- 172.21.15.47:0/931445899 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98880327f0 con 0x7f98900d16f0 2024-05-27T10:53:29.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.546+0000 7f9887400640 1 -- 172.21.15.47:0/931445899 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9888037040 con 0x7f98900d16f0 2024-05-27T10:53:29.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.546+0000 7f9896400640 1 -- 172.21.15.47:0/931445899 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f989015cde0 con 0x7f98900d16f0 2024-05-27T10:53:29.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.546+0000 7f9896400640 1 -- 172.21.15.47:0/931445899 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98900cbad0 con 0x7f98900d16f0 2024-05-27T10:53:29.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.548+0000 7f9887400640 1 -- 172.21.15.47:0/931445899 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9888045020 con 0x7f98900d16f0 2024-05-27T10:53:29.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.549+0000 7f9887400640 1 --2- 172.21.15.47:0/931445899 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f987006c8f0 0x7f987006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.549+0000 7f9887400640 1 -- 172.21.15.47:0/931445899 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f98880accb0 con 0x7f98900d16f0 2024-05-27T10:53:29.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.549+0000 7f988f400640 1 --2- 172.21.15.47:0/931445899 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f987006c8f0 0x7f987006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.549+0000 7f98991ff740 1 Processor -- start 2024-05-27T10:53:29.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.550+0000 7f98991ff740 1 -- start start 2024-05-27T10:53:29.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.550+0000 7f988f400640 1 --2- 172.21.15.47:0/931445899 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f987006c8f0 0x7f987006edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f98800011e0 tx=0x7f9880009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:29.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.550+0000 7f98991ff740 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c02a2a0 0x555b5c02da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.550+0000 7f98991ff740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b5c02df60 0x555b5c049ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.550+0000 7f98991ff740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c04a3e0 0x555b5c04a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.550+0000 7f98991ff740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555b5bf67b10 con 0x555b5c04a3e0 2024-05-27T10:53:29.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.550+0000 7f98991ff740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555b5bf0e2b0 con 0x555b5c02df60 2024-05-27T10:53:29.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.550+0000 7f98991ff740 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x555b5bf63ad0 con 0x555b5c02a2a0 2024-05-27T10:53:29.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.551+0000 7f988fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c04a3e0 0x555b5c04a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.551+0000 7f988fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c04a3e0 0x555b5c04a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55148/0 (socket says 172.21.15.47:55148) 2024-05-27T10:53:29.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.551+0000 7f988fe00640 1 -- 172.21.15.47:0/4215250622 learned_addr learned my addr 172.21.15.47:0/4215250622 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:29.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.551+0000 7f988f400640 1 --2- 172.21.15.47:0/4215250622 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c02a2a0 0x555b5c02da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.551+0000 7f988fe00640 1 -- 172.21.15.47:0/4215250622 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c02a2a0 msgr2=0x555b5c02da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:29.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.551+0000 7f988fe00640 1 --2- 172.21.15.47:0/4215250622 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c02a2a0 0x555b5c02da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.551+0000 7f988ea00640 1 --2- 172.21.15.47:0/4215250622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b5c02df60 0x555b5c049ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.551+0000 7f988fe00640 1 -- 172.21.15.47:0/4215250622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b5c02df60 msgr2=0x555b5c049ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:29.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.551+0000 7f988fe00640 1 --2- 172.21.15.47:0/4215250622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b5c02df60 0x555b5c049ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.551+0000 7f988fe00640 1 -- 172.21.15.47:0/4215250622 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b5bc7a2d0 con 0x555b5c04a3e0 2024-05-27T10:53:29.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.551+0000 7f988f400640 1 --2- 172.21.15.47:0/4215250622 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c02a2a0 0x555b5c02da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:29.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.551+0000 7f988ea00640 1 --2- 172.21.15.47:0/4215250622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b5c02df60 0x555b5c049ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:29.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.551+0000 7f988fe00640 1 --2- 172.21.15.47:0/4215250622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c04a3e0 0x555b5c04a840 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9888083080 tx=0x7f988807a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1b85fc7f8863c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:29.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.552+0000 7f987be00640 1 -- 172.21.15.47:0/4215250622 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98880835b0 con 0x555b5c04a3e0 2024-05-27T10:53:29.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.552+0000 7f987be00640 1 -- 172.21.15.47:0/4215250622 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9888078cd0 con 0x555b5c04a3e0 2024-05-27T10:53:29.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.552+0000 7f987be00640 1 -- 172.21.15.47:0/4215250622 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98880810c0 con 0x555b5c04a3e0 2024-05-27T10:53:29.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.552+0000 7f98991ff740 1 -- 172.21.15.47:0/4215250622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c04a3e0 msgr2=0x555b5c04a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:29.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.552+0000 7f98991ff740 1 --2- 172.21.15.47:0/4215250622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c04a3e0 0x555b5c04a840 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9888083080 tx=0x7f988807a3f0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.552+0000 7f98991ff740 1 -- 172.21.15.47:0/4215250622 shutdown_connections 2024-05-27T10:53:29.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.552+0000 7f98991ff740 1 --2- 172.21.15.47:0/4215250622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c04a3e0 0x555b5c04a840 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.552+0000 7f98991ff740 1 --2- 172.21.15.47:0/4215250622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b5c02df60 0x555b5c049ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.552+0000 7f98991ff740 1 --2- 172.21.15.47:0/4215250622 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c02a2a0 0x555b5c02da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.552+0000 7f98991ff740 1 -- 172.21.15.47:0/4215250622 >> 172.21.15.47:0/4215250622 conn(0x555b5c000280 msgr2=0x555b5c001280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.553+0000 7f98991ff740 1 -- 172.21.15.47:0/4215250622 shutdown_connections 2024-05-27T10:53:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.553+0000 7f98991ff740 1 -- 172.21.15.47:0/4215250622 wait complete. 2024-05-27T10:53:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.553+0000 7f98991ff740 1 -- start start 2024-05-27T10:53:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.554+0000 7f98991ff740 1 Processor -- start 2024-05-27T10:53:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.555+0000 7f98991ff740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c02df60 0x555b5c01b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.555+0000 7f98991ff740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b5c04a3e0 0x555b5c045330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.555+0000 7f98991ff740 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c045870 0x555b5c0442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.555+0000 7f98991ff740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555b5bffe0b0 con 0x555b5c02df60 2024-05-27T10:53:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.555+0000 7f98991ff740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555b5bf21570 con 0x555b5c04a3e0 2024-05-27T10:53:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.555+0000 7f98991ff740 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x555b5bffe390 con 0x555b5c045870 2024-05-27T10:53:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.555+0000 7f98991ff740 10 client.0 _ll_register_callbacks cb 0x555b5beeffc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T10:53:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.555+0000 7f988f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c02df60 0x555b5c01b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.555+0000 7f988f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c02df60 0x555b5c01b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55154/0 (socket says 172.21.15.47:55154) 2024-05-27T10:53:29.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.555+0000 7f988f400640 1 -- 172.21.15.47:0/2758585059 learned_addr learned my addr 172.21.15.47:0/2758585059 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:29.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.555+0000 7f988fe00640 1 --2- 172.21.15.47:0/2758585059 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c045870 0x555b5c0442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.555+0000 7f988f400640 1 -- 172.21.15.47:0/2758585059 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c045870 msgr2=0x555b5c0442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:29.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.555+0000 7f988f400640 1 --2- 172.21.15.47:0/2758585059 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c045870 0x555b5c0442b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.555+0000 7f988f400640 1 -- 172.21.15.47:0/2758585059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b5c04a3e0 msgr2=0x555b5c045330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:29.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.555+0000 7f988f400640 1 --2- 172.21.15.47:0/2758585059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b5c04a3e0 0x555b5c045330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.555+0000 7f988f400640 1 -- 172.21.15.47:0/2758585059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b5bd446b0 con 0x555b5c02df60 2024-05-27T10:53:29.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.556+0000 7f988f400640 1 --2- 172.21.15.47:0/2758585059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c02df60 0x555b5c01b270 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f98800073b0 tx=0x7f9880000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246c549af69c6e77 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:29.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.556+0000 7f9878c00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-27T10:53:29.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.556+0000 7f9878c00640 1 -- 172.21.15.47:0/2758585059 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9880021630 con 0x555b5c02df60 2024-05-27T10:53:29.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.556+0000 7f9878c00640 1 -- 172.21.15.47:0/2758585059 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f9880020a80 con 0x555b5c02df60 2024-05-27T10:53:29.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.556+0000 7f98991ff740 1 -- 172.21.15.47:0/2758585059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9888078cd0 con 0x555b5c02df60 2024-05-27T10:53:29.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.556+0000 7f9878c00640 1 -- 172.21.15.47:0/2758585059 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f9880020c80 con 0x555b5c02df60 2024-05-27T10:53:29.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.556+0000 7f98991ff740 10 client.5400 fetch_fsmap learned FSMap version 17 2024-05-27T10:53:29.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.556+0000 7f98991ff740 1 -- 172.21.15.47:0/2758585059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x555b5c030ce0 con 0x555b5c02df60 2024-05-27T10:53:29.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.557+0000 7f9878c00640 1 -- 172.21.15.47:0/2758585059 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9888078cd0 con 0x555b5c02df60 2024-05-27T10:53:29.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.557+0000 7f9878c00640 1 -- 172.21.15.47:0/2758585059 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f9880020420 con 0x555b5c02df60 2024-05-27T10:53:29.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.557+0000 7f98991ff740 10 client.5400 fetch_fsmap finished waiting for FSMap version 17 2024-05-27T10:53:29.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.557+0000 7f98991ff740 10 client.5400 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-27T10:53:29.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.557+0000 7f98991ff740 20 client.5400 populate_metadata read hostname 'smithi047' 2024-05-27T10:53:29.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.557+0000 7f98991ff740 1 --2- 172.21.15.47:0/2758585059 >> [v2:172.21.15.53:6832/2725015532,v1:172.21.15.53:6833/2725015532] conn(0x555b5c0277f0 0x555b5c027bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.557+0000 7f98991ff740 4 client.5400 mds_command: new command op to 5223 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T10:53:29.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.557+0000 7f98991ff740 1 -- 172.21.15.47:0/2758585059 --> [v2:172.21.15.53:6832/2725015532,v1:172.21.15.53:6833/2725015532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b5bf75530 con 0x555b5c0277f0 2024-05-27T10:53:29.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.558+0000 7f988ea00640 1 --2- 172.21.15.47:0/2758585059 >> [v2:172.21.15.53:6832/2725015532,v1:172.21.15.53:6833/2725015532] conn(0x555b5c0277f0 0x555b5c027bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.559+0000 7f988ea00640 1 --2- 172.21.15.47:0/2758585059 >> [v2:172.21.15.53:6832/2725015532,v1:172.21.15.53:6833/2725015532] conn(0x555b5c0277f0 0x555b5c027bf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a80d0ccd4170829 server_cookie=69bdef004235cab5 in_seq=0 out_seq=0 2024-05-27T10:53:29.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.559+0000 7f9878c00640 10 client.5400 ms_handle_connect on v2:172.21.15.53:6832/2725015532 2024-05-27T10:53:29.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.561+0000 7f9878c00640 1 -- 172.21.15.47:0/2758585059 <== mds.0 v2:172.21.15.53:6832/2725015532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555b5bf75530 con 0x555b5c0277f0 2024-05-27T10:53:29.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.561+0000 7f9878c00640 10 client.5400 handle_command_reply: tid=0 2024-05-27T10:53:29.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.561+0000 7f98991ff740 1 client.5400 shutdown 2024-05-27T10:53:29.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.561+0000 7f98991ff740 1 -- 172.21.15.47:0/2758585059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c02df60 msgr2=0x555b5c01b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:29.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.561+0000 7f98991ff740 1 --2- 172.21.15.47:0/2758585059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c02df60 0x555b5c01b270 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f98800073b0 tx=0x7f9880000ed0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.562+0000 7f98991ff740 1 -- 172.21.15.47:0/2758585059 shutdown_connections 2024-05-27T10:53:29.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.562+0000 7f98991ff740 1 --2- 172.21.15.47:0/2758585059 >> [v2:172.21.15.53:6832/2725015532,v1:172.21.15.53:6833/2725015532] conn(0x555b5c0277f0 0x555b5c027bf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.562+0000 7f98991ff740 1 --2- 172.21.15.47:0/2758585059 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c045870 0x555b5c0442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.562+0000 7f98991ff740 1 --2- 172.21.15.47:0/2758585059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b5c04a3e0 0x555b5c045330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.562+0000 7f98991ff740 1 --2- 172.21.15.47:0/2758585059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c02df60 0x555b5c01b270 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.562+0000 7f9878c00640 0 client.5400 ms_handle_reset on v2:172.21.15.53:6832/2725015532 2024-05-27T10:53:29.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.562+0000 7f98991ff740 1 -- 172.21.15.47:0/2758585059 >> 172.21.15.47:0/2758585059 conn(0x555b5c02a2a0 msgr2=0x555b5bffcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:29.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.562+0000 7f98991ff740 1 -- 172.21.15.47:0/2758585059 shutdown_connections 2024-05-27T10:53:29.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.562+0000 7f98991ff740 1 -- 172.21.15.47:0/2758585059 wait complete. 2024-05-27T10:53:29.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.562+0000 7f98991ff740 20 client.5400 trim_cache size 0 max 16384 2024-05-27T10:53:29.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.584+0000 7f98991ff740 1 Processor -- start 2024-05-27T10:53:29.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.584+0000 7f98991ff740 1 -- start start 2024-05-27T10:53:29.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.585+0000 7f98991ff740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b5c02df60 0x555b5c025c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.585+0000 7f98991ff740 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c045870 0x555b5c019900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.585+0000 7f98991ff740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c04a3e0 0x555b5c019e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.585+0000 7f98991ff740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f98901ffee0 con 0x555b5c04a3e0 2024-05-27T10:53:29.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.585+0000 7f98991ff740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f98901ff2a0 con 0x555b5c02df60 2024-05-27T10:53:29.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.585+0000 7f98991ff740 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f98901ff890 con 0x555b5c045870 2024-05-27T10:53:29.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.585+0000 7f988fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c04a3e0 0x555b5c019e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.585+0000 7f988fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c04a3e0 0x555b5c019e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55166/0 (socket says 172.21.15.47:55166) 2024-05-27T10:53:29.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.585+0000 7f988fe00640 1 -- 172.21.15.47:0/4287324846 learned_addr learned my addr 172.21.15.47:0/4287324846 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:29.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.585+0000 7f988ea00640 1 --2- 172.21.15.47:0/4287324846 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c045870 0x555b5c019900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.585+0000 7f988fe00640 1 -- 172.21.15.47:0/4287324846 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c045870 msgr2=0x555b5c019900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:29.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.585+0000 7f988f400640 1 --2- 172.21.15.47:0/4287324846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b5c02df60 0x555b5c025c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.585+0000 7f988fe00640 1 --2- 172.21.15.47:0/4287324846 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c045870 0x555b5c019900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.585+0000 7f988fe00640 1 -- 172.21.15.47:0/4287324846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b5c02df60 msgr2=0x555b5c025c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:29.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.585+0000 7f988fe00640 1 --2- 172.21.15.47:0/4287324846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b5c02df60 0x555b5c025c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.586+0000 7f988fe00640 1 -- 172.21.15.47:0/4287324846 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b5bf0d8b0 con 0x555b5c04a3e0 2024-05-27T10:53:29.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.586+0000 7f988fe00640 1 --2- 172.21.15.47:0/4287324846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c04a3e0 0x555b5c019e40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9888083080 tx=0x7f9888081050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76a5872f003f89 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:29.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.586+0000 7f987b400640 1 -- 172.21.15.47:0/4287324846 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98880aa070 con 0x555b5c04a3e0 2024-05-27T10:53:29.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.586+0000 7f987b400640 1 -- 172.21.15.47:0/4287324846 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f988809a020 con 0x555b5c04a3e0 2024-05-27T10:53:29.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.586+0000 7f987b400640 1 -- 172.21.15.47:0/4287324846 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98880835b0 con 0x555b5c04a3e0 2024-05-27T10:53:29.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.587+0000 7f98991ff740 1 -- 172.21.15.47:0/4287324846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c04a3e0 msgr2=0x555b5c019e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:29.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.587+0000 7f98991ff740 1 --2- 172.21.15.47:0/4287324846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c04a3e0 0x555b5c019e40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9888083080 tx=0x7f9888081050 comp rx=0 tx=0).stop 2024-05-27T10:53:29.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.587+0000 7f98991ff740 1 -- 172.21.15.47:0/4287324846 shutdown_connections 2024-05-27T10:53:29.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.587+0000 7f98991ff740 1 --2- 172.21.15.47:0/4287324846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c04a3e0 0x555b5c019e40 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.587+0000 7f98991ff740 1 --2- 172.21.15.47:0/4287324846 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c045870 0x555b5c019900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.587+0000 7f98991ff740 1 --2- 172.21.15.47:0/4287324846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b5c02df60 0x555b5c025c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.587+0000 7f98991ff740 1 -- 172.21.15.47:0/4287324846 >> 172.21.15.47:0/4287324846 conn(0x555b5c02a2a0 msgr2=0x555b5c05b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:29.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.587+0000 7f98991ff740 1 -- 172.21.15.47:0/4287324846 shutdown_connections 2024-05-27T10:53:29.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.587+0000 7f98991ff740 1 -- 172.21.15.47:0/4287324846 wait complete. 2024-05-27T10:53:29.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.588+0000 7f98991ff740 1 -- start start 2024-05-27T10:53:29.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.588+0000 7f98991ff740 1 Processor -- start 2024-05-27T10:53:29.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.589+0000 7f98991ff740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c02df60 0x555b5c0b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.589+0000 7f98991ff740 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c045870 0x555b5c0ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.589+0000 7f98991ff740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b5c04a3e0 0x555b5c048e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.589+0000 7f98991ff740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555b5c0315d0 con 0x555b5c02df60 2024-05-27T10:53:29.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.589+0000 7f98991ff740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555b5c030fc0 con 0x555b5c04a3e0 2024-05-27T10:53:29.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.589+0000 7f98991ff740 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x555b5c029590 con 0x555b5c045870 2024-05-27T10:53:29.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.589+0000 7f98991ff740 10 client.0 _ll_register_callbacks cb 0x7f9880005e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T10:53:29.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.589+0000 7f988f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c02df60 0x555b5c0b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.589+0000 7f988f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c02df60 0x555b5c0b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55184/0 (socket says 172.21.15.47:55184) 2024-05-27T10:53:29.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.589+0000 7f988f400640 1 -- 172.21.15.47:0/3279027274 learned_addr learned my addr 172.21.15.47:0/3279027274 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:29.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.590+0000 7f988ea00640 1 --2- 172.21.15.47:0/3279027274 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c045870 0x555b5c0ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.590+0000 7f988f400640 1 -- 172.21.15.47:0/3279027274 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c045870 msgr2=0x555b5c0ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:29.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.590+0000 7f988f400640 1 --2- 172.21.15.47:0/3279027274 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c045870 0x555b5c0ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.590+0000 7f988f400640 1 -- 172.21.15.47:0/3279027274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b5c04a3e0 msgr2=0x555b5c048e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:29.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.590+0000 7f988f400640 1 --2- 172.21.15.47:0/3279027274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b5c04a3e0 0x555b5c048e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.590+0000 7f988f400640 1 -- 172.21.15.47:0/3279027274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b5c02ce70 con 0x555b5c02df60 2024-05-27T10:53:29.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.590+0000 7f988f400640 1 --2- 172.21.15.47:0/3279027274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c02df60 0x555b5c0b3040 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9880007c90 tx=0x7f9880007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885097b324eeca1c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:29.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.590+0000 7f9878c00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-27T10:53:29.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.590+0000 7f9878c00640 1 -- 172.21.15.47:0/3279027274 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988002f070 con 0x555b5c02df60 2024-05-27T10:53:29.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.590+0000 7f9878c00640 1 -- 172.21.15.47:0/3279027274 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f9880020e20 con 0x555b5c02df60 2024-05-27T10:53:29.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.590+0000 7f98991ff740 1 -- 172.21.15.47:0/3279027274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f988809a020 con 0x555b5c02df60 2024-05-27T10:53:29.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.591+0000 7f9878c00640 1 -- 172.21.15.47:0/3279027274 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f988003e050 con 0x555b5c02df60 2024-05-27T10:53:29.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.591+0000 7f98991ff740 10 client.5406 fetch_fsmap learned FSMap version 17 2024-05-27T10:53:29.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.591+0000 7f98991ff740 1 -- 172.21.15.47:0/3279027274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x555b5c02d150 con 0x555b5c02df60 2024-05-27T10:53:29.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.591+0000 7f9878c00640 1 -- 172.21.15.47:0/3279027274 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f988809a020 con 0x555b5c02df60 2024-05-27T10:53:29.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.591+0000 7f9878c00640 1 -- 172.21.15.47:0/3279027274 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f9880041020 con 0x555b5c02df60 2024-05-27T10:53:29.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.591+0000 7f98991ff740 10 client.5406 fetch_fsmap finished waiting for FSMap version 17 2024-05-27T10:53:29.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.591+0000 7f98991ff740 10 client.5406 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-27T10:53:29.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.591+0000 7f98991ff740 20 client.5406 populate_metadata read hostname 'smithi047' 2024-05-27T10:53:29.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.591+0000 7f98991ff740 1 --2- 172.21.15.47:0/3279027274 >> [v2:172.21.15.53:6832/2725015532,v1:172.21.15.53:6833/2725015532] conn(0x555b5c0423d0 0x555b5c0427b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.591+0000 7f98991ff740 4 client.5406 mds_command: new command op to 5223 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-27T10:53:29.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.591+0000 7f98991ff740 1 -- 172.21.15.47:0/3279027274 --> [v2:172.21.15.53:6832/2725015532,v1:172.21.15.53:6833/2725015532] -- command(tid 0: {"prefix": "status"}) -- 0x555b5bffe700 con 0x555b5c0423d0 2024-05-27T10:53:29.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.592+0000 7f988ea00640 1 --2- 172.21.15.47:0/3279027274 >> [v2:172.21.15.53:6832/2725015532,v1:172.21.15.53:6833/2725015532] conn(0x555b5c0423d0 0x555b5c0427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.593+0000 7f988ea00640 1 --2- 172.21.15.47:0/3279027274 >> [v2:172.21.15.53:6832/2725015532,v1:172.21.15.53:6833/2725015532] conn(0x555b5c0423d0 0x555b5c0427b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54615014301d0094 server_cookie=5944f6b4982f0fd7 in_seq=0 out_seq=0 2024-05-27T10:53:29.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.593+0000 7f9878c00640 10 client.5406 ms_handle_connect on v2:172.21.15.53:6832/2725015532 2024-05-27T10:53:29.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.593+0000 7f9878c00640 1 -- 172.21.15.47:0/3279027274 <== mds.0 v2:172.21.15.53:6832/2725015532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x555b5bffe700 con 0x555b5c0423d0 2024-05-27T10:53:29.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.593+0000 7f9878c00640 10 client.5406 handle_command_reply: tid=0 2024-05-27T10:53:29.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.593+0000 7f98991ff740 1 client.5406 shutdown 2024-05-27T10:53:29.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.594+0000 7f98991ff740 1 -- 172.21.15.47:0/3279027274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c02df60 msgr2=0x555b5c0b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:29.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.594+0000 7f98991ff740 1 --2- 172.21.15.47:0/3279027274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c02df60 0x555b5c0b3040 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9880007c90 tx=0x7f9880007000 comp rx=0 tx=0).stop 2024-05-27T10:53:29.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.594+0000 7f98991ff740 1 -- 172.21.15.47:0/3279027274 shutdown_connections 2024-05-27T10:53:29.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.594+0000 7f98991ff740 1 --2- 172.21.15.47:0/3279027274 >> [v2:172.21.15.53:6832/2725015532,v1:172.21.15.53:6833/2725015532] conn(0x555b5c0423d0 0x555b5c0427b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.594+0000 7f98991ff740 1 --2- 172.21.15.47:0/3279027274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b5c04a3e0 0x555b5c048e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.594+0000 7f98991ff740 1 --2- 172.21.15.47:0/3279027274 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x555b5c045870 0x555b5c0ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.594+0000 7f98991ff740 1 --2- 172.21.15.47:0/3279027274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b5c02df60 0x555b5c0b3040 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.594+0000 7f9878c00640 0 client.5406 ms_handle_reset on v2:172.21.15.53:6832/2725015532 2024-05-27T10:53:29.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.594+0000 7f98991ff740 1 -- 172.21.15.47:0/3279027274 >> 172.21.15.47:0/3279027274 conn(0x555b5c02a2a0 msgr2=0x555b5c046d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:29.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.594+0000 7f98991ff740 1 -- 172.21.15.47:0/3279027274 shutdown_connections 2024-05-27T10:53:29.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.594+0000 7f98991ff740 1 -- 172.21.15.47:0/3279027274 wait complete. 2024-05-27T10:53:29.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.594+0000 7f98991ff740 20 client.5406 trim_cache size 0 max 16384 2024-05-27T10:53:29.593 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-27T10:53:29.593 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "7b0baa11-ae73-495b-918f-c8db2aa0510f", 2024-05-27T10:53:29.593 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-05-27T10:53:29.593 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 5223, 2024-05-27T10:53:29.593 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-27T10:53:29.593 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-27T10:53:29.593 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-27T10:53:29.594 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 6.7726421290000003, 2024-05-27T10:53:29.594 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 17, 2024-05-27T10:53:29.594 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 33, 2024-05-27T10:53:29.594 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 33, 2024-05-27T10:53:29.594 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 15.575813849999999 2024-05-27T10:53:29.594 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-27T10:53:29.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.595+0000 7f9896400640 1 -- 172.21.15.47:0/931445899 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f987006c8f0 msgr2=0x7f987006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:29.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.595+0000 7f9896400640 1 --2- 172.21.15.47:0/931445899 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f987006c8f0 0x7f987006edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f98800011e0 tx=0x7f9880009040 comp rx=0 tx=0).stop 2024-05-27T10:53:29.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.595+0000 7f9896400640 1 -- 172.21.15.47:0/931445899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98900d16f0 msgr2=0x7f98900b9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:29.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.595+0000 7f9896400640 1 --2- 172.21.15.47:0/931445899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98900d16f0 0x7f98900b9510 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9888009d90 tx=0x7f9888004a40 comp rx=0 tx=0).stop 2024-05-27T10:53:29.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.595+0000 7f9896400640 1 -- 172.21.15.47:0/931445899 shutdown_connections 2024-05-27T10:53:29.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.595+0000 7f9896400640 1 --2- 172.21.15.47:0/931445899 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f987006c8f0 0x7f987006edb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.595+0000 7f9896400640 1 --2- 172.21.15.47:0/931445899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98900d16f0 0x7f98900b9510 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.595+0000 7f9896400640 1 --2- 172.21.15.47:0/931445899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98900d1310 0x7f98900b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.595+0000 7f9896400640 1 --2- 172.21.15.47:0/931445899 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f98900cf4e0 0x7f989015a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.595+0000 7f9896400640 1 -- 172.21.15.47:0/931445899 >> 172.21.15.47:0/931445899 conn(0x7f989008bfd0 msgr2=0x7f98900ca240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:29.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.595+0000 7f9896400640 1 -- 172.21.15.47:0/931445899 shutdown_connections 2024-05-27T10:53:29.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.595+0000 7f9896400640 1 -- 172.21.15.47:0/931445899 wait complete. 2024-05-27T10:53:29.609 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T10:53:29.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.799+0000 7f8800c00640 1 Processor -- start 2024-05-27T10:53:29.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.799+0000 7f8800c00640 1 -- start start 2024-05-27T10:53:29.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.800+0000 7f8800c00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f87fc15b380 0x7f87fc0d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.800+0000 7f8800c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f87fc0d08a0 0x7f87fc06e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.800+0000 7f8800c00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87fc06f3a0 con 0x7f87fc06ebd0 2024-05-27T10:53:29.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.800+0000 7f8800c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f87fc0d0d10 con 0x7f87fc0d08a0 2024-05-27T10:53:29.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.800+0000 7f8800c00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f87fc0adcc0 con 0x7f87fc15b380 2024-05-27T10:53:29.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.801+0000 7f87faa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f87fc0d08a0 0x7f87fc06e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.801+0000 7f87faa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f87fc0d08a0 0x7f87fc06e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55200/0 (socket says 172.21.15.47:55200) 2024-05-27T10:53:29.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.801+0000 7f87faa00640 1 -- 172.21.15.47:0/90581828 learned_addr learned my addr 172.21.15.47:0/90581828 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:29.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.801+0000 7f87fb400640 1 --2- 172.21.15.47:0/90581828 >> v2:172.21.15.53:3300/0 conn(0x7f87fc15b380 0x7f87fc0d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.801+0000 7f87faa00640 1 -- 172.21.15.47:0/90581828 >> v2:172.21.15.53:3300/0 conn(0x7f87fc15b380 msgr2=0x7f87fc0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:29.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.801+0000 7f87faa00640 1 --2- 172.21.15.47:0/90581828 >> v2:172.21.15.53:3300/0 conn(0x7f87fc15b380 0x7f87fc0d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.801+0000 7f87faa00640 1 -- 172.21.15.47:0/90581828 >> v1:172.21.15.53:6789/0 conn(0x7f87fc06ebd0 legacy=0x7f87fc0b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:29.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.801+0000 7f87faa00640 1 -- 172.21.15.47:0/90581828 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87fc06f680 con 0x7f87fc0d08a0 2024-05-27T10:53:29.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.802+0000 7f87faa00640 1 --2- 172.21.15.47:0/90581828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87fc0d08a0 0x7f87fc06e690 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f87fc06afa0 tx=0x7f87e402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab08872f4da6dd36 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:29.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.803+0000 7f87fa000640 1 -- 172.21.15.47:0/90581828 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4037070 con 0x7f87fc0d08a0 2024-05-27T10:53:29.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.803+0000 7f87fa000640 1 -- 172.21.15.47:0/90581828 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e4032440 con 0x7f87fc0d08a0 2024-05-27T10:53:29.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.803+0000 7f87fa000640 1 -- 172.21.15.47:0/90581828 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4032810 con 0x7f87fc0d08a0 2024-05-27T10:53:29.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.803+0000 7f8800c00640 1 -- 172.21.15.47:0/90581828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87fc0d08a0 msgr2=0x7f87fc06e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:29.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.803+0000 7f8800c00640 1 --2- 172.21.15.47:0/90581828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87fc0d08a0 0x7f87fc06e690 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f87fc06afa0 tx=0x7f87e402a1a0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.803+0000 7f8800c00640 1 -- 172.21.15.47:0/90581828 shutdown_connections 2024-05-27T10:53:29.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.803+0000 7f8800c00640 1 --2- 172.21.15.47:0/90581828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87fc0d08a0 0x7f87fc06e690 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.803+0000 7f8800c00640 1 --2- 172.21.15.47:0/90581828 >> v2:172.21.15.53:3300/0 conn(0x7f87fc15b380 0x7f87fc0d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.803+0000 7f8800c00640 1 -- 172.21.15.47:0/90581828 >> 172.21.15.47:0/90581828 conn(0x7f87fc06bb20 msgr2=0x7f87fc06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:29.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.803+0000 7f8800c00640 1 -- 172.21.15.47:0/90581828 shutdown_connections 2024-05-27T10:53:29.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.803+0000 7f8800c00640 1 -- 172.21.15.47:0/90581828 wait complete. 2024-05-27T10:53:29.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.805+0000 7f8800c00640 1 Processor -- start 2024-05-27T10:53:29.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.805+0000 7f8800c00640 1 -- start start 2024-05-27T10:53:29.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.806+0000 7f8800c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f87fc06ebd0 0x7f87fc152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.806+0000 7f8800c00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87fc0d08a0 0x7f87fc149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.806+0000 7f8800c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87fc15b380 0x7f87fc1f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.806+0000 7f8800c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f87fc06fc40 con 0x7f87fc15b380 2024-05-27T10:53:29.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.806+0000 7f8800c00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f87fc06ff20 con 0x7f87fc0d08a0 2024-05-27T10:53:29.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.806+0000 7f8800c00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f87fc06efe0 con 0x7f87fc06ebd0 2024-05-27T10:53:29.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.806+0000 7f87fbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87fc15b380 0x7f87fc1f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.806+0000 7f87fbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87fc15b380 0x7f87fc1f23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55210/0 (socket says 172.21.15.47:55210) 2024-05-27T10:53:29.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.806+0000 7f87fbe00640 1 -- 172.21.15.47:0/1615939732 learned_addr learned my addr 172.21.15.47:0/1615939732 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:29.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.807+0000 7f87fb400640 1 --2- 172.21.15.47:0/1615939732 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f87fc06ebd0 0x7f87fc152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.807+0000 7f87faa00640 1 --2- 172.21.15.47:0/1615939732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87fc0d08a0 0x7f87fc149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.807+0000 7f87fbe00640 1 -- 172.21.15.47:0/1615939732 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f87fc06ebd0 msgr2=0x7f87fc152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:29.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.807+0000 7f87fbe00640 1 --2- 172.21.15.47:0/1615939732 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f87fc06ebd0 0x7f87fc152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.807+0000 7f87fbe00640 1 -- 172.21.15.47:0/1615939732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87fc0d08a0 msgr2=0x7f87fc149160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:29.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.807+0000 7f87fbe00640 1 --2- 172.21.15.47:0/1615939732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87fc0d08a0 0x7f87fc149160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:29.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.807+0000 7f87fbe00640 1 -- 172.21.15.47:0/1615939732 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87fc09a360 con 0x7f87fc15b380 2024-05-27T10:53:29.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.807+0000 7f87fbe00640 1 --2- 172.21.15.47:0/1615939732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87fc15b380 0x7f87fc1f23d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f87f400c410 tx=0x7f87f400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:29.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.807+0000 7f87f3400640 1 -- 172.21.15.47:0/1615939732 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4011790 con 0x7f87fc15b380 2024-05-27T10:53:29.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.807+0000 7f87f3400640 1 -- 172.21.15.47:0/1615939732 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f4017070 con 0x7f87fc15b380 2024-05-27T10:53:29.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.807+0000 7f87f3400640 1 -- 172.21.15.47:0/1615939732 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4011bb0 con 0x7f87fc15b380 2024-05-27T10:53:29.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.807+0000 7f8800c00640 1 -- 172.21.15.47:0/1615939732 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87fc09c3e0 con 0x7f87fc15b380 2024-05-27T10:53:29.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.808+0000 7f8800c00640 1 -- 172.21.15.47:0/1615939732 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87fc1f2910 con 0x7f87fc15b380 2024-05-27T10:53:29.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.809+0000 7f8800c00640 1 -- 172.21.15.47:0/1615939732 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87fc159980 con 0x7f87fc15b380 2024-05-27T10:53:29.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.810+0000 7f87f3400640 1 -- 172.21.15.47:0/1615939732 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f87f401c460 con 0x7f87fc15b380 2024-05-27T10:53:29.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.811+0000 7f87f3400640 1 --2- 172.21.15.47:0/1615939732 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f87d806c8f0 0x7f87d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:29.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.811+0000 7f87f3400640 1 -- 172.21.15.47:0/1615939732 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f87f408b730 con 0x7f87fc15b380 2024-05-27T10:53:29.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.811+0000 7f87fb400640 1 --2- 172.21.15.47:0/1615939732 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f87d806c8f0 0x7f87d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:29.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.812+0000 7f87fb400640 1 --2- 172.21.15.47:0/1615939732 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f87d806c8f0 0x7f87d806edb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0070b0 tx=0x7f87ec007040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:29.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:29.815+0000 7f87f3400640 1 -- 172.21.15.47:0/1615939732 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f87fc159980 con 0x7f87fc15b380 2024-05-27T10:53:30.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:30.071+0000 7f8800c00640 1 -- 172.21.15.47:0/1615939732 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f87fc04fce0 con 0x7f87fc15b380 2024-05-27T10:53:30.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:30.072+0000 7f87f3400640 1 -- 172.21.15.47:0/1615939732 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f87f4021020 con 0x7f87fc15b380 2024-05-27T10:53:30.069 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-27T10:53:30.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:30.075+0000 7f8800c00640 1 -- 172.21.15.47:0/1615939732 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f87d806c8f0 msgr2=0x7f87d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:30.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:30.075+0000 7f8800c00640 1 --2- 172.21.15.47:0/1615939732 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f87d806c8f0 0x7f87d806edb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0070b0 tx=0x7f87ec007040 comp rx=0 tx=0).stop 2024-05-27T10:53:30.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:30.075+0000 7f8800c00640 1 -- 172.21.15.47:0/1615939732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87fc15b380 msgr2=0x7f87fc1f23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:30.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:30.075+0000 7f8800c00640 1 --2- 172.21.15.47:0/1615939732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87fc15b380 0x7f87fc1f23d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f87f400c410 tx=0x7f87f400c8d0 comp rx=0 tx=0).stop 2024-05-27T10:53:30.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:30.075+0000 7f8800c00640 1 -- 172.21.15.47:0/1615939732 shutdown_connections 2024-05-27T10:53:30.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:30.075+0000 7f8800c00640 1 --2- 172.21.15.47:0/1615939732 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f87d806c8f0 0x7f87d806edb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:30.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:30.075+0000 7f8800c00640 1 --2- 172.21.15.47:0/1615939732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87fc15b380 0x7f87fc1f23d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:30.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:30.075+0000 7f8800c00640 1 --2- 172.21.15.47:0/1615939732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87fc0d08a0 0x7f87fc149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:30.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:30.075+0000 7f8800c00640 1 --2- 172.21.15.47:0/1615939732 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f87fc06ebd0 0x7f87fc152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:30.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:30.075+0000 7f8800c00640 1 -- 172.21.15.47:0/1615939732 >> 172.21.15.47:0/1615939732 conn(0x7f87fc06bb20 msgr2=0x7f87fc0afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:30.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:30.075+0000 7f8800c00640 1 -- 172.21.15.47:0/1615939732 shutdown_connections 2024-05-27T10:53:30.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:30.075+0000 7f8800c00640 1 -- 172.21.15.47:0/1615939732 wait complete. 2024-05-27T10:53:30.092 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-27T10:53:30.092 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T10:53:30.092 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-05-27T10:53:30.092 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-27T10:53:30.092 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-27T10:53:30.092 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-27T10:53:30.092 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T10:53:30.092 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T10:53:30.093 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-27T10:53:30.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:53:30.093 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-05-27T10:53:30.148 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T10:53:30.148 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T10:53:30.149 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T10:53:30.149 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:53:30.149 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-05-27T10:53:30.149 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:53:30.149 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T10:53:30.149 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-05-27T10:53:30.149 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-05-27T10:53:30.149 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T10:53:30.149 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-05-27T10:53:30.149 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-05-27T10:53:30.149 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T10:53:30.150 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-05-27T10:53:30.150 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-05-27T10:53:30.150 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-27T10:53:30.150 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42488sec preferred_lft 42488sec 2024-05-27T10:53:30.150 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link noprefixroute 2024-05-27T10:53:30.150 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:53:30.150 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T10:53:30.150 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-05-27T10:53:30.150 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-05-27T10:53:30.150 INFO:teuthology.orchestra.run.smithi047.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T10:53:30.150 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether e6:bc:c5:54:0a:f5 brd ff:ff:ff:ff:ff:ff 2024-05-27T10:53:30.150 INFO:teuthology.orchestra.run.smithi047.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-27T10:53:30.150 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:53:30.151 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::fcdc:f9ff:fef0:43e8/64 scope link 2024-05-27T10:53:30.151 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:53:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T10:53:30.151 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether f6:38:c6:67:c8:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T10:53:30.151 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::f438:c6ff:fe67:c823/64 scope link 2024-05-27T10:53:30.151 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:53:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T10:53:30.151 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether e6:bc:c5:54:0a:f5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T10:53:30.151 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::e4bc:c5ff:fe54:af5/64 scope link 2024-05-27T10:53:30.151 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-27T10:53:30.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:53:30.152 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T10:53:30.236 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-05-27T10:53:30.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:53:30.240 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-05-27T10:53:30.294 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-05-27T10:53:30.294 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T10:53:30.294 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-27T10:53:30.294 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-27T10:53:30.294 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T10:53:30.295 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T10:53:30.295 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-27T10:53:30.296 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-27T10:53:30.296 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-27T10:53:30.296 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-27T10:53:30.296 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-27T10:53:30.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T10:53:30.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:53:30.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:53:30.526 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-27T10:53:30.578 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-27T10:53:30.579 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-27T10:53:30.580 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-27T10:53:30.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:53:30.580 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-05-27T10:53:30.669 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-27T10:53:30.669 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T10:53:30.670 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-27T10:53:30.728 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-27T10:53:30.729 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T10:53:30.729 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-27T10:53:30.784 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-05-27T10:53:30.878 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T10:53:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-05-27T10:53:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-05-27T10:53:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-05-27T10:53:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-05-27T10:53:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-05-27T10:53:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-05-27T10:53:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-05-27T10:53:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-05-27T10:53:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-05-27T10:53:30.933 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-05-27T10:53:30.933 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-05-27T10:53:30.933 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-05-27T10:53:30.933 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T10:53:30.933 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-05-27T10:53:30.933 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-05-27T10:53:30.933 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-05-27T10:53:30.933 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-05-27T10:53:30.933 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-05-27T10:53:30.933 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-05-27T10:53:30.933 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-05-27T10:53:30.933 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-27T10:53:30.933 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-27T10:53:30.934 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-05-27T10:53:30.934 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-05-27T10:53:30.934 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-05-27T10:53:30.934 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T10:53:30.934 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T10:53:30.934 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T10:53:30.934 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T10:53:30.934 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-05-27T10:53:30.934 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T10:53:30.934 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T10:53:30.934 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T10:53:30.934 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T10:53:30.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:53:30.935 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-05-27T10:53:30.987 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-27T10:53:30.988 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-27T10:53:30.992 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-05-27T10:53:31.061 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T10:53:31.108 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-05-27T10:53:31.109 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-05-27T10:53:31.109 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-05-27T10:53:31.109 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-05-27T10:53:31.109 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-05-27T10:53:31.109 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-05-27T10:53:31.109 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-05-27T10:53:31.109 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-05-27T10:53:31.109 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-05-27T10:53:31.109 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-05-27T10:53:31.109 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-05-27T10:53:31.109 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-05-27T10:53:31.109 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T10:53:31.110 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-05-27T10:53:31.110 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-05-27T10:53:31.110 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-05-27T10:53:31.110 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-05-27T10:53:31.110 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-05-27T10:53:31.110 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-05-27T10:53:31.110 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-05-27T10:53:31.110 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-27T10:53:31.110 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-27T10:53:31.110 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-05-27T10:53:31.110 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-05-27T10:53:31.110 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-05-27T10:53:31.110 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T10:53:31.111 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T10:53:31.111 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T10:53:31.111 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T10:53:31.111 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-05-27T10:53:31.111 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T10:53:31.111 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T10:53:31.111 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T10:53:31.111 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T10:53:31.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:53:31.112 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-05-27T10:53:31.182 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:2024-05-27T10:53:31.183+0000 7fda93341480 -1 init, newargv = 0x55b8395eebc0 newargc=15 2024-05-27T10:53:31.182 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[49671]: starting ceph client 2024-05-27T10:53:31.190 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[49671]: starting fuse 2024-05-27T10:53:31.449 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T10:53:31.457 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T10:53:32.263 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-05-27T10:53:32.360 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T10:53:32.421 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-05-27T10:53:32.421 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-05-27T10:53:32.421 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-05-27T10:53:32.421 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-05-27T10:53:32.421 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-05-27T10:53:32.421 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-05-27T10:53:32.421 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-05-27T10:53:32.421 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-05-27T10:53:32.422 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-05-27T10:53:32.422 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-05-27T10:53:32.422 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-05-27T10:53:32.422 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-05-27T10:53:32.422 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T10:53:32.422 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-05-27T10:53:32.422 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-05-27T10:53:32.422 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-05-27T10:53:32.422 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-05-27T10:53:32.422 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-05-27T10:53:32.422 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-05-27T10:53:32.422 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-05-27T10:53:32.422 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-27T10:53:32.423 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-27T10:53:32.423 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-05-27T10:53:32.423 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-05-27T10:53:32.423 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-05-27T10:53:32.423 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T10:53:32.423 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T10:53:32.423 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T10:53:32.423 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T10:53:32.423 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-05-27T10:53:32.423 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T10:53:32.423 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T10:53:32.423 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T10:53:32.423 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T10:53:32.423 INFO:teuthology.orchestra.run.smithi047.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-27T10:53:32.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:53:32.425 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-05-27T10:53:32.480 INFO:teuthology.orchestra.run.smithi047.stdout:42 2024-05-27T10:53:32.481 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-05-27T10:53:32.481 DEBUG:teuthology.orchestra.run.smithi047:> sudo stdin-killer -- python3 -c ' 2024-05-27T10:53:32.481 DEBUG:teuthology.orchestra.run.smithi047:> import glob 2024-05-27T10:53:32.481 DEBUG:teuthology.orchestra.run.smithi047:> import re 2024-05-27T10:53:32.481 DEBUG:teuthology.orchestra.run.smithi047:> import os 2024-05-27T10:53:32.481 DEBUG:teuthology.orchestra.run.smithi047:> import subprocess 2024-05-27T10:53:32.481 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-27T10:53:32.481 DEBUG:teuthology.orchestra.run.smithi047:> def _find_admin_socket(client_name): 2024-05-27T10:53:32.481 DEBUG:teuthology.orchestra.run.smithi047:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-27T10:53:32.481 DEBUG:teuthology.orchestra.run.smithi047:> files = glob.glob(asok_path) 2024-05-27T10:53:32.481 DEBUG:teuthology.orchestra.run.smithi047:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-27T10:53:32.481 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-27T10:53:32.482 DEBUG:teuthology.orchestra.run.smithi047:> # Given a non-glob path, it better be there 2024-05-27T10:53:32.482 DEBUG:teuthology.orchestra.run.smithi047:> if "*" not in asok_path: 2024-05-27T10:53:32.482 DEBUG:teuthology.orchestra.run.smithi047:> assert(len(files) == 1) 2024-05-27T10:53:32.482 DEBUG:teuthology.orchestra.run.smithi047:> return files[0] 2024-05-27T10:53:32.482 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-27T10:53:32.482 DEBUG:teuthology.orchestra.run.smithi047:> for f in files: 2024-05-27T10:53:32.482 DEBUG:teuthology.orchestra.run.smithi047:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-27T10:53:32.482 DEBUG:teuthology.orchestra.run.smithi047:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-27T10:53:32.482 DEBUG:teuthology.orchestra.run.smithi047:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-27T10:53:32.482 DEBUG:teuthology.orchestra.run.smithi047:> contents = proc_f.read() 2024-05-27T10:53:32.482 DEBUG:teuthology.orchestra.run.smithi047:> if mountpoint in contents: 2024-05-27T10:53:32.482 DEBUG:teuthology.orchestra.run.smithi047:> return f 2024-05-27T10:53:32.482 DEBUG:teuthology.orchestra.run.smithi047:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-27T10:53:32.482 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-27T10:53:32.482 DEBUG:teuthology.orchestra.run.smithi047:> print(_find_admin_socket("client.0")) 2024-05-27T10:53:32.483 DEBUG:teuthology.orchestra.run.smithi047:> ' 2024-05-27T10:53:32.657 INFO:teuthology.orchestra.run.smithi047.stdout:/var/run/ceph/ceph-client.0.49671.asok 2024-05-27T10:53:32.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T10:53:32.677 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49671.asok 2024-05-27T10:53:32.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:53:32.677 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49671.asok status 2024-05-27T10:53:32.913 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-27T10:53:32.913 INFO:teuthology.orchestra.run.smithi047.stdout: "metadata": { 2024-05-27T10:53:32.913 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_sha1": "81797d879079e1a392b37a9c23a946594f658c50", 2024-05-27T10:53:32.913 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 19.0.0-3154-g81797d87 (81797d879079e1a392b37a9c23a946594f658c50) squid (dev)", 2024-05-27T10:53:32.913 INFO:teuthology.orchestra.run.smithi047.stdout: "entity_id": "0", 2024-05-27T10:53:32.913 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": "smithi047", 2024-05-27T10:53:32.913 INFO:teuthology.orchestra.run.smithi047.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-27T10:53:32.914 INFO:teuthology.orchestra.run.smithi047.stdout: "pid": "49671", 2024-05-27T10:53:32.914 INFO:teuthology.orchestra.run.smithi047.stdout: "root": "/" 2024-05-27T10:53:32.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:32.914 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_count": 0, 2024-05-27T10:53:32.914 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_pinned_count": 0, 2024-05-27T10:53:32.914 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 5421, 2024-05-27T10:53:32.914 INFO:teuthology.orchestra.run.smithi047.stdout: "inst": { 2024-05-27T10:53:32.914 INFO:teuthology.orchestra.run.smithi047.stdout: "name": { 2024-05-27T10:53:32.914 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "client", 2024-05-27T10:53:32.914 INFO:teuthology.orchestra.run.smithi047.stdout: "num": 5421 2024-05-27T10:53:32.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:32.914 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-05-27T10:53:32.914 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-05-27T10:53:32.915 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.1:0", 2024-05-27T10:53:32.915 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 2725739653 2024-05-27T10:53:32.915 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:32.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:32.915 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-05-27T10:53:32.915 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-05-27T10:53:32.915 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.1:0", 2024-05-27T10:53:32.915 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 2725739653 2024-05-27T10:53:32.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-27T10:53:32.915 INFO:teuthology.orchestra.run.smithi047.stdout: "inst_str": "client.5421 192.168.0.1:0/2725739653", 2024-05-27T10:53:32.915 INFO:teuthology.orchestra.run.smithi047.stdout: "addr_str": "192.168.0.1:0/2725739653", 2024-05-27T10:53:32.915 INFO:teuthology.orchestra.run.smithi047.stdout: "inode_count": 1, 2024-05-27T10:53:32.915 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_epoch": 17, 2024-05-27T10:53:32.915 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch": 33, 2024-05-27T10:53:32.916 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch_barrier": 0, 2024-05-27T10:53:32.916 INFO:teuthology.orchestra.run.smithi047.stdout: "blocklisted": false, 2024-05-27T10:53:32.916 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs" 2024-05-27T10:53:32.916 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-27T10:53:32.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:53:32.929 DEBUG:teuthology.orchestra.run.smithi047:> stat --file-system '--printf=%T 2024-05-27T10:53:32.930 DEBUG:teuthology.orchestra.run.smithi047:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-27T10:53:32.989 INFO:teuthology.orchestra.run.smithi047.stdout:fuseblk 2024-05-27T10:53:32.989 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-27T10:53:32.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:53:32.990 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-27T10:53:33.079 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-27T10:53:33.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.304+0000 7fd07d400640 1 Processor -- start 2024-05-27T10:53:33.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.304+0000 7fd07d400640 1 -- start start 2024-05-27T10:53:33.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.305+0000 7fd07d400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd078162160 0x7fd0780d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:33.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.305+0000 7fd07d400640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd0780d2c80 0x7fd0780d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:33.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.305+0000 7fd07d400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd0781626d0 0x7fd078162b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:33.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.305+0000 7fd07d400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd0780cf3e0 con 0x7fd078162160 2024-05-27T10:53:33.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.305+0000 7fd07d400640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fd0780cf6c0 con 0x7fd0780d2c80 2024-05-27T10:53:33.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.305+0000 7fd07d400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd0780cf9a0 con 0x7fd0781626d0 2024-05-27T10:53:33.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.306+0000 7fd076800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd078162160 0x7fd0780d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:33.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.306+0000 7fd076800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd078162160 0x7fd0780d01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53832/0 (socket says 172.21.15.47:53832) 2024-05-27T10:53:33.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.306+0000 7fd076800640 1 -- 172.21.15.47:0/1470460839 learned_addr learned my addr 172.21.15.47:0/1470460839 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:33.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.306+0000 7fd077200640 1 --2- 172.21.15.47:0/1470460839 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd0781626d0 0x7fd078162b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:33.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.306+0000 7fd076800640 1 -- 172.21.15.47:0/1470460839 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd0781626d0 msgr2=0x7fd078162b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:33.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.306+0000 7fd076800640 1 --2- 172.21.15.47:0/1470460839 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd0781626d0 0x7fd078162b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:33.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.306+0000 7fd075e00640 1 --2- 172.21.15.47:0/1470460839 >> v2:172.21.15.53:3300/0 conn(0x7fd0780d2c80 0x7fd0780d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:33.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.306+0000 7fd076800640 1 -- 172.21.15.47:0/1470460839 >> v2:172.21.15.53:3300/0 conn(0x7fd0780d2c80 msgr2=0x7fd0780d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:33.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.306+0000 7fd076800640 1 --2- 172.21.15.47:0/1470460839 >> v2:172.21.15.53:3300/0 conn(0x7fd0780d2c80 0x7fd0780d3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:33.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.306+0000 7fd076800640 1 -- 172.21.15.47:0/1470460839 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0780cfc80 con 0x7fd078162160 2024-05-27T10:53:33.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.307+0000 7fd077200640 1 --2- 172.21.15.47:0/1470460839 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd0781626d0 0x7fd078162b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:33.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.308+0000 7fd076800640 1 --2- 172.21.15.47:0/1470460839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd078162160 0x7fd0780d01a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd068009870 tx=0x7fd06802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b5af881d5b05bd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:33.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.308+0000 7fd075400640 1 -- 172.21.15.47:0/1470460839 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd068037070 con 0x7fd078162160 2024-05-27T10:53:33.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.308+0000 7fd075400640 1 -- 172.21.15.47:0/1470460839 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd068032440 con 0x7fd078162160 2024-05-27T10:53:33.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.308+0000 7fd075400640 1 -- 172.21.15.47:0/1470460839 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd068032810 con 0x7fd078162160 2024-05-27T10:53:33.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.308+0000 7fd07d400640 1 -- 172.21.15.47:0/1470460839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd078162160 msgr2=0x7fd0780d01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:33.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.308+0000 7fd07d400640 1 --2- 172.21.15.47:0/1470460839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd078162160 0x7fd0780d01a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd068009870 tx=0x7fd06802a200 comp rx=0 tx=0).stop 2024-05-27T10:53:33.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.309+0000 7fd07d400640 1 -- 172.21.15.47:0/1470460839 shutdown_connections 2024-05-27T10:53:33.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.309+0000 7fd07d400640 1 --2- 172.21.15.47:0/1470460839 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd0781626d0 0x7fd078162b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:33.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.309+0000 7fd07d400640 1 --2- 172.21.15.47:0/1470460839 >> v2:172.21.15.53:3300/0 conn(0x7fd0780d2c80 0x7fd0780d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:33.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.309+0000 7fd07d400640 1 --2- 172.21.15.47:0/1470460839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd078162160 0x7fd0780d01a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:33.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.309+0000 7fd07d400640 1 -- 172.21.15.47:0/1470460839 >> 172.21.15.47:0/1470460839 conn(0x7fd07808bfd0 msgr2=0x7fd0780d46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:33.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.309+0000 7fd07d400640 1 -- 172.21.15.47:0/1470460839 shutdown_connections 2024-05-27T10:53:33.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.309+0000 7fd07d400640 1 -- 172.21.15.47:0/1470460839 wait complete. 2024-05-27T10:53:33.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.310+0000 7fd07d400640 1 Processor -- start 2024-05-27T10:53:33.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.311+0000 7fd07d400640 1 -- start start 2024-05-27T10:53:33.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.311+0000 7fd07d400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd0780d2c80 0x7fd07815e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:33.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.312+0000 7fd07d400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd078162160 0x7fd0781519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:33.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.312+0000 7fd07d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0781626d0 0x7fd078160720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:33.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.312+0000 7fd07d400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd078163220 con 0x7fd0781626d0 2024-05-27T10:53:33.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.312+0000 7fd07d400640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781630a0 con 0x7fd078162160 2024-05-27T10:53:33.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.312+0000 7fd07d400640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd07806cb90 con 0x7fd0780d2c80 2024-05-27T10:53:33.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.312+0000 7fd077200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0781626d0 0x7fd078160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:33.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.312+0000 7fd077200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0781626d0 0x7fd078160720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53846/0 (socket says 172.21.15.47:53846) 2024-05-27T10:53:33.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.312+0000 7fd077200640 1 -- 172.21.15.47:0/2127805085 learned_addr learned my addr 172.21.15.47:0/2127805085 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:33.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.312+0000 7fd076800640 1 --2- 172.21.15.47:0/2127805085 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd0780d2c80 0x7fd07815e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:33.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.312+0000 7fd075e00640 1 --2- 172.21.15.47:0/2127805085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd078162160 0x7fd0781519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:33.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.313+0000 7fd077200640 1 -- 172.21.15.47:0/2127805085 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd0780d2c80 msgr2=0x7fd07815e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:33.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.313+0000 7fd077200640 1 --2- 172.21.15.47:0/2127805085 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd0780d2c80 0x7fd07815e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:33.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.313+0000 7fd077200640 1 -- 172.21.15.47:0/2127805085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd078162160 msgr2=0x7fd0781519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:33.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.313+0000 7fd077200640 1 --2- 172.21.15.47:0/2127805085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd078162160 0x7fd0781519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:33.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.313+0000 7fd077200640 1 -- 172.21.15.47:0/2127805085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07815ea10 con 0x7fd0781626d0 2024-05-27T10:53:33.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.313+0000 7fd077200640 1 --2- 172.21.15.47:0/2127805085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0781626d0 0x7fd078160720 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd07000cd50 tx=0x7fd07000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:33.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.313+0000 7fd06ea00640 1 -- 172.21.15.47:0/2127805085 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07000f680 con 0x7fd0781626d0 2024-05-27T10:53:33.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.313+0000 7fd06ea00640 1 -- 172.21.15.47:0/2127805085 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd07000f840 con 0x7fd0781626d0 2024-05-27T10:53:33.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.313+0000 7fd06ea00640 1 -- 172.21.15.47:0/2127805085 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07000fc30 con 0x7fd0781626d0 2024-05-27T10:53:33.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.313+0000 7fd07d400640 1 -- 172.21.15.47:0/2127805085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd07815ecf0 con 0x7fd0781626d0 2024-05-27T10:53:33.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.313+0000 7fd07d400640 1 -- 172.21.15.47:0/2127805085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd07815f2b0 con 0x7fd0781626d0 2024-05-27T10:53:33.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.315+0000 7fd07d400640 1 -- 172.21.15.47:0/2127805085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0780689e0 con 0x7fd0781626d0 2024-05-27T10:53:33.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.316+0000 7fd06ea00640 1 -- 172.21.15.47:0/2127805085 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd0700213f0 con 0x7fd0781626d0 2024-05-27T10:53:33.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.317+0000 7fd06ea00640 1 --2- 172.21.15.47:0/2127805085 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd05806c8f0 0x7fd05806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:33.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.317+0000 7fd06ea00640 1 -- 172.21.15.47:0/2127805085 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fd07008c8a0 con 0x7fd0781626d0 2024-05-27T10:53:33.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.317+0000 7fd076800640 1 --2- 172.21.15.47:0/2127805085 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd05806c8f0 0x7fd05806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:33.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.318+0000 7fd076800640 1 --2- 172.21.15.47:0/2127805085 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd05806c8f0 0x7fd05806edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd068034000 tx=0x7fd06802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:33.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.322+0000 7fd06ea00640 1 -- 172.21.15.47:0/2127805085 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd070014030 con 0x7fd0781626d0 2024-05-27T10:53:33.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:33.574+0000 7fd07d400640 1 -- 172.21.15.47:0/2127805085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fd0780d2a60 con 0x7fd0781626d0 2024-05-27T10:53:34.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.133+0000 7fd06ea00640 1 -- 172.21.15.47:0/2127805085 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) ==== 136+0+0 (secure 0 0 0) 0x7fd07005acd0 con 0x7fd0781626d0 2024-05-27T10:53:34.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.137+0000 7fd07d400640 1 -- 172.21.15.47:0/2127805085 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd05806c8f0 msgr2=0x7fd05806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:34.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.137+0000 7fd07d400640 1 --2- 172.21.15.47:0/2127805085 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd05806c8f0 0x7fd05806edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd068034000 tx=0x7fd06802e000 comp rx=0 tx=0).stop 2024-05-27T10:53:34.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.137+0000 7fd07d400640 1 -- 172.21.15.47:0/2127805085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0781626d0 msgr2=0x7fd078160720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:34.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.137+0000 7fd07d400640 1 --2- 172.21.15.47:0/2127805085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0781626d0 0x7fd078160720 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd07000cd50 tx=0x7fd07000a650 comp rx=0 tx=0).stop 2024-05-27T10:53:34.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.137+0000 7fd07d400640 1 -- 172.21.15.47:0/2127805085 shutdown_connections 2024-05-27T10:53:34.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.137+0000 7fd07d400640 1 --2- 172.21.15.47:0/2127805085 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fd05806c8f0 0x7fd05806edb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:34.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.137+0000 7fd07d400640 1 --2- 172.21.15.47:0/2127805085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0781626d0 0x7fd078160720 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:34.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.137+0000 7fd07d400640 1 --2- 172.21.15.47:0/2127805085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd078162160 0x7fd0781519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:34.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.137+0000 7fd07d400640 1 --2- 172.21.15.47:0/2127805085 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd0780d2c80 0x7fd07815e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:34.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.138+0000 7fd07d400640 1 -- 172.21.15.47:0/2127805085 >> 172.21.15.47:0/2127805085 conn(0x7fd07808bfd0 msgr2=0x7fd0780b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:34.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.138+0000 7fd07d400640 1 -- 172.21.15.47:0/2127805085 shutdown_connections 2024-05-27T10:53:34.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.138+0000 7fd07d400640 1 -- 172.21.15.47:0/2127805085 wait complete. 2024-05-27T10:53:34.160 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-27T10:53:34.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.372+0000 7fe080e00640 1 Processor -- start 2024-05-27T10:53:34.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.372+0000 7fe080e00640 1 -- start start 2024-05-27T10:53:34.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.374+0000 7fe080e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe07c072330 0x7fe07c06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:34.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.374+0000 7fe080e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe07c06fe40 con 0x7fe07c15f2a0 2024-05-27T10:53:34.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.374+0000 7fe080e00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe07c15f830 con 0x7fe07c0d0360 2024-05-27T10:53:34.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.374+0000 7fe080e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe07c072710 con 0x7fe07c072330 2024-05-27T10:53:34.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.374+0000 7fe07be00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe07c15f2a0 0x7fe07c0b31d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49990/0 (socket says 172.21.15.47:49990) 2024-05-27T10:53:34.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.374+0000 7fe07be00640 1 -- 172.21.15.47:0/482492692 learned_addr learned my addr 172.21.15.47:0/482492692 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-27T10:53:34.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.374+0000 7fe07b400640 1 --2- 172.21.15.47:0/482492692 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe07c072330 0x7fe07c06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:34.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.375+0000 7fe07a000640 1 -- 172.21.15.47:0/482492692 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2810953065 0 0) 0x7fe074001490 con 0x7fe07c15f2a0 2024-05-27T10:53:34.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.375+0000 7fe07a000640 1 -- 172.21.15.47:0/482492692 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe060003520 con 0x7fe07c15f2a0 2024-05-27T10:53:34.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.375+0000 7fe07a000640 1 -- 172.21.15.47:0/482492692 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 121637518 0 0) 0x7fe07c15f830 con 0x7fe07c0d0360 2024-05-27T10:53:34.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.375+0000 7fe07a000640 1 -- 172.21.15.47:0/482492692 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe074001490 con 0x7fe07c0d0360 2024-05-27T10:53:34.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.375+0000 7fe07a000640 1 -- 172.21.15.47:0/482492692 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1200119472 0 0) 0x7fe060003520 con 0x7fe07c15f2a0 2024-05-27T10:53:34.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.375+0000 7fe07a000640 1 -- 172.21.15.47:0/482492692 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe07c072330 msgr2=0x7fe07c06eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:34.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.375+0000 7fe07a000640 1 --2- 172.21.15.47:0/482492692 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe07c072330 0x7fe07c06eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:34.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.375+0000 7fe07a000640 1 -- 172.21.15.47:0/482492692 >> v1:172.21.15.53:6789/0 conn(0x7fe07c0d0360 legacy=0x7fe07c15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:34.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.375+0000 7fe07a000640 1 -- 172.21.15.47:0/482492692 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe07c06dfd0 con 0x7fe07c15f2a0 2024-05-27T10:53:34.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.375+0000 7fe07a000640 1 -- 172.21.15.47:0/482492692 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 952261392 0 0) 0x7fe074001bc0 con 0x7fe07c15f2a0 2024-05-27T10:53:34.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.375+0000 7fe07a000640 1 -- 172.21.15.47:0/482492692 >> v1:172.21.15.47:6789/0 conn(0x7fe07c15f2a0 legacy=0x7fe07c0b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:34.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.375+0000 7fe07a000640 1 --2- 172.21.15.47:0/482492692 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe07c072330 0x7fe060003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:34.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.376+0000 7fe07a000640 1 --2- 172.21.15.47:0/482492692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0600040d0 0x7fe060004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:34.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.376+0000 7fe07a000640 1 --2- 172.21.15.47:0/482492692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe060004d40 0x7fe0600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:34.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.376+0000 7fe07a000640 1 -- 172.21.15.47:0/482492692 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c072710 con 0x7fe0600040d0 2024-05-27T10:53:34.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.376+0000 7fe07a000640 1 -- 172.21.15.47:0/482492692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe06000bbd0 con 0x7fe060004d40 2024-05-27T10:53:34.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.376+0000 7fe07a000640 1 -- 172.21.15.47:0/482492692 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe06000bdd0 con 0x7fe07c072330 2024-05-27T10:53:34.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.376+0000 7fe07aa00640 1 --2- 172.21.15.47:0/482492692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0600040d0 0x7fe060004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:34.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.376+0000 7fe07be00640 1 --2- 172.21.15.47:0/482492692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe060004d40 0x7fe0600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:34.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.376+0000 7fe07b400640 1 --2- 172.21.15.47:0/482492692 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe07c072330 0x7fe060003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:34.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.376+0000 7fe07aa00640 1 -- 172.21.15.47:0/482492692 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe07c072330 msgr2=0x7fe060003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:34.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.376+0000 7fe07aa00640 1 --2- 172.21.15.47:0/482492692 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe07c072330 0x7fe060003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:34.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.376+0000 7fe07aa00640 1 -- 172.21.15.47:0/482492692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe060004d40 msgr2=0x7fe0600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:34.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.376+0000 7fe07aa00640 1 --2- 172.21.15.47:0/482492692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe060004d40 0x7fe0600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:34.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.376+0000 7fe07aa00640 1 -- 172.21.15.47:0/482492692 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe060003520 con 0x7fe0600040d0 2024-05-27T10:53:34.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.376+0000 7fe07b400640 1 --2- 172.21.15.47:0/482492692 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe07c072330 0x7fe060003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:34.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.378+0000 7fe07aa00640 1 --2- 172.21.15.47:0/482492692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0600040d0 0x7fe060004800 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe0680018d0 tx=0x7fe060005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b85f24bffde53a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:34.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.378+0000 7fe07a000640 1 -- 172.21.15.47:0/482492692 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0680014f0 con 0x7fe0600040d0 2024-05-27T10:53:34.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.378+0000 7fe07a000640 1 -- 172.21.15.47:0/482492692 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0680052d0 con 0x7fe0600040d0 2024-05-27T10:53:34.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.378+0000 7fe07a000640 1 -- 172.21.15.47:0/482492692 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06802aca0 con 0x7fe0600040d0 2024-05-27T10:53:34.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.378+0000 7fe080e00640 1 -- 172.21.15.47:0/482492692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0600040d0 msgr2=0x7fe060004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:34.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.378+0000 7fe080e00640 1 --2- 172.21.15.47:0/482492692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0600040d0 0x7fe060004800 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe0680018d0 tx=0x7fe060005830 comp rx=0 tx=0).stop 2024-05-27T10:53:34.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.378+0000 7fe07be00640 1 -- 172.21.15.47:0/482492692 reap_dead start 2024-05-27T10:53:34.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.378+0000 7fe080e00640 1 -- 172.21.15.47:0/482492692 shutdown_connections 2024-05-27T10:53:34.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.378+0000 7fe080e00640 1 -- 172.21.15.47:0/482492692 >> 172.21.15.47:0/482492692 conn(0x7fe07c06bb20 msgr2=0x7fe07c06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:34.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.379+0000 7fe080e00640 1 -- 172.21.15.47:0/482492692 shutdown_connections 2024-05-27T10:53:34.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.379+0000 7fe080e00640 1 -- 172.21.15.47:0/482492692 wait complete. 2024-05-27T10:53:34.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.380+0000 7fe080e00640 1 Processor -- start 2024-05-27T10:53:34.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.381+0000 7fe080e00640 1 -- start start 2024-05-27T10:53:34.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.381+0000 7fe080e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe07c09ddf0 0x7fe07c1e90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:34.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.381+0000 7fe080e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe07c09a780 0x7fe07c09c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:34.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.382+0000 7fe080e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe07c09c670 0x7fe07c09caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:34.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.382+0000 7fe080e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c06e620 con 0x7fe07c09a780 2024-05-27T10:53:34.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.382+0000 7fe080e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c15fb10 con 0x7fe07c09ddf0 2024-05-27T10:53:34.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.382+0000 7fe080e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe07c06eab0 con 0x7fe07c09c670 2024-05-27T10:53:34.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.382+0000 7fe07aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe07c09a780 0x7fe07c09c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:34.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.382+0000 7fe07aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe07c09a780 0x7fe07c09c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53866/0 (socket says 172.21.15.47:53866) 2024-05-27T10:53:34.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.382+0000 7fe07aa00640 1 -- 172.21.15.47:0/3139142212 learned_addr learned my addr 172.21.15.47:0/3139142212 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:34.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.382+0000 7fe07b400640 1 --2- 172.21.15.47:0/3139142212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe07c09ddf0 0x7fe07c1e90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:34.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.382+0000 7fe07be00640 1 --2- 172.21.15.47:0/3139142212 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe07c09c670 0x7fe07c09caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:34.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.382+0000 7fe07aa00640 1 -- 172.21.15.47:0/3139142212 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe07c09c670 msgr2=0x7fe07c09caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:34.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.382+0000 7fe07aa00640 1 --2- 172.21.15.47:0/3139142212 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe07c09c670 0x7fe07c09caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:34.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.382+0000 7fe07aa00640 1 -- 172.21.15.47:0/3139142212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe07c09ddf0 msgr2=0x7fe07c1e90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:34.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.382+0000 7fe07aa00640 1 --2- 172.21.15.47:0/3139142212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe07c09ddf0 0x7fe07c1e90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:34.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.382+0000 7fe07aa00640 1 -- 172.21.15.47:0/3139142212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe07c1e99d0 con 0x7fe07c09a780 2024-05-27T10:53:34.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.383+0000 7fe07aa00640 1 --2- 172.21.15.47:0/3139142212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe07c09a780 0x7fe07c09c130 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe06802a6b0 tx=0x7fe0680012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:34.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.383+0000 7fe073400640 1 -- 172.21.15.47:0/3139142212 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06803f030 con 0x7fe07c09a780 2024-05-27T10:53:34.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.383+0000 7fe073400640 1 -- 172.21.15.47:0/3139142212 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe068005480 con 0x7fe07c09a780 2024-05-27T10:53:34.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.383+0000 7fe073400640 1 -- 172.21.15.47:0/3139142212 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0680014f0 con 0x7fe07c09a780 2024-05-27T10:53:34.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.383+0000 7fe080e00640 1 -- 172.21.15.47:0/3139142212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe07c1e9cb0 con 0x7fe07c09a780 2024-05-27T10:53:34.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.383+0000 7fe080e00640 1 -- 172.21.15.47:0/3139142212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe07c1ea270 con 0x7fe07c09a780 2024-05-27T10:53:34.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.384+0000 7fe080e00640 1 -- 172.21.15.47:0/3139142212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe07c09bf30 con 0x7fe07c09a780 2024-05-27T10:53:34.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.385+0000 7fe073400640 1 -- 172.21.15.47:0/3139142212 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe068042070 con 0x7fe07c09a780 2024-05-27T10:53:34.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.386+0000 7fe073400640 1 --2- 172.21.15.47:0/3139142212 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe05c06c8f0 0x7fe05c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:34.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.386+0000 7fe073400640 1 -- 172.21.15.47:0/3139142212 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe0680ab570 con 0x7fe07c09a780 2024-05-27T10:53:34.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.387+0000 7fe07b400640 1 --2- 172.21.15.47:0/3139142212 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe05c06c8f0 0x7fe05c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:34.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.387+0000 7fe07b400640 1 --2- 172.21.15.47:0/3139142212 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe05c06c8f0 0x7fe05c06edb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0099c0 tx=0x7fe06c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:34.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.391+0000 7fe073400640 1 -- 172.21.15.47:0/3139142212 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe07c09bf30 con 0x7fe07c09a780 2024-05-27T10:53:34.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.623+0000 7fe080e00640 1 -- 172.21.15.47:0/3139142212 --> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fe07c04fce0 con 0x7fe05c06c8f0 2024-05-27T10:53:34.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.627+0000 7fe073400640 1 -- 172.21.15.47:0/3139142212 <== mgr.4108 v2:172.21.15.47:6832/3679485934 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fe07c04fce0 con 0x7fe05c06c8f0 2024-05-27T10:53:34.624 INFO:teuthology.orchestra.run.smithi047.stdout:[ 2024-05-27T10:53:34.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-27T10:53:34.624 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephfs" 2024-05-27T10:53:34.624 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-27T10:53:34.624 INFO:teuthology.orchestra.run.smithi047.stdout:] 2024-05-27T10:53:34.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.630+0000 7fe080e00640 1 -- 172.21.15.47:0/3139142212 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe05c06c8f0 msgr2=0x7fe05c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:34.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.630+0000 7fe080e00640 1 --2- 172.21.15.47:0/3139142212 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe05c06c8f0 0x7fe05c06edb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0099c0 tx=0x7fe06c008040 comp rx=0 tx=0).stop 2024-05-27T10:53:34.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.630+0000 7fe080e00640 1 -- 172.21.15.47:0/3139142212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe07c09a780 msgr2=0x7fe07c09c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:34.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.630+0000 7fe080e00640 1 --2- 172.21.15.47:0/3139142212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe07c09a780 0x7fe07c09c130 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe06802a6b0 tx=0x7fe0680012d0 comp rx=0 tx=0).stop 2024-05-27T10:53:34.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.630+0000 7fe080e00640 1 -- 172.21.15.47:0/3139142212 shutdown_connections 2024-05-27T10:53:34.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.630+0000 7fe080e00640 1 --2- 172.21.15.47:0/3139142212 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fe05c06c8f0 0x7fe05c06edb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:34.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.630+0000 7fe080e00640 1 --2- 172.21.15.47:0/3139142212 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe07c09c670 0x7fe07c09caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:34.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.630+0000 7fe080e00640 1 --2- 172.21.15.47:0/3139142212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe07c09a780 0x7fe07c09c130 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:34.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.630+0000 7fe080e00640 1 --2- 172.21.15.47:0/3139142212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe07c09ddf0 0x7fe07c1e90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:34.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.630+0000 7fe080e00640 1 -- 172.21.15.47:0/3139142212 >> 172.21.15.47:0/3139142212 conn(0x7fe07c06bb20 msgr2=0x7fe07c157360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:34.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.630+0000 7fe080e00640 1 -- 172.21.15.47:0/3139142212 shutdown_connections 2024-05-27T10:53:34.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.630+0000 7fe080e00640 1 -- 172.21.15.47:0/3139142212 wait complete. 2024-05-27T10:53:34.647 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-27T10:53:34.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.870+0000 7f5de3e00640 1 Processor -- start 2024-05-27T10:53:34.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.870+0000 7f5de3e00640 1 -- start start 2024-05-27T10:53:34.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.871+0000 7f5de3e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5de415c510 0x7f5de40b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:34.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.871+0000 7f5de3e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5de406da80 0x7f5de40d0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:34.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.871+0000 7f5de3e00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5de40b4620 con 0x7f5de40d0860 2024-05-27T10:53:34.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.871+0000 7f5de3e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f5de40d0cb0 con 0x7f5de406da80 2024-05-27T10:53:34.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.871+0000 7f5de3e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5de40b4900 con 0x7f5de415c510 2024-05-27T10:53:34.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.872+0000 7f5dda000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5de406da80 0x7f5de40d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:34.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.872+0000 7f5dda000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5de406da80 0x7f5de40d0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53882/0 (socket says 172.21.15.47:53882) 2024-05-27T10:53:34.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.872+0000 7f5dda000640 1 -- 172.21.15.47:0/4189514732 learned_addr learned my addr 172.21.15.47:0/4189514732 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:34.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.872+0000 7f5de2a00640 1 --2- 172.21.15.47:0/4189514732 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5de415c510 0x7f5de40b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:34.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.872+0000 7f5dda000640 1 -- 172.21.15.47:0/4189514732 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5de415c510 msgr2=0x7f5de40b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:34.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.872+0000 7f5dda000640 1 --2- 172.21.15.47:0/4189514732 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5de415c510 0x7f5de40b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:34.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.872+0000 7f5dda000640 1 -- 172.21.15.47:0/4189514732 >> v1:172.21.15.53:6789/0 conn(0x7f5de40d0860 legacy=0x7f5de41600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:34.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.872+0000 7f5dda000640 1 -- 172.21.15.47:0/4189514732 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de40b4be0 con 0x7f5de406da80 2024-05-27T10:53:34.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.873+0000 7f5dda000640 1 --2- 172.21.15.47:0/4189514732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de406da80 0x7f5de40d0320 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc009870 tx=0x7f5dcc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab95c54f3d647d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:34.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.874+0000 7f5de2000640 1 -- 172.21.15.47:0/4189514732 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc037070 con 0x7f5de406da80 2024-05-27T10:53:34.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.874+0000 7f5de2000640 1 -- 172.21.15.47:0/4189514732 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dcc032440 con 0x7f5de406da80 2024-05-27T10:53:34.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.874+0000 7f5de2000640 1 -- 172.21.15.47:0/4189514732 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc032810 con 0x7f5de406da80 2024-05-27T10:53:34.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.874+0000 7f5de3e00640 1 -- 172.21.15.47:0/4189514732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de406da80 msgr2=0x7f5de40d0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:34.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.874+0000 7f5de3e00640 1 --2- 172.21.15.47:0/4189514732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de406da80 0x7f5de40d0320 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc009870 tx=0x7f5dcc02a210 comp rx=0 tx=0).stop 2024-05-27T10:53:34.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.874+0000 7f5de3e00640 1 -- 172.21.15.47:0/4189514732 shutdown_connections 2024-05-27T10:53:34.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.874+0000 7f5de3e00640 1 --2- 172.21.15.47:0/4189514732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de406da80 0x7f5de40d0320 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:34.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.874+0000 7f5de3e00640 1 --2- 172.21.15.47:0/4189514732 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5de415c510 0x7f5de40b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:34.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.874+0000 7f5de3e00640 1 -- 172.21.15.47:0/4189514732 >> 172.21.15.47:0/4189514732 conn(0x7f5de406bb20 msgr2=0x7f5de406bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:34.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.875+0000 7f5de3e00640 1 -- 172.21.15.47:0/4189514732 shutdown_connections 2024-05-27T10:53:34.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.875+0000 7f5de3e00640 1 -- 172.21.15.47:0/4189514732 wait complete. 2024-05-27T10:53:34.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.876+0000 7f5de3e00640 1 Processor -- start 2024-05-27T10:53:34.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.877+0000 7f5de3e00640 1 -- start start 2024-05-27T10:53:34.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.877+0000 7f5de3e00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5de406da80 0x7f5de40ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:34.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.877+0000 7f5de3e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5de40d0860 0x7f5de415f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:34.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.878+0000 7f5de3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de415c510 0x7f5de415d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:34.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.878+0000 7f5de3e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5de40b4210 con 0x7f5de415c510 2024-05-27T10:53:34.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.878+0000 7f5de3e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5de415c8f0 con 0x7f5de40d0860 2024-05-27T10:53:34.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.878+0000 7f5de3e00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5de40b4390 con 0x7f5de406da80 2024-05-27T10:53:34.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.878+0000 7f5de3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de415c510 0x7f5de415d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:34.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.878+0000 7f5de3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de415c510 0x7f5de415d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53890/0 (socket says 172.21.15.47:53890) 2024-05-27T10:53:34.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.878+0000 7f5de3400640 1 -- 172.21.15.47:0/1865853420 learned_addr learned my addr 172.21.15.47:0/1865853420 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:34.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.878+0000 7f5de2a00640 1 --2- 172.21.15.47:0/1865853420 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5de406da80 0x7f5de40ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:34.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.878+0000 7f5dda000640 1 --2- 172.21.15.47:0/1865853420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5de40d0860 0x7f5de415f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:34.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.878+0000 7f5de3400640 1 -- 172.21.15.47:0/1865853420 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5de406da80 msgr2=0x7f5de40ad2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:34.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.878+0000 7f5de3400640 1 --2- 172.21.15.47:0/1865853420 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5de406da80 0x7f5de40ad2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:34.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.878+0000 7f5de3400640 1 -- 172.21.15.47:0/1865853420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5de40d0860 msgr2=0x7f5de415f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:34.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.878+0000 7f5de3400640 1 --2- 172.21.15.47:0/1865853420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5de40d0860 0x7f5de415f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:34.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.878+0000 7f5de3400640 1 -- 172.21.15.47:0/1865853420 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de415e310 con 0x7f5de415c510 2024-05-27T10:53:34.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.878+0000 7f5dda000640 1 --2- 172.21.15.47:0/1865853420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5de40d0860 0x7f5de415f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:34.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.879+0000 7f5de3400640 1 --2- 172.21.15.47:0/1865853420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de415c510 0x7f5de415d890 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00c440 tx=0x7f5ddc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:34.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.879+0000 7f5ddb400640 1 -- 172.21.15.47:0/1865853420 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc011790 con 0x7f5de415c510 2024-05-27T10:53:34.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.879+0000 7f5ddb400640 1 -- 172.21.15.47:0/1865853420 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ddc017070 con 0x7f5de415c510 2024-05-27T10:53:34.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.879+0000 7f5ddb400640 1 -- 172.21.15.47:0/1865853420 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc011b70 con 0x7f5de415c510 2024-05-27T10:53:34.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.879+0000 7f5de3e00640 1 -- 172.21.15.47:0/1865853420 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de415e5f0 con 0x7f5de415c510 2024-05-27T10:53:34.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.879+0000 7f5de3e00640 1 -- 172.21.15.47:0/1865853420 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de415ee90 con 0x7f5de415c510 2024-05-27T10:53:34.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.880+0000 7f5de3e00640 1 -- 172.21.15.47:0/1865853420 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de415e7c0 con 0x7f5de415c510 2024-05-27T10:53:34.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.881+0000 7f5ddb400640 1 -- 172.21.15.47:0/1865853420 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5ddc011d10 con 0x7f5de415c510 2024-05-27T10:53:34.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.882+0000 7f5ddb400640 1 --2- 172.21.15.47:0/1865853420 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5dc006c8f0 0x7f5dc006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:34.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.882+0000 7f5ddb400640 1 -- 172.21.15.47:0/1865853420 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f5ddc08b9a0 con 0x7f5de415c510 2024-05-27T10:53:34.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.883+0000 7f5de2a00640 1 --2- 172.21.15.47:0/1865853420 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5dc006c8f0 0x7f5dc006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:34.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.883+0000 7f5de2a00640 1 --2- 172.21.15.47:0/1865853420 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5dc006c8f0 0x7f5dc006edb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40099c0 tx=0x7f5dd4003990 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:34.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:34.887+0000 7f5ddb400640 1 -- 172.21.15.47:0/1865853420 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5ddc059d30 con 0x7f5de415c510 2024-05-27T10:53:35.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.091+0000 7f5de3e00640 1 -- 172.21.15.47:0/1865853420 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5de404fce0 con 0x7f5de415c510 2024-05-27T10:53:35.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.092+0000 7f5ddb400640 1 -- 172.21.15.47:0/1865853420 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f5ddc059630 con 0x7f5de415c510 2024-05-27T10:53:35.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.095+0000 7f5de3e00640 1 -- 172.21.15.47:0/1865853420 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5dc006c8f0 msgr2=0x7f5dc006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:35.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.095+0000 7f5de3e00640 1 --2- 172.21.15.47:0/1865853420 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5dc006c8f0 0x7f5dc006edb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40099c0 tx=0x7f5dd4003990 comp rx=0 tx=0).stop 2024-05-27T10:53:35.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.095+0000 7f5de3e00640 1 -- 172.21.15.47:0/1865853420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de415c510 msgr2=0x7f5de415d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:35.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.095+0000 7f5de3e00640 1 --2- 172.21.15.47:0/1865853420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de415c510 0x7f5de415d890 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00c440 tx=0x7f5ddc00c900 comp rx=0 tx=0).stop 2024-05-27T10:53:35.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.095+0000 7f5de3e00640 1 -- 172.21.15.47:0/1865853420 shutdown_connections 2024-05-27T10:53:35.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.095+0000 7f5de3e00640 1 --2- 172.21.15.47:0/1865853420 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f5dc006c8f0 0x7f5dc006edb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:35.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.095+0000 7f5de3e00640 1 --2- 172.21.15.47:0/1865853420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de415c510 0x7f5de415d890 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:35.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.095+0000 7f5de3e00640 1 --2- 172.21.15.47:0/1865853420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5de40d0860 0x7f5de415f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:35.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.095+0000 7f5de3e00640 1 --2- 172.21.15.47:0/1865853420 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5de406da80 0x7f5de40ad2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:35.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.095+0000 7f5de3e00640 1 -- 172.21.15.47:0/1865853420 >> 172.21.15.47:0/1865853420 conn(0x7f5de406bb20 msgr2=0x7f5de406bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:35.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.095+0000 7f5de3e00640 1 -- 172.21.15.47:0/1865853420 shutdown_connections 2024-05-27T10:53:35.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.095+0000 7f5de3e00640 1 -- 172.21.15.47:0/1865853420 wait complete. 2024-05-27T10:53:35.111 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-27T10:53:35.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.334+0000 7f54dde00640 1 Processor -- start 2024-05-27T10:53:35.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.335+0000 7f54dde00640 1 -- start start 2024-05-27T10:53:35.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.336+0000 7f54dde00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f54d815e990 0x7f54d80d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:35.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.336+0000 7f54dde00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54d80d1210 0x7f54d80d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:35.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.336+0000 7f54dde00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54d80cefa0 con 0x7f54d815e5b0 2024-05-27T10:53:35.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.336+0000 7f54dde00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f54d80d1790 con 0x7f54d815e990 2024-05-27T10:53:35.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.336+0000 7f54dde00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f54d80cf240 con 0x7f54d80d1210 2024-05-27T10:53:35.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.337+0000 7f54dd400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54d80d1210 0x7f54d80d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:35.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.337+0000 7f54dd400640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54d80d1210 0x7f54d80d28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:60138/0 (socket says 172.21.15.47:60138) 2024-05-27T10:53:35.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.337+0000 7f54dd400640 1 -- 172.21.15.47:0/446223110 learned_addr learned my addr 172.21.15.47:0/446223110 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:35.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.337+0000 7f54d7e00640 1 --2- 172.21.15.47:0/446223110 >> v2:172.21.15.53:3300/0 conn(0x7f54d815e990 0x7f54d80d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:35.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.338+0000 7f54d7400640 1 -- 172.21.15.47:0/446223110 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3046454568 0 0) 0x7f54d80cefa0 con 0x7f54d815e5b0 2024-05-27T10:53:35.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.338+0000 7f54d7400640 1 -- 172.21.15.47:0/446223110 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54bc003520 con 0x7f54d815e5b0 2024-05-27T10:53:35.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.338+0000 7f54d7e00640 1 -- 172.21.15.47:0/446223110 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54d80d1210 msgr2=0x7f54d80d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:35.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.338+0000 7f54d7e00640 1 --2- 172.21.15.47:0/446223110 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54d80d1210 0x7f54d80d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:35.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.338+0000 7f54d7e00640 1 -- 172.21.15.47:0/446223110 >> v1:172.21.15.53:6789/0 conn(0x7f54d815e5b0 legacy=0x7f54d80cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:35.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.338+0000 7f54d7e00640 1 -- 172.21.15.47:0/446223110 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d80cf520 con 0x7f54d815e990 2024-05-27T10:53:35.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.340+0000 7f54d7e00640 1 --2- 172.21.15.47:0/446223110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54d815e990 0x7f54d80d0cd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f54c00097a0 tx=0x7f54c002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbffa205a7d0b5c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:35.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.340+0000 7f54d7400640 1 -- 172.21.15.47:0/446223110 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c0037070 con 0x7f54d815e990 2024-05-27T10:53:35.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.340+0000 7f54d7400640 1 -- 172.21.15.47:0/446223110 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c002ae50 con 0x7f54d815e990 2024-05-27T10:53:35.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.340+0000 7f54d7400640 1 -- 172.21.15.47:0/446223110 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c0032660 con 0x7f54d815e990 2024-05-27T10:53:35.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.341+0000 7f54dde00640 1 -- 172.21.15.47:0/446223110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54d815e990 msgr2=0x7f54d80d0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:35.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.341+0000 7f54dde00640 1 --2- 172.21.15.47:0/446223110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54d815e990 0x7f54d80d0cd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f54c00097a0 tx=0x7f54c002a100 comp rx=0 tx=0).stop 2024-05-27T10:53:35.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.341+0000 7f54dde00640 1 -- 172.21.15.47:0/446223110 shutdown_connections 2024-05-27T10:53:35.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.341+0000 7f54dde00640 1 --2- 172.21.15.47:0/446223110 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54d80d1210 0x7f54d80d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:35.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.341+0000 7f54dde00640 1 --2- 172.21.15.47:0/446223110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54d815e990 0x7f54d80d0cd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:35.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.341+0000 7f54dde00640 1 -- 172.21.15.47:0/446223110 >> 172.21.15.47:0/446223110 conn(0x7f54d809d850 msgr2=0x7f54d808bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:35.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.341+0000 7f54dde00640 1 -- 172.21.15.47:0/446223110 shutdown_connections 2024-05-27T10:53:35.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.341+0000 7f54dde00640 1 -- 172.21.15.47:0/446223110 wait complete. 2024-05-27T10:53:35.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.343+0000 7f54dde00640 1 Processor -- start 2024-05-27T10:53:35.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.343+0000 7f54dde00640 1 -- start start 2024-05-27T10:53:35.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.344+0000 7f54dde00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54d80d1210 0x7f54d81f78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:35.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.344+0000 7f54dde00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54d815e5b0 0x7f54d80c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:35.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.344+0000 7f54dde00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54d815e990 0x7f54d80ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:35.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.344+0000 7f54dde00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f54d80d2e10 con 0x7f54d80d1210 2024-05-27T10:53:35.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.344+0000 7f54dde00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f54d81631a0 con 0x7f54d815e5b0 2024-05-27T10:53:35.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.344+0000 7f54dde00640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f54d80d2f90 con 0x7f54d815e990 2024-05-27T10:53:35.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.344+0000 7f54dca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54d80d1210 0x7f54d81f78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:35.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.345+0000 7f54dca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54d80d1210 0x7f54d81f78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53896/0 (socket says 172.21.15.47:53896) 2024-05-27T10:53:35.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.345+0000 7f54dca00640 1 -- 172.21.15.47:0/3754782396 learned_addr learned my addr 172.21.15.47:0/3754782396 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:35.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.345+0000 7f54dca00640 1 -- 172.21.15.47:0/3754782396 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54d815e990 msgr2=0x7f54d80ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:35.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.345+0000 7f54dca00640 1 --2- 172.21.15.47:0/3754782396 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54d815e990 0x7f54d80ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:35.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.345+0000 7f54dca00640 1 -- 172.21.15.47:0/3754782396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54d815e5b0 msgr2=0x7f54d80c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:35.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.345+0000 7f54dca00640 1 --2- 172.21.15.47:0/3754782396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54d815e5b0 0x7f54d80c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:35.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.345+0000 7f54dca00640 1 -- 172.21.15.47:0/3754782396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d815f4b0 con 0x7f54d80d1210 2024-05-27T10:53:35.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.345+0000 7f54dca00640 1 --2- 172.21.15.47:0/3754782396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54d80d1210 0x7f54d81f78f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f54c800c840 tx=0x7f54c800cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:35.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.346+0000 7f54d4c00640 1 -- 172.21.15.47:0/3754782396 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c8003b70 con 0x7f54d80d1210 2024-05-27T10:53:35.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.346+0000 7f54d4c00640 1 -- 172.21.15.47:0/3754782396 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c8003d10 con 0x7f54d80d1210 2024-05-27T10:53:35.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.346+0000 7f54d4c00640 1 -- 172.21.15.47:0/3754782396 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c800aa70 con 0x7f54d80d1210 2024-05-27T10:53:35.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.346+0000 7f54dde00640 1 -- 172.21.15.47:0/3754782396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d815f790 con 0x7f54d80d1210 2024-05-27T10:53:35.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.346+0000 7f54dde00640 1 -- 172.21.15.47:0/3754782396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d815fd50 con 0x7f54d80d1210 2024-05-27T10:53:35.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.347+0000 7f54dde00640 1 -- 172.21.15.47:0/3754782396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54d8073440 con 0x7f54d80d1210 2024-05-27T10:53:35.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.348+0000 7f54d4c00640 1 -- 172.21.15.47:0/3754782396 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f54c800ac10 con 0x7f54d80d1210 2024-05-27T10:53:35.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.349+0000 7f54d4c00640 1 --2- 172.21.15.47:0/3754782396 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f54b406c970 0x7f54b406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:35.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.349+0000 7f54d4c00640 1 -- 172.21.15.47:0/3754782396 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f54c808ba60 con 0x7f54d80d1210 2024-05-27T10:53:35.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.350+0000 7f54d7e00640 1 --2- 172.21.15.47:0/3754782396 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f54b406c970 0x7f54b406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:35.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.351+0000 7f54d7e00640 1 --2- 172.21.15.47:0/3754782396 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f54b406c970 0x7f54b406ee30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f54c0034000 tx=0x7f54c002c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:35.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.354+0000 7f54d4c00640 1 -- 172.21.15.47:0/3754782396 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f54d8073440 con 0x7f54d80d1210 2024-05-27T10:53:35.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.587+0000 7f54dde00640 1 -- 172.21.15.47:0/3754782396 --> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f54d81600a0 con 0x7f54b406c970 2024-05-27T10:53:35.593 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:53:35.596+0000 7f2e39600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T10:53:35.593 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:53:35.596+0000 7f2e39600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T10:53:35.593 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:53:35.596+0000 7f2e39600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T10:53:35.594 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:53:35.596+0000 7f2e39600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T10:53:35.594 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-27T10:53:35.596+0000 7f2e39600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T10:53:35.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.671+0000 7f54d4c00640 1 -- 172.21.15.47:0/3754782396 <== mgr.4108 v2:172.21.15.47:6832/3679485934 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f54d81600a0 con 0x7f54b406c970 2024-05-27T10:53:35.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.674+0000 7f54dde00640 1 -- 172.21.15.47:0/3754782396 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f54b406c970 msgr2=0x7f54b406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:35.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.675+0000 7f54dde00640 1 --2- 172.21.15.47:0/3754782396 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f54b406c970 0x7f54b406ee30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f54c0034000 tx=0x7f54c002c000 comp rx=0 tx=0).stop 2024-05-27T10:53:35.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.675+0000 7f54dde00640 1 -- 172.21.15.47:0/3754782396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54d80d1210 msgr2=0x7f54d81f78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:35.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.675+0000 7f54dde00640 1 --2- 172.21.15.47:0/3754782396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54d80d1210 0x7f54d81f78f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f54c800c840 tx=0x7f54c800cd00 comp rx=0 tx=0).stop 2024-05-27T10:53:35.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.675+0000 7f54dde00640 1 -- 172.21.15.47:0/3754782396 shutdown_connections 2024-05-27T10:53:35.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.675+0000 7f54dde00640 1 --2- 172.21.15.47:0/3754782396 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7f54b406c970 0x7f54b406ee30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:35.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.675+0000 7f54dde00640 1 --2- 172.21.15.47:0/3754782396 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54d815e990 0x7f54d80ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:35.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.675+0000 7f54dde00640 1 --2- 172.21.15.47:0/3754782396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54d815e5b0 0x7f54d80c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:35.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.675+0000 7f54dde00640 1 --2- 172.21.15.47:0/3754782396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54d80d1210 0x7f54d81f78f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:35.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.675+0000 7f54dde00640 1 -- 172.21.15.47:0/3754782396 >> 172.21.15.47:0/3754782396 conn(0x7f54d809d850 msgr2=0x7f54d80b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:35.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.675+0000 7f54dde00640 1 -- 172.21.15.47:0/3754782396 shutdown_connections 2024-05-27T10:53:35.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.675+0000 7f54dde00640 1 -- 172.21.15.47:0/3754782396 wait complete. 2024-05-27T10:53:35.695 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-27T10:53:35.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.910+0000 7fbf9a600640 1 Processor -- start 2024-05-27T10:53:35.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.910+0000 7fbf9a600640 1 -- start start 2024-05-27T10:53:35.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.912+0000 7fbf9a600640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbf9415c510 0x7fbf940b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:36.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.912+0000 7fbf9a600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbf940d0a30 0x7fbf940ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:36.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.912+0000 7fbf9a600640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf940b4620 con 0x7fbf9406da80 2024-05-27T10:53:36.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.912+0000 7fbf9a600640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fbf940b4900 con 0x7fbf9415c510 2024-05-27T10:53:36.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.912+0000 7fbf9a600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbf940b4be0 con 0x7fbf940d0a30 2024-05-27T10:53:36.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.913+0000 7fbf99c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbf940d0a30 0x7fbf940ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:36.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.913+0000 7fbf99200640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbf9415c510 0x7fbf940b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:36.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.913+0000 7fbf99c00640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbf940d0a30 0x7fbf940ce9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.47:60172/0 (socket says 172.21.15.47:60172) 2024-05-27T10:53:36.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.913+0000 7fbf99c00640 1 -- 172.21.15.47:0/2442428999 learned_addr learned my addr 172.21.15.47:0/2442428999 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:36.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.914+0000 7fbf99c00640 1 -- 172.21.15.47:0/2442428999 >> v2:172.21.15.53:3300/0 conn(0x7fbf9415c510 msgr2=0x7fbf940b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T10:53:36.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.914+0000 7fbf99c00640 1 --2- 172.21.15.47:0/2442428999 >> v2:172.21.15.53:3300/0 conn(0x7fbf9415c510 0x7fbf940b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:36.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.914+0000 7fbf99c00640 1 -- 172.21.15.47:0/2442428999 >> v1:172.21.15.53:6789/0 conn(0x7fbf9406da80 legacy=0x7fbf940d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:36.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.914+0000 7fbf99c00640 1 -- 172.21.15.47:0/2442428999 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf940b4ec0 con 0x7fbf940d0a30 2024-05-27T10:53:36.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.914+0000 7fbf99200640 1 --2- 172.21.15.47:0/2442428999 >> v2:172.21.15.53:3300/0 conn(0x7fbf9415c510 0x7fbf940b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T10:53:36.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.914+0000 7fbf93400640 1 -- 172.21.15.47:0/2442428999 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1196516025 0 0) 0x7fbf940b4620 con 0x7fbf9406da80 2024-05-27T10:53:36.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.915+0000 7fbf99c00640 1 --2- 172.21.15.47:0/2442428999 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbf940d0a30 0x7fbf940ce9f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c009e50 tx=0x7fbf8c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b80223a8490c2d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:36.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.916+0000 7fbf93400640 1 -- 172.21.15.47:0/2442428999 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c036070 con 0x7fbf940d0a30 2024-05-27T10:53:36.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.916+0000 7fbf93400640 1 -- 172.21.15.47:0/2442428999 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf8c031600 con 0x7fbf940d0a30 2024-05-27T10:53:36.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.916+0000 7fbf93400640 1 -- 172.21.15.47:0/2442428999 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c0319d0 con 0x7fbf940d0a30 2024-05-27T10:53:36.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.917+0000 7fbf9a600640 1 -- 172.21.15.47:0/2442428999 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbf940d0a30 msgr2=0x7fbf940ce9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:36.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.917+0000 7fbf9a600640 1 --2- 172.21.15.47:0/2442428999 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbf940d0a30 0x7fbf940ce9f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c009e50 tx=0x7fbf8c02a710 comp rx=0 tx=0).stop 2024-05-27T10:53:36.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.917+0000 7fbf9a600640 1 -- 172.21.15.47:0/2442428999 shutdown_connections 2024-05-27T10:53:36.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.917+0000 7fbf9a600640 1 --2- 172.21.15.47:0/2442428999 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbf940d0a30 0x7fbf940ce9f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:36.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.917+0000 7fbf9a600640 1 --2- 172.21.15.47:0/2442428999 >> v2:172.21.15.53:3300/0 conn(0x7fbf9415c510 0x7fbf940b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:36.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.917+0000 7fbf9a600640 1 -- 172.21.15.47:0/2442428999 >> 172.21.15.47:0/2442428999 conn(0x7fbf9406bb20 msgr2=0x7fbf9406bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:36.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.917+0000 7fbf9a600640 1 -- 172.21.15.47:0/2442428999 shutdown_connections 2024-05-27T10:53:36.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.917+0000 7fbf9a600640 1 -- 172.21.15.47:0/2442428999 wait complete. 2024-05-27T10:53:36.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.919+0000 7fbf9a600640 1 Processor -- start 2024-05-27T10:53:36.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.919+0000 7fbf9a600640 1 -- start start 2024-05-27T10:53:36.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.920+0000 7fbf9a600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf9406da80 0x7fbf9414d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:36.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.920+0000 7fbf9a600640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbf940d0a30 0x7fbf9415e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:36.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.920+0000 7fbf9a600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf9415c510 0x7fbf940ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:36.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.920+0000 7fbf9a600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbf940b4390 con 0x7fbf9415c510 2024-05-27T10:53:36.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.920+0000 7fbf9a600640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbf940b4210 con 0x7fbf9406da80 2024-05-27T10:53:36.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.920+0000 7fbf9a600640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbf940cef30 con 0x7fbf940d0a30 2024-05-27T10:53:36.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.920+0000 7fbf99c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf9415c510 0x7fbf940ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:36.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.920+0000 7fbf99c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf9415c510 0x7fbf940ad030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53914/0 (socket says 172.21.15.47:53914) 2024-05-27T10:53:36.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.920+0000 7fbf99c00640 1 -- 172.21.15.47:0/3041328504 learned_addr learned my addr 172.21.15.47:0/3041328504 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-27T10:53:36.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.921+0000 7fbf99200640 1 --2- 172.21.15.47:0/3041328504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf9406da80 0x7fbf9414d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:36.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.921+0000 7fbf93e00640 1 --2- 172.21.15.47:0/3041328504 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbf940d0a30 0x7fbf9415e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.921+0000 7fbf99c00640 1 -- 172.21.15.47:0/3041328504 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbf940d0a30 msgr2=0x7fbf9415e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.921+0000 7fbf99c00640 1 --2- 172.21.15.47:0/3041328504 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbf940d0a30 0x7fbf9415e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.921+0000 7fbf99c00640 1 -- 172.21.15.47:0/3041328504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf9406da80 msgr2=0x7fbf9414d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.921+0000 7fbf99c00640 1 --2- 172.21.15.47:0/3041328504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf9406da80 0x7fbf9414d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.921+0000 7fbf99c00640 1 -- 172.21.15.47:0/3041328504 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf94156580 con 0x7fbf9415c510 2024-05-27T10:53:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.921+0000 7fbf93e00640 1 --2- 172.21.15.47:0/3041328504 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbf940d0a30 0x7fbf9415e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T10:53:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.921+0000 7fbf99c00640 1 --2- 172.21.15.47:0/3041328504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf9415c510 0x7fbf940ad030 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c009e50 tx=0x7fbf8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.921+0000 7fbf90c00640 1 -- 172.21.15.47:0/3041328504 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c041020 con 0x7fbf9415c510 2024-05-27T10:53:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.922+0000 7fbf90c00640 1 -- 172.21.15.47:0/3041328504 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf8c037040 con 0x7fbf9415c510 2024-05-27T10:53:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.922+0000 7fbf90c00640 1 -- 172.21.15.47:0/3041328504 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c036050 con 0x7fbf9415c510 2024-05-27T10:53:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.922+0000 7fbf9a600640 1 -- 172.21.15.47:0/3041328504 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf94156860 con 0x7fbf9415c510 2024-05-27T10:53:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.922+0000 7fbf9a600640 1 -- 172.21.15.47:0/3041328504 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf94156e20 con 0x7fbf9415c510 2024-05-27T10:53:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.923+0000 7fbf9a600640 1 -- 172.21.15.47:0/3041328504 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf9404fce0 con 0x7fbf9415c510 2024-05-27T10:53:36.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.924+0000 7fbf90c00640 1 -- 172.21.15.47:0/3041328504 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbf8c007c50 con 0x7fbf9415c510 2024-05-27T10:53:36.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.925+0000 7fbf90c00640 1 --2- 172.21.15.47:0/3041328504 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbf7406c920 0x7fbf7406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T10:53:36.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.925+0000 7fbf90c00640 1 -- 172.21.15.47:0/3041328504 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fbf8c0ac200 con 0x7fbf9415c510 2024-05-27T10:53:36.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.925+0000 7fbf99200640 1 --2- 172.21.15.47:0/3041328504 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbf7406c920 0x7fbf7406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T10:53:36.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.926+0000 7fbf99200640 1 --2- 172.21.15.47:0/3041328504 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbf7406c920 0x7fbf7406ede0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbf9406c1b0 tx=0x7fbf88008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T10:53:36.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:35.930+0000 7fbf90c00640 1 -- 172.21.15.47:0/3041328504 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbf8c04b060 con 0x7fbf9415c510 2024-05-27T10:53:36.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:36.165+0000 7fbf9a600640 1 -- 172.21.15.47:0/3041328504 --> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fbf9415f180 con 0x7fbf7406c920 2024-05-27T10:53:36.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:36.173+0000 7fbf90c00640 1 -- 172.21.15.47:0/3041328504 <== mgr.4108 v2:172.21.15.47:6832/3679485934 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7fbf880118e0 con 0x7fbf7406c920 2024-05-27T10:53:36.211 INFO:teuthology.orchestra.run.smithi047.stdout:/volumes/_nogroup/sv1/9d146f8b-67c1-4a9b-8d64-3b2aadfbb28a 2024-05-27T10:53:36.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:36.176+0000 7fbf9a600640 1 -- 172.21.15.47:0/3041328504 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbf7406c920 msgr2=0x7fbf7406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:36.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:36.176+0000 7fbf9a600640 1 --2- 172.21.15.47:0/3041328504 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbf7406c920 0x7fbf7406ede0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbf9406c1b0 tx=0x7fbf88008040 comp rx=0 tx=0).stop 2024-05-27T10:53:36.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:36.176+0000 7fbf9a600640 1 -- 172.21.15.47:0/3041328504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf9415c510 msgr2=0x7fbf940ad030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T10:53:36.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:36.176+0000 7fbf9a600640 1 --2- 172.21.15.47:0/3041328504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf9415c510 0x7fbf940ad030 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c009e50 tx=0x7fbf8c004a40 comp rx=0 tx=0).stop 2024-05-27T10:53:36.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:36.176+0000 7fbf9a600640 1 -- 172.21.15.47:0/3041328504 shutdown_connections 2024-05-27T10:53:36.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:36.176+0000 7fbf9a600640 1 --2- 172.21.15.47:0/3041328504 >> [v2:172.21.15.47:6832/3679485934,v1:172.21.15.47:6833/3679485934] conn(0x7fbf7406c920 0x7fbf7406ede0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:36.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:36.176+0000 7fbf9a600640 1 --2- 172.21.15.47:0/3041328504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf9415c510 0x7fbf940ad030 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:36.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:36.176+0000 7fbf9a600640 1 --2- 172.21.15.47:0/3041328504 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbf940d0a30 0x7fbf9415e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:36.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:36.176+0000 7fbf9a600640 1 --2- 172.21.15.47:0/3041328504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf9406da80 0x7fbf9414d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T10:53:36.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:36.176+0000 7fbf9a600640 1 -- 172.21.15.47:0/3041328504 >> 172.21.15.47:0/3041328504 conn(0x7fbf9406bb20 msgr2=0x7fbf940d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T10:53:36.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:36.176+0000 7fbf9a600640 1 -- 172.21.15.47:0/3041328504 shutdown_connections 2024-05-27T10:53:36.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-27T10:53:36.177+0000 7fbf9a600640 1 -- 172.21.15.47:0/3041328504 wait complete. 2024-05-27T10:53:36.214 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 10 files each 1024MB size under directory volumes/_nogroup/sv1/9d146f8b-67c1-4a9b-8d64-3b2aadfbb28a 2024-05-27T10:53:36.214 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:53:36.214 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:53:36.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:53:36.275 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/9d146f8b-67c1-4a9b-8d64-3b2aadfbb28a/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-27T10:53:52.687 INFO:teuthology.orchestra.run.smithi047.stderr:1024+0 records in 2024-05-27T10:53:52.687 INFO:teuthology.orchestra.run.smithi047.stderr:1024+0 records out 2024-05-27T10:53:52.687 INFO:teuthology.orchestra.run.smithi047.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 16.322 s, 65.8 MB/s 2024-05-27T10:53:52.689 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:53:52.689 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:53:52.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:53:52.746 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/9d146f8b-67c1-4a9b-8d64-3b2aadfbb28a/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-27T10:54:01.590 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T10:54:01.597 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T10:54:06.466 INFO:teuthology.orchestra.run.smithi047.stderr:1024+0 records in 2024-05-27T10:54:06.466 INFO:teuthology.orchestra.run.smithi047.stderr:1024+0 records out 2024-05-27T10:54:06.466 INFO:teuthology.orchestra.run.smithi047.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 13.6553 s, 78.6 MB/s 2024-05-27T10:54:06.469 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:54:06.469 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:54:06.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:54:06.528 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/9d146f8b-67c1-4a9b-8d64-3b2aadfbb28a/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-27T10:54:20.713 INFO:teuthology.orchestra.run.smithi047.stderr:1024+0 records in 2024-05-27T10:54:20.713 INFO:teuthology.orchestra.run.smithi047.stderr:1024+0 records out 2024-05-27T10:54:20.713 INFO:teuthology.orchestra.run.smithi047.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 14.1211 s, 76.0 MB/s 2024-05-27T10:54:20.715 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:54:20.715 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:54:20.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:54:20.773 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/9d146f8b-67c1-4a9b-8d64-3b2aadfbb28a/subvolume_file.3 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-27T10:54:31.721 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T10:54:31.733 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T10:54:34.267 INFO:teuthology.orchestra.run.smithi047.stderr:1024+0 records in 2024-05-27T10:54:34.268 INFO:teuthology.orchestra.run.smithi047.stderr:1024+0 records out 2024-05-27T10:54:34.268 INFO:teuthology.orchestra.run.smithi047.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 13.4277 s, 80.0 MB/s 2024-05-27T10:54:34.270 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:54:34.270 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:54:34.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:54:34.318 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/9d146f8b-67c1-4a9b-8d64-3b2aadfbb28a/subvolume_file.4 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-27T10:54:49.042 INFO:teuthology.orchestra.run.smithi047.stderr:1024+0 records in 2024-05-27T10:54:49.043 INFO:teuthology.orchestra.run.smithi047.stderr:1024+0 records out 2024-05-27T10:54:49.043 INFO:teuthology.orchestra.run.smithi047.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 14.6178 s, 73.5 MB/s 2024-05-27T10:54:49.044 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:54:49.044 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:54:49.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:54:49.098 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/9d146f8b-67c1-4a9b-8d64-3b2aadfbb28a/subvolume_file.5 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-27T10:55:01.877 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T10:55:01.886 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T10:55:02.644 INFO:teuthology.orchestra.run.smithi047.stderr:1024+0 records in 2024-05-27T10:55:02.645 INFO:teuthology.orchestra.run.smithi047.stderr:1024+0 records out 2024-05-27T10:55:02.645 INFO:teuthology.orchestra.run.smithi047.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 13.4828 s, 79.6 MB/s 2024-05-27T10:55:02.647 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:55:02.647 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:55:02.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:55:02.702 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/9d146f8b-67c1-4a9b-8d64-3b2aadfbb28a/subvolume_file.6 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-27T10:55:16.429 INFO:teuthology.orchestra.run.smithi047.stderr:1024+0 records in 2024-05-27T10:55:16.430 INFO:teuthology.orchestra.run.smithi047.stderr:1024+0 records out 2024-05-27T10:55:16.430 INFO:teuthology.orchestra.run.smithi047.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 13.6651 s, 78.6 MB/s 2024-05-27T10:55:16.431 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:55:16.432 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:55:16.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:55:16.486 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/9d146f8b-67c1-4a9b-8d64-3b2aadfbb28a/subvolume_file.7 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-27T10:55:30.321 INFO:teuthology.orchestra.run.smithi047.stderr:1024+0 records in 2024-05-27T10:55:30.321 INFO:teuthology.orchestra.run.smithi047.stderr:1024+0 records out 2024-05-27T10:55:30.321 INFO:teuthology.orchestra.run.smithi047.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 13.7747 s, 78.0 MB/s 2024-05-27T10:55:30.323 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:55:30.323 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:55:30.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:55:30.380 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/9d146f8b-67c1-4a9b-8d64-3b2aadfbb28a/subvolume_file.8 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-27T10:55:32.026 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T10:55:32.034 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T10:55:43.305 INFO:teuthology.orchestra.run.smithi047.stderr:1024+0 records in 2024-05-27T10:55:43.305 INFO:teuthology.orchestra.run.smithi047.stderr:1024+0 records out 2024-05-27T10:55:43.305 INFO:teuthology.orchestra.run.smithi047.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 12.8621 s, 83.5 MB/s 2024-05-27T10:55:43.307 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-27T10:55:43.307 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T10:55:43.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T10:55:43.365 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/9d146f8b-67c1-4a9b-8d64-3b2aadfbb28a/subvolume_file.9 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-27T10:55:48.568 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-05-27T10:55:48.568 DEBUG:teuthology.task.console_log:Killing console logger for smithi047 2024-05-27T10:55:48.569 DEBUG:teuthology.task.console_log:Killing console logger for smithi053 2024-05-27T10:55:48.569 DEBUG:teuthology.exit:Finished running handlers